Etl Consultant Resume
CA
SUMMARY
- 13 years of Strong IT and leadership experience in DW/BI specifically in the area of analyzing, designing and implementing business technology solutions in ETL/Data warehousing including experience working directly with clients and leading ETL teams.
- Development of Data Quality mappings and Building Data Warehouse using ETL - Informatica Power Center 9x, 10.1, 10.2 &10.4 for OLTP, OLAP and equivalent large systems
- Experience and Knowledge in banking, health care domain. Worked with various prestigious clients like Confidential Bank, Confidential, Confidential, Confidential.
- Have strong conceptual and logical ETL designing skills involving data analyzing, data cleansing and validation, requirements gathering, creating data mapping documents, implementing, and testing areas.
- Experience in requirement gathering, data analysis and data profiling using complex SQL queries
- Experience in gathering and analyzing the data, cleaning the data to remove errors and ensure consistency of data.
- Proficient in understanding DW Business processes / requirements and translating them into technical requirements for ETL DW projects.
- Experience in IBM Info sphere Data stage 11.5/9.x/8.x/7.5.x Suite. (Data stage & Information Analyzer).
- Experience in working with relational databases such as Oracle 11g/10g/9i/8x, SQL Server 2008/2005, DB2 8.0/7.0 .
- Strong Database skills in writing advanced SQL and PL/SQL queries in Oracle .
- Strong UNIX scripting for invoking and executing ETL sessions using static and dynamic parameter files. Have Knowledge in Python scripting.
- Excellent analytical, high level and low level design creation, and problem solving skills.
- Ability to understand business areas and propose solutions that meet customer needs.
- Experience in working with multiple vendors and geographically distributed teams.
- Experience in leading ETL teams, guiding them taking the requirement further till build phase and updating management with the updates.
- Strong knowledge in Dimensional modeling like Star Schema and Snowflake Schema.
- Extensively used ETL methodologies for supporting data extraction, transformations and loading processing using Ab Initio and Informatica Power Centre.
- Ability to handle multiple tasks, initiative and adaptable. Proactive team player with capability of handling responsibilities independently as well.
- Extensive experience in designing and developing Data Warehouses/Data Marts with expertise in using Data Warehousing tools such as Informatica Power Centre and Datastage.
- Experience in Data modelling, Data Analysis and Profiling, ETL Design, Development, Testing, Implementation and troubleshooting/debugging in the field of Data warehousing and Business Intelligence.
- Analyzed the requirements and planned the strategy and approach in driving the development phase of the project.
- Been responsible for deployment of ETL mappings after successful completion of testing phase.
- Been responsible for defining processes, improving data scalability, and review of designs, codes and test plans.
- Been involved in creating technical design documents, build source to target mapping documents (STTM), unit & integration test documents, leading ETL team and onsite-offshore coordination.
- Strong UNIX scripting for invoking and executing ETL sessions using static and dynamic parameter files.
- Experience in integration of various data sources from Databases like Oracle, SQL Server and dealing source files like XML files and regular flat files (.dat, .csv).
- Good knowledge in Agile Methodology and experience working in Scrum Teams.
- Expertise in post production support, enhancements and performance tuning.
- Coordinate with multiple vendors from geographically distributed teams for a successful development, testing and deployment of a single project.
- Strong database skills, Software Development Life Cycle and development knowledge.
- Conduct Impact Analysis, create Design Specifications as per the high-level design, and create Unit Test Plans in order todevelop / validate / maintain the application as per the requirements.
- Experience in security, reliability of the platform, Incident Management, Change management process during and after implementation.
- Experience in Coordinating onsite - offshore interaction, contributed suggestions and valuable solutions during the on-going. Good communication skills, interpersonal skills, self-motivated, quick learner and valuable team player.
- Expertise in postproduction support, enhancements, and performance tuning.
TECHNICAL SKILLS
Domain: Banking & Health Care
Data Warehousing Tool: Informatica Power Center 10.4/10.2/10.1/9.6.1 , Data Stage 11.5, 9.1, 8.7,8.5 & MDM
Data Modeling: Relational, Star and Snowflake Schema
Databases: DB2,Oracle, SQL Server & Teradata
Scripting Languages: UNIX Shell Scripts, Python
Project Tools: Tidal, Autosys, Toad, putty,Db2.
PROFESSIONAL EXPERIENCE
Confidential, CA
ETL Consultant
Responsibilities:
- Designed and developed the data transformations for source system data extraction; staging, movement, and aggregation; information and analytics delivery; and data quality handling, system testing, performance tuning. Created Informatica Mappings to build business rules to load data using transformations like Source Qualifier, Aggregator, Expression, Joiner, Connected and Unconnected lookups, Filters and Sequence, External Procedure, Router and Update strategy.
- Stored reformatted data from relational, flat file, XML files using Informatica (ETL).
- Worked on different tasks in Workflows like sessions, events raise, event wait, decision, e-mail, command, worklets, Assignment, Timer and scheduling of the workflow.
- Used Type 1 SCD and Type 2 SCD mappings to update slowly Changing Dimension Tables
- Developed Change detection capture (CDC) processes to identify new and changed loan related information
- Created scripts to createnew tables, views, queriesfor new enhancement in the application using SQL Developer.
- Created and modified severalUNIX shell scriptsaccording to the changing needs of the project and client requirements.
- Created scripts to createnew tables, views, queriesfor new enhancement in the application using TOAD. Createdindexes on the tables for faster retrieval of the data to enhance databaseperformance.
- Created Views which can act as aggregated tables, where the database engine aggregates data (sum, average, etc.) and presents the calculated results as part of the data.
- Used Views extensively in this project as it can hide the complexity of data. transparently partitioning the actual underlying table.
- Involved in data loading usingPL/SQLandSQL*Loadercalling UNIX scripts to download and manipulate files.
- UsedBulk Collectionsforbetter performanceand easy retrieval of data, by reducing context switching between SQL and PL/SQL engines.
- Extensively used the advanced features of PL/SQL likeRecords, Tables, Object typesandDynamic SQL.
Confidential, San Ramon, CA
ETL Developer
Responsibilities:
- Develop ETL mappings using Power Center tools - designer, workflow manager, workflow monitor
- Designed and developed the data transformations for source system data extraction; staging, movement and aggregation, data quality handling, system testing and performance tuning.
- Created scripts to createnew tables, views, queriesfor new enhancement in the application using SQL Developer.
- Conduct Impact Analysis, create Design Specifications as per the high-level design, and create Unit Test Plans in order todevelop / validate / maintain the application as per the requirements
- Document design documents for the respective modules
- Conduct root cause analysis of issues and failures and provide solutions for the same.
- Work on complex Oracle SQL queries and shell scripting.
- Create health checks for data validations like column validations, count validations, etc. to ensure data quality.
- Perform unit testing and create Unit Test Plans to ensure quality of code.
Confidential, Pleasanton CA
ETL Consultant
Responsibilities:
- Requirement gathering, data analysis and data profiling using SQL
- Develop end to end ETL mappings using Power Center tools - designer, workflow manager, workflow monitor
- Designed and developed the data transformations for source system data extraction; staging, movement and aggregation, data quality handling, system testing and performance tuning.
- Created scripts to createnew tables, views, queriesfor new enhancement in the application using SQL Developer.
- Conduct Impact Analysis, create Design Specifications as per the high-level design, and create Unit Test Plans in order todevelop / validate / maintain the application as per the requirements
- Document design documents for the respective modules.
- Conduct root cause analysis of issues and failures and provide solutions for the same.
- Work on complex Oracle SQL queries and shell scripting.
- Perform unit testing and create Unit Test Plans to ensure quality of code.
- Work with Tidal Scheduling team to help them create scheduled jobs.
- Participate in peer code review and design reviews for code quality improvements
- Support production issues post deployment to prod environment and resolve development and implementation issues.
Confidential, San Ramon, CA
Senior ETL Developer
Responsibilities:
- Requirement gathering, data analysis and data profiling using SQL
- Create end to end source-to-target mapping(STTM) documents and update existing documents
- Develop end to end ETL mappings using Power Center tools - designer, workflow manager, workflow monitor
- Designed and developed the data transformations for source system data extraction; staging, movement and aggregation, data quality handling, system testing and performance tuning.
- Created scripts to createnew tables, views, queriesfor new enhancement in the application using SQL Developer.
- Conduct Impact Analysis, create Design Specifications as per the high-level design, and create Unit Test Plans in order todevelop / validate / maintain the application as per the requirements
- Document design documents for the respective modules
- Conduct root cause analysis of issues and failures and provide solutions for the same.
- Work on complex Oracle SQL queries and shell scripting.
- Create health checks for data validations like column validations, count validations, etc. to ensure data quality.
- Perform unit testing and create Unit Test Plans to ensure quality of code.
- Work with Tidal Scheduling team to help them create scheduled jobs.
- Support production issues post deployment to prod environment and resolve development and implementation issues.
Confidential, Rochester, MN
ETL Consultant
Responsibilities:
- Responsible for delivering artifacts as a part of Agile methodology
- Responsible for translating business requirements into technical specs and Understanding the requirement specifications and worked closely with the business team on the requirements.
- Gathered and analyzed the requirements of the in-house business users for the data warehousing from JAD sessions.
- Collected the information about different Entities and attributes by studying the existing ODS and reverse engineering into Erwin.
- Defined the Primary keys and foreign keys for the Entities.
- Designed staging and Error handling tables keeping in view the overall ETL strategy.
- Performed Data validations across Sources, Operational Data Store and EDW.
- Worked on slowly changing dimensions based on the business requirements.
- Performed Unit testing of developed components and promoted the code to testing environment, System testing and User Acceptance Testing
- Written complex queries to test the functionality of the code during System testing.
- Designed the Unique key combination using various fields and join the tables for Reporting purposes.
- Performance tuned and optimized various complex SQL queries.
- Involved in Unit Testing, System testing and User Acceptance Testing.
- Generated Tableau Dashboard with quick/context/global filters, parameters and calculated fields on Tableau (7.x / 8.x) reports.
- Created Tableau Dashboards with interactive views, trends and drill downs along with user level security.
Confidential
ETL Consultant(Module lead)
Responsibilities:
- Understand the client and project requirements by studying the existing documentation and gathering requirements from Business Analysts/SMEs and Clients, seeking clarifications, if any, to participate efficiently in the Development and Testing phases of the project
- Requirement gathering, data analysis and data profiling using SQL
- Create end to end source-to-target mapping(STTM) documents and update existing documents
- Develop end to end ETL mappings using Power Center tools - designer, workflow manager, workflow monitor
- Designed and developed the data transformations for source system data extraction; staging, movement and aggregation, data quality handling, system testing and performance tuning.
- Created Informatica Mappings to build business rules to load data using transformations like Source Qualifier, Aggregator, Expression, Joiner, Connected and Unconnected lookups, Filters, Sequence Generator, Router and Update strategy.
- Used Type 1 SCD and Type 2 SCD mappings to update slowly Changing Dimension Tables
- Developed Change detection capture (CDC) processes to identify new and changed loan related information
- Created scripts to createnew tables, views, queriesfor new enhancement in the application using SQL Developer.
- Conduct Impact Analysis, create Design Specifications as per the high-level design, and create Unit Test Plans in order todevelop / validate / maintain the application as per the requirements
- Document both HLD and LLD for the respective modules
- Conduct root cause analysis of issues and failures and provide solution for the same.
- Coordinate with multiple vendors from geographically distributed teams for a successful development, testing and deployment of a single project
- Work on complex Oracle SQL queries and shell scripting.
- Create health checks for data validations like column validations, count validations, etc. to ensure data quality.
- Modifying existing mappings as per the change requests from the business.
- Perform unit testing and create Unit Test Plans to ensure quality of code.
- Work with Tidal Scheduling team to help then create scheduled jobs.
- Participate in peer code review and design reviews for code quality improvements
- Support production issues post deployment to prod environment and resolve development and implementation issues.
Confidential
ETL Consultant(Module lead)
Responsibilities:
- Defined the high level scope of Application Architecture, provided the solution for the design changes, build the informatica data quality mapplets and PowerCenter mappings for the Customer Identification (CID) Project.
- Analyzed and documented all client requirements and business processes.
- Worked on data cleansing and standardization using the cleanse functions in Informatica MDM.
- Used Hierarchies tool for configuring entity base objects, entity types, relationship base objects, relationship types, profiles, put and display packages and used the entity types as subject areas in IDD.
- Defined the Trust and Validation rules and setting up the match/merge rule sets to get the right master records. Configured match rule set property by enabling search by rules in MDM according to Business Rules.
- Involved in creating, monitoring, modifying, & communicating the project plan with other team members. Performed match/merge and ran match rules to check the effectiveness of MDM process on data.
- Designed and developed the data transformations for source system data extraction; staging, movement and aggregation; information and analytics delivery; and data quality handling, system testing, performance tuning.
- Created Informatica Mappings to build business rules to load data using transformations like Source Qualifier, Aggregator, Expression, Joiner, Connected and Unconnected lookups, Filters and Sequence, External Procedure, Router and Update strategy.
- Stored reformatted data from relational, flat file, XML files using Informatica (ETL).
- Worked on different tasks in Workflows like sessions, events raise, event wait, decision, e-mail, command, worklets, Assignment, Timer and scheduling of the workflow.
- Created sessions, configured workflows to extract data from various sources, transformed data, and loading into data warehouse.
- Extensively used SQL* loader to load data from flat files to the database tables in Oracle.
- Created various batch Scripts for scheduling various data cleansing scripts and loading process.
- Extensively worked on Mapping Variables, Mapping Parameters and Session Parameters.
- Created post-session and pre-session shell scripts and mail-notifications
- Working in the Oracle PL/SQL procedures & packages to analyses and develop the new business requirements and enhancements in the existing functionalities.
Confidential
Senior Software Engineer
Responsibilities:
- Collaborate with business functional leaders by analyzing and evaluating business requirements; diagnose the design, propose/design alternatives and recommendations.
- Extract structured and unstructured data from source systems, transforming it to fit business performance management needs, and loading it into a data mart.
- Ensure ETL process is developed in modular fashion in shared folders and reusable objects to enforce consistency and timely development.
- Requirement gathering, data analysis and data profiling using complex SQL queries
- Oversee the data load production process and resolve any production issues through troubleshooting and quick diagnoses.
- Ensure data quality by designing and implementing adequate internal controls and monitoring processes.
- Ensure controls are maintained when designing new structures by utilizing object naming conventions to encourage consistent development and ease of migration from development to test to production.
- Maintain effective ongoing communications with the business and IT community and operational management.
- Conduct Impact Analysis, create Design Specifications as per the high-level design, and create Unit Test Plans in order todevelop / validate / maintain the application as per the requirements.
- Document both HLD and LLD for the respective modules
- Good hands on experience in performance tuning and maintenance on ETL tool (informatica) and Oracle Database.
Confidential
Software Engineer (ETL Developer)
Responsibilities:
- Responsible for translating business requirements into technical specs.
- Understanding the requirement specifications and worked closely with the business team on the requirements.
- Worked on Data Stage - Data Stage Designer, Data Stage Manager, Data Stage Director. Involved in the development of Data Stage Parallel jobs.
- Developed jobs with collection of all source stages, target stages and processing stages like Transformer, Join, Hash, Sort, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset and Aggregator etc.
- Designed DataStage jobs using Quality Stage stages for data cleansing & data standardization Process. Implemented Survive stage & Match Stage for data patterns & data definitions. Worked on SCD Type 1- & 2-dimension designs.
- Involved in Unit Testing, System testing and User Acceptance Testing. Written complex queries to test the functionality of the code during System testing.
- Designing Job Sequences, designing Data Stage Containers and other reusable components, defining Parameters, connecting Data Stage with external databases and queues, integrating Data Stage with an external scheduling tool like Control-M.
- Tuning SQL Queries to overcome spool space errors and improve performance.
- Designed and developed the data transformations for source system data extraction; staging, movement and aggregation; information and analytics delivery; and data quality handling, system testing, performance tuning.
- Stored reformatted data from relational, flat file, XML files using DataStage (ETL).
- Worked on Dimensional modeling to design and develop STAR schemas using ER-win 4.0, Identifying Fact and Dimension Tables.
- Used Type 1 SCD and Type 2 SCD mappings to update slowly Changing Dimension Tables.
- Created post-session and pre-session shell scripts and mail-notifications
- Written Unix Shell Scripts for getting data from various source systems to Data Warehouse.