Etl Developer - Consultant Resume
Brea, CA
PROFESSIONAL SUMMARY:
- Over 8 years of extensive experience in complete Software Development Life Cycle (SDLC) including System Requirements Collection, Design, Coding, Development, Testing, Production Support, Maintenance and Enhancement in Data Warehouse and Business Intelligence applications in Windows and Unix environments
- Experienced in Design, Development, Implementation and support of ETL process for Data Marts and large Data warehousing application using Informatica Power Center 9.5,8.6,8.1,7.x
- Experienced in Writing Technical Design Document and converting Functional Specs to Technical Specs
- Experienced in Performance Tuning including identifying and eliminating bottlenecks of sources, mappings, sessions and targets.
- Experienced in designing/developing complex mappings, from varied transformation logic like Unconnected and Connected lookups, Router, Filter, Expression, Aggregator, Joiner, Update Strategy and Normalizer.
- Extensively worked with various Heterogeneous source systems like Netezza, Oracle, DB2, XML files, Flat files, Teradata and SQL Server.
- Extensive knowledge in data modelling using dimensional modelling and Kimball methodology
- Good understanding in database and data warehousing concepts (OLTP & OLAP). Experience with logical and physical data modelling and database design using Erwin.
- Strong Experience in creating Stored Procedures, Indexes, Functions and Triggers using Oracle PL/SQL.
- Hands on Experience in UNIX, Data Relationships, Data extraction & Validation.
- Expertise in scheduling the jobs using Tivoli, Tidal and Autosys
- Strong background in Data Warehousing concepts and implementing dimensional Modelling concepts (Star schema & Snow flake schema, type 2 and type 3 SCD’s, confirmed dimensions).
- Experienced in analysing business specification documents, developing test plans, defining test cases, development to support ETL processes.
- Good communication and interpersonal skills and Strong understanding of ETL best practices. Responsible for providing technical expertise for the design and execution of ETL projects while working with onshore and offshore developers.
- Extensive experience in developing the Workflows, Worklets, Mappings and configuring the Informatica Server using Informatica Power Center.
TECHNICAL SKILLS:
ETL: Informatica (Power Center 9.X, 8.X, 7.X).
Tools: SQL, PL/SQL, TOAD, TIVOLI
Operating Systems: Windows 95/98/NT /XP/2000, UNIX shell scripts
Programming languages: C, C++, Java, .NET Framework.
RDBMS: Oracle, SQL Server, DB2 and Teradata.
PROFESSIONAL EXPERIENCE
Confidential, Brea, CA
ETL Developer - Consultant
Responsibilities:
- Involved in all phases including Requirement Analysis, Design, Coding, Testing and Documentation.
- Translated the business processes into Informatica mappings.
- Responsible for coordinating development and testing efforts with offshore team members.
- Develop, test and maintain ETL procedures employing both ETL tools and custom PL/SQL.
- Participated in the development and maintenance of a Date Warehouse Routine Load Schedule.
- Involved in business requirements gathering to enable Data Integration across all business groups.
- Extensive involvement with the Quality Assurance team for building exhaustive set of test cases.
- Implemented logic to control job dependencies between the workflows solely through the use of event-raise and event-wait tasks and entries made by ETLs in pilot database tables.
- Used most of the transformations such as the Connected & Unconnected Lookups, Filters, Routers, Joiners, Stored Procedure transformations, Sequence Generators & Mapplets.
- Worked on making session runs more flexible through the use of mapping parameters and variables by using parameter files and variable functions to manipulate them.
- Implemented Slowly Changing Dimensions (Type-2).
- Identified and resolved the bottlenecks in source, target, transformations, mappings and sessions to improve performance.
- Used Repository manager to migrate code from Dev to Qa and Qa to Prod using deployment groups and Hudson Build Tool.
- Worked on Pre-Production and Post-Production Issues.
- Performed the Unit and Integration Testing which validated that the data is mapped correctly which provides a qualitative check of overall data flow.
- Created and Documented ETL Test Plans, Test Cases, Expected Results, Assumptions and Validations.
- Prepared the coding standards and quality assurance policies and procedures.
Environment: Informatica Power Center 8.6.1/9.5.1, Netezza, Sql Server 2012, DB visualizer 8.0, Shell Scripts, Tivoli, Windows XP.
Confidential, SFO, CA
ETL Developer
Responsibilities:
- Develop several complex mappings in Informatica using various transformations, Mapping Parameters, Mapping Variables and Mapplets.
- Develop workflows, used Worklets, tasks such as event waits, conditional flows, email and command.
- Reusing the single workflow for loading data from various regional files with similar file structure using indirect loading as source type in session properties.
- Expertise in Performance Tuning by identifying the bottlenecks at sources, targets, transformations and session level. For SQL tuning: used techniques like Explain plans, Oracle hints re-designing the mappings.
- Used Mapplets, Reusable transformations, Parameters and Variables to facilitate the reusability of Code.
- Used Debugger to validate the mappings and gain troubleshooting information about data and error conditions.
- Developed processes for automation of loading data using parameter driven sessions for various workflows, verification and re-conciliation of data stored in several different source systems.
- Configured and scheduled Pre and Post Session commands with Shell Scripts and invoked them using command task.
- Used TOAD as the tool to run SQL queries and validate the data.
- Extensively used command, event-wait, event-raise and control tasks for keeping track of events in the ETL process.
- Created UNIX shell script to FTP flat files from different ordering systems to the ETL server.
- Wrote stored procedures for generating the data warehouse cycle dates and to drop, re-create the indexes.
- Developed Test Cases according to Business and Technical Requirements and prepared SQL scripts to test data.
- Performed unit test for Informatica mappings and workflows in both development and test environments.
- Used Incremental aggregation to capture new source data and in scenarios where the incremental changes do not significantly change the target so that the Power Center server updates the target incrementally.
Environment: Informatica Power Center 8.6.1, Oracle 10g, TOAD, UNIX, SQL, PL/SQL and Windows XP/ 7.
Confidential, Chicago, IL
ETL Developer
Responsibilities:
- Extraction, Transformation and Loading of the data using Informatica.
- Designed the target load process based on the requirements documents.
- Enhancing the existing mappings where changes are made to the existing mappings using Informatica Power center.
- Developed various transformations like Source Qualifier, Update Strategy, Lookup transformation, Expressions and Sequence Generator for loading the data into target table.
- Created Workflows, Tasks, database connections using Workflow Manager
- Developed complex Informatica mappings and tuned them for better performance
- Created sessions and batches to move data at specific intervals & on demand using Server Manager
- Responsibilities include creating the sessions and scheduling the sessions
- Recovering the failed Sessions and Batches.
- Involving in extracting the data from Direct Flat files and Indirect Flat files.
- Implemented performance tuning techniques by identifying and resolving the bottlenecks in source, target, transformations, mappings and sessions to improve performance Understanding the Functional Requirements.
- Responsible for identifying the missed records in different stages from source to target and resolving the issue
- Preparing the documents for test data loading.
Environment: Oracle SQL * Plus, TOAD, Informatica Power center 8.1.1, PLSQL developer, Oracle SQL, PL/SQL and UNIX shell script, Oracle10g/9i, SQL Server, DB2 8.0.
Confidential
ETL Developer
Responsibilities:
- Used Informatica Power Center for (ETL) Extraction, Transformation and Loading data from heterogeneous source systems like flat files, database tables and XML files.
- Involved in importing Source/Target Tables from the respective databases and created Reusable Transformations (Joiner, Routers, Lookups, Rank, Filter, Expression, Aggregator), Mapplets and Mappings using Designer module of Informatica. Analyzed and created Facts, Dimension tables.
- Wrote complex SQL queries, stored procedures using Oracle 8i/9i and UNIX shell scripts for achieving the ETL requirements.
- Used Informatica debugging techniques to debug the mappings and used session log files and bad files to trace errors that occur while loading.
- Scheduled and executed batch and session jobs on Autosys.
- Used Informatica Version Control for checking in all versions of the objects used in creating the mappings and workflows and to keep track of the changes in the development, testing and production environments.
- Scheduled workflows and sent automatic email messages that post the statistics of the data load.
- Quickly understood and provided alternate solutions to requirement changes by simplifying mappings, sessions and workflows and improving their performance by using transformations like source filters and sorted input in aggregator while still achieving the desired results within the stipulated timeframe.
- Performed extensive testing of changes and fixes in different environments.
- Incorporated the changes and reverted to the business within the least possible turnaround time.
- Tuned performance of Informatica session for large data files by increasing block size, data cache size, sequence buffer length and target based commit interval.
- Using Informatica Repository Manager maintained all the repositories of various applications, created users, user groups, and security access control.
- Assisted in creating the Technical designspecifications based on Client functional specs.
- Designed re-usable sessions and mapplets to ensure better productivity and consistency.
- Coordinated the onsite-offshore teams for developing new requirements.
Environment: Informatica Power Center 7.1.3, SQL Server, Oracle, SQL Loader, UNIX Shell Scripting, Perl, Toad.
Confidential
ETL Developer
Responsibilities:
- Worked with Informatica as the tool to extract the data from the source into the target system.
- Participated in system analysis and data modelling, which included creating tables, views, indexes, synonyms, triggers, functions, procedures, cursors and packages.
- Writing queries and stored procedures in PL/SQL to fetch data from the OLTP system and executed at regular intervals of time.
- Modified existing forms, reports, and graphs as per the enhancement.
- Developed PL/SQL scripts to validate and load data into interface tables. The backend was in Oracle and database operations were handled using stored procedures.
- Worked on all phases of multiple projects from initial concept through research and development, implementation, QA, to live production, by strict adherence to project timelines.
- Moved data from one database to other database, Used SQL*Loader for data migration.
Environment: Informatica Power Center 7.1.3, Oracle 8i, SQL, PL/SQL, UNIX, Windows 2000, SQL Plus, SQL * Loader.