Senior Etl Engineer / Developer Resume
Brea, CA
SUMMARY
- Almost 9 years of IT experience in analysis, design, development and implementation of Data warehouses, data marts and Decision Support Systems (DSS) using Informatica Power Center with Oracle, MS SQL server, DB2 and Teradata databases.
- Thorough understanding of Software Development Life Cycle (SDLC), AGILE methodology including requirements analysis, system analysis, design, development, documentation, training, implementation and post - implementation review.
- Solid experience in Ralph Kimball Methodology, Bill Inmon Methodology, Logical Modeling, Physical Modeling, Dimensional Data Modeling, Star Schema, Snowflake Schema, FACT tables, Dimension tables.
- Strong expertise using Informatica Power Center Client tools - Designer, Repository manager, Workflow manager/monitor and Server tools - Informatica Server, Repository Server manager.Workflows using 9.x/8.x/7.x/6.x/5.x versions.
- Extensive work experience in ETL processes consisting of data sourcing, data transformation, mapping and loading of data from multiple source systems into Data Warehouse using Informatica Power Center.
- Proficient in implementing complex business rules through Informatica transformations, Workflows/Worklets and Mappings/Mapplets.
- Experience in debugging and Performance tuning of targets, sources, mappings, sessions and system and resolving performance bottlenecks in various levels like sources, targets, mappings, and sessions.
- Experience in Installation, Configuration, and Administration of Informatica Power Center Client, Server and having handled FTP systems and release management.
- Proficient in developing reports / dashboards using OBIEE 10G/ 11G.
- Good experience with OBIEE DAC server
- Customized and developed repository, configured metadata objects (Subject Area, Table, Column) and Web Catalog Objects (Dashboard, Pages, Folders, Reports).
- Developed and debugged many Dashboards using different Analytics Views (Pivot Table, Chart, and Column Selector, View Selector) and created many user interface components like columns, sections, global filters, navigation links, dashboard pages using oracle bi presentation services.
- Experience in Informatica MDM Hub Match and Merge process by creating Path components, Columns and rules Batch Jobs, Batch Groups, Validation Rules, Trust settings for source systems.
- Experience in 24X7 on call Production support and preparing procedures/documentation whenever necessary.
- Possess excellent documentation skills, prepared best practices document’sand have experience in data modeling and data modeling tools like Erwin.
- Extensive Experience in writing SQL queries, stored procedures, functions, packages, triggers, exception handlers, Cursors.
- Expert in Unit Testing, Integration testing and System Testing.
- Committed team player with multitasking capabilities. Excellent interpersonal and human relations skills. Strong communication skills, both verbal and written, with an ability to express complex business concepts in technical terms.
TECHNICAL SKILLS
ETL Tools: Informatica Power Center 9.x / 8.x / 7.x / 6.x
RDBMS: Oracle 8x/9x/10x,Netezza,Teradata, IBM DB2, MS SQL Server, My SQL, Sybase, MS Access
Business Intelligence: OBIEE 10G / 11G,MSTR 9.4/10.2
Scheduling Tools: Autosys, Tivoli
Data Modeling: Erwin, E/R Studio, Enterprise Architect
Programming Languages: SQL, PL/SQL, HTML, C, C++, UNIX Shell Scripting.
Operating Systems: Sun Solaris 8,9 / Oracle Linux 4,5,6 / Redhat Linux
PROFESSIONAL EXPERIENCE
Confidential, Brea, CA
Senior ETL Engineer / Developer
Responsibilities:
- Analyzed business requirements and worked closely with various application teams and business teams to develop ETL procedures that are consistent across all applications and system.
- Wrote Informatica ETL Design, Coding, Testing and Documentation.
- Responsible for coordinating development and testing efforts with offshore team members.
- Planned managed and executed Production Deployment across different teams like Application, Operations, Mstr, Database and ETL .
- Collaborated with Corporate Audit group and Performed Yearly KPMG walkthrough meetings on financial accounting data.
- Working with Business Analysts to find the RCA for the defects found during Corporate Audit and Sox Testing and fixing those.
- Worked on Creating Multiple data feeds for vendors like Dmv’s, Clue, Lexis Nexus and HSB etc.
- End to End data validation from Guidewire application source data to financial datafeed and MSTR reports. Troubleshooting Discrepancies between MSTR reports and financial datafeed
- Worked on an Agile SDLC model to deploy our product and customer data
- Develop, test and maintain ETL procedures employing both ETL tools and custom PL/SQL.
- Extensively worked on Power Center Client Tools like Repository Admin Console, Repository Manager, Designer, Workflow Manager, and Workflow Monitor .
- Extensively worked on Power Center Designer client tools like Source Analyzer, Warehouse Designer, Mapping Designer, Mapplet Designer and Transformation Developer.
- Worked on making session runs more flexible through the use of mapping parameters and variables by using parameter files and variable functions to manipulate them.
- Analyzed the source data coming from different sources (Netezza, DB2, XML, Sql Server, Flat files) and worked on developing ETL mappings.
- Good experience in installation of informatica Power Exchange.
- Developed complex Informatica Mappings, reusable Mapplets and Transformations for different types of tests in research studies on daily and monthly basis.
- Identified and resolved the bottlenecks in source, target, transformations, mappings and sessions to improve performance.
- Used Repository manager to migrate code from Dev to Qa and Qa to Prod using deployment groups and Hudson Build Tool.
- Worked on Pre-Production and Post-Production Issues.
- Involved with Data Steward Team for designing, documenting and configuring Informatica Data Director for supporting management ofMDMdata.
- Applied business rules using Informatica Data Quality (IDQ) tool to cleanse data
- Worked with Informatica and other consultants to develop IDQ plans to identify possible data issues and Data Profiling.
- Extensive Data modeling experience using Dimensional Data modeling, Star Schema modeling, Snowflake modeling, FACT and Dimensions tables.
- Development and maintenance of a Data Warehouse Routine jobs Schedule in Tivoli.
- Extensive involvement with the Quality Assurance team for building exhaustive set of test cases.
- Performed the Unit and Integration Testing which validated that the data is mapped correctly which provides a qualitative check of overall data flow.
- Created and Documented ETL Test Plans, Test Cases, Expected Results, Assumptions and Validations.
- Prepared the coding standards and quality assurance policies and procedures.
Environment: Guidewire Application, Informatica 9.x, Informatica MDM, IDQ, Micro Strategy9.4/10.2, Flat Files, xml files, SQL Server, Management Studio 2008, DB Visualizer 8.6, Enterprise Architect
Confidential, Torrance, CA
Senior ETL Engineer / Informatica Developer
Responsibilities:
- Worked Closely with Business Analyst and Business users in Requirement Gathering, Analysis, Process Design, Data Design, Development, Testing and Implementation of load processes and Data transformation processes.
- Involved in Dimensional modeling (Star Schema) of the Data warehouse and used Erwin 4.5 to design the business process, dimensions and measured facts.
- Responsible for developing, support and maintenance for the ETL (Extract, Transform and Load) processes using Informatica Powercenter 9.1
- Worked extensively on different transformations like source qualifier, Expression, Filter, Aggregator, Router, Update strategy, lookup, Normalizer, Stored procedure, Mapping Variables and Sequence generator and java.
- Worked on Migration Strategies between Development, Test and Production Repositories.
- Developed Unit test cases and Unit test plans to verify the data loading process.
- Created debugging sessions before the session to validate the transformations and also used existing mappings in debug mode extensively for error identification by creating break points and monitoring the debug monitor.
- Extensively worked on Performance tuning to increase the throughput of the data load (like read the data from flat file & write the data into target flat files to identify the bottlenecks).
- Automation and scheduling of UNIX and Korn shell scripts and Informatica sessions and batches using Tidal.
- Worked with command line program pmcmd to interact with the server to start and stop sessions and batches, to stop the Informatica server and recover the sessions.
- Created procedures to drop and recreate the indexes in the target Data warehouse before and after the sessions.
- Worked on Pre-Production and Post-Production Issues.
Environment: Oracle 10G, Informatica 9.x, OBIEE 10g / 11g, Oracle, TOAD, Linux 5, Flat Files, xml files, SQL Server, Management Studio 2008, SQL Developer.
Confidential, Plano, TX
Senior ETL Engineer / OBIEE Report Developer
Responsibilities:
- Requirements gathering from users through meetings, understanding the business model and end user/ executive objectives.
- Preparing the high-level technical mapping documents laying out the application logic, and designed the ETL process for data loads.
- Developing mappings for loading all the dimension and fact tables using different transformations.
- During Implementation phase, tuned Informatica Mappings and Sessions for optimum performance.
- Developed ETL mappings, transformations using Informatica PowerCenter.
- Extensively used Informatica client tools Source Analyzer, Warehouse designer, Mapping Designer, Mapplet Designer, Transformation Developer, Informatica Repository Manager and Informatica Workflow Manager.
- Extensively used ETL Tool Informatica to load data from Flat Files, Oracle.
- Developed data Mappings between source systems and target system using Mapping Designer.
- Responsible for error handling using Session Logs, Reject Files, and Session Logs in the Workflow Monitor.
- Developed reusable Mapplets and Transformations.
- Developed and tested all the Informatica mappings and update processes.
- Extensively worked with the Debugger for handling the data errors in the mapping designer
- Worked extensively on different transformations like source qualifier, Expression, Filter, Aggregator, Router, Update strategy, lookup, Normalizer, Stored procedure, Mapping Variables and Sequence generator and java.
- Solely responsible for the daily loads and handling of the rejected data.
- Testing of data warehouse using OBIEE reports and SQL statements.
- Scheduling Informatica workflows to automate the update processes.
- Writing PL/SQL functions and procedures.
- Writing UNIX shell scripts.
- Created the Colwin management and adhoc reports for the areas of support benefit issuance and recovery, program expenditures, program management, workload management.
- Worked extensively on OBIEE Answers to create the reports as per the client requirements (including compound views, table, charts)
- Created highly effective Dashboard designs by appropriately including guided navigational links and drilldowns.
- Created Proactive agents (iBots) and configured Interactive dashboards to alert the employees as per the requirements.
- Used the Catalog manager and maintained the Analytics web catalog to manage Dashboards, Answers and Delivers.
Environment: Oracle 10G, Informatica 8.x / 9.x, OBIEE 10g / 11g, Oracle Linux 5, Flat Files, xml files, SQL Developer Designer, SQL Developer, UNIX Shell Script
Confidential, Hayward, CA
Informatica Developer / Prod support
Responsibilities:
- Responsible for Business Analysis and Requirements Collection.
- Parsed high-level design specification to simple ETL coding and mapping standards.
- Designed and customized data models for Data warehouse supporting data from multiple sources on real time.
- Involved in data modeling to implement star schema database.
- Involved in understanding the business requirement, identifying the grains, designing the fact tables with key performance indicators and establishing the relations between the dimensions.
- Also created complex Oracle packages, procedures, cursors, triggers to load the data into warehouse.
- Extensive use of partitioning and indexing for high performance of query retrievals.
- Building the ETL architecture for Source to Target mapping to load data into Data warehouse.
- Worked on transformations like filter, router, connected lookup and unconnected lookup, update strategy, expression etc.
- Extensively used Erwin for data modeling and Dimensional Data Modeling.
- Write Repository Queries in support of developments and Production statistics.
- Monitoring the jobs and server space availability and CPU process.
- Developed, Modified and tested UNIX shell scripts and necessary Test plans to ensure the successful execution of the data loading process.
- Involved in migration of objects in all phases (DEV, INT and PRD) of project and trained developers to maintain system when in production.
- Creating Folders and manages user and user group access to objects in the repository.
- Responsible for performance tuning on tables having high volume of data (Terabytes) by partitioning the tables and indexing for user retrieval.
- Loading huge vendor flat files into data warehouse every day using Informatica and oracle packages.
- Created complex sql to test the data.
- Implemented Explain Plan and SQL Trace for improving the performance of SQL queries.
- Loading SAP R3 data through Informatica and using power connect to connect to SAP.
- Was responsible for the version control and up-gradation.
- Extensively used scripts for data cleansing and data loading.
- Coordinated with source system owners, monitored day-to-day ETL progress, performed Data warehouse target schema Design (Star Schema) and maintenance.
- Extensively used Workflow manager to create and schedule various Workflows and Worklets.
- On time delivery of all kinds of Adhoc reports with excellent performance.
- Worked in unit testing each workflow and then testing after all the workflows are run in a batch process.
- Involved in Data Quality Analysis to determine cleansing requirements.
- Performed Development, Test and Production mapping migration using Repository Manager. Also used Repository Manager to maintain the metadata, Security and Reporting. Tuned the Informatica Repository and Mappings for optimum performance.
Environment: Oracle 10G, Informatica 8.6.1 (Repository Manager, Admin Console, Designer, Workflow Manager, Workflow Monitor),Power Connect, SAP R3Toad, Sql Navigator, Sql Plus, Erwin 4.0, PL/SQL, Windows XP professional, Erwin 3.5.2, AIX, Shell Scripting.
Confidential
ETL / DB Developer
Responsibilities:
- Involved in design and development of Business Requirements in liaison to business users and Technical teams by gathering requirement specification documents and identifying data sources and targets.
- Analyzed application requirements and provided recommended design and studied the current system to understand the existing data structures.
- Participated actively in user meetings and collected requirements from users.
- Maintained Offshore team with 6 resources for development works.
- Designed and developed star schema model for target database using ERWIN Data modeling.
- Used Informatica Power Center for extraction, transformation and loading (ETL) of source data on heterogeneous Database sources like Oracle, SQL Server, DB2, Teradata & flat files.
- Designed and developed a number of complex mappings using various transformations like Source Qualifier, Aggregator, Router, Joiner, Union, Expression, Lookup (Connected & unconnected), Filter, Update Strategy, Stored Procedure, Sequence Generator and used reusable transformations as well as mapplets.
- Worked with Workflow Manager for the creation of various tasks like Worklets, Sessions, Batches, Event Wait, E-mail notifications, Decision and to Schedule jobs.
- Extensively used the Slowly Changing Dimensions-Type II in various data mappings to load dimension tables in Data warehouse.
- Administered the repository by creating folders and logins for the group members and assigning necessary privileges using Informatica Repository Manager.
- Was responsible for the version control and up-gradation.
- Involved in the creation of partitions in Mapping to improve the performance of Informatica sessions.
- Involved in extensive performance tuning by determining bottlenecks using Debugger at various points like targets, sources, mappings, sessions or system. This led to better session performance.
- Extensively involved in coding of the Business Rules through PL/SQL using the Functions, Cursors, Triggers and Stored Procedures in the server side.
- Involved in creation of Classes, Objects and Universes for reporting purpose using Business Objects Designer.
Environment: Informatica Power Center 5.1.1/6.1.2 , MS SQL server 2005/2008, Oracle 8i/9i, SQL, PL/SQL, Shell Scripts, Windows XP, Unix, Espresso (ESP) Workload Manager