Software Developer Lead - Etl Resume
SUMMARY
- 8+ years of experience in ETL process using Informatica Power Center.
- Good knowledge of Informatica Data Quality (IDQ) Tool.
- Good knowledge of Data warehouse concepts and principles Star Schema, Snowflake, SCD, Surrogate keys, Normalization/De normalization.
- Extensively used Informatica Metadata Manager for impact analysis and data lineage.
- Experience in integration of various data sources with Multiple Relational Databases like Oracle, SQL Server and Worked on integrating data from flat files like fixed width and delimited.
- Have extensively worked in developing ETL for supporting Data Extraction, transformations and loading using Informatica Power Center.
- Well acquainted with Informatica PowerCenter Designer Components - Source Analyzer, Target Designer, Transformation Developer, Mapplet and Mapping Designer.
- Worked extensively with complex mappings using different transformations like Source Qualifiers, Expressions, Filters, Joiners, Routers, Union, Unconnected / Connected Lookups, Normalizers and Aggregators etc.
- Strong Experience in developing Sessions/tasks, Worklets, Workflows using Workflow Manager Tools - Task Developer, Workflow & Worklet Designer.
- Experience in using the Informatica command line utilities like pmcmd to execute workflows in non-windows environments. Extensively used Informatica Repository Manager and Workflow Monitor.
- Experience in debugging mappings. Identified bugs in existing mappings by analyzing the data flow and evaluating transformations.
- Hands on experience in Performance Tuning of sources, targets, transformations and sessions.
- Good experience in documenting the ETL process flow for better maintenance and analyzing the process flow.
- Worked with Stored Procedures, Triggers, Cursors, Indexes and Functions.
- Strong in UNIX Shell scripting. Developed UNIX scripts using PMCMD utility and scheduled ETL load using utilities like CA7 passport, Autosys and Control-M.
- Strong Knowledge in optimizing database performance.
- Good knowledge of external tables and sql loader.
- Migrating data mappings/workflows to production and monitoring, troubleshooting and restarting batch processes using Informatica Power Center
- Have knowledge of Hadoop, Hive.
- Have knowledge of AbInitio ETL Tool.
- Demonstrated ability to work and communicate effectively with both business and technical audiences.
- Highly motivated to take independent responsibility as well as ability to contribute and be a productive team member.
TECHNICAL SKILLS
ETL Tools: Informatica Power Center, Abi Initio, Oracle Warehouse Builder. Informatica Data Quality (IDQ), Informatica Metadata Manager
Databases: Oracle, SQL Server, DB2, Confidential, Teradata, Hive
GUI Tools: Toad, SQL Navigator, SQL* PLUS, SQL Developer, SQL Assistant, SQL Server Management Studio, Aginity Workbench for Confidential
Scheduling Tools: Informatica Scheduler, Autosys, Control-M, CA7 Passport
Scripting Languages: UNIX/Linux Shell Scripting
Operating Systems: Windows NT/2000/XP Professional/2003 Server, LINUX, UNIX
Oracle Tuning: SQL Tuning, Explain Plan, Table Partitioning, Materialized views, Hints.
PROFESSIONAL EXPERIENCE
Confidential
Software Developer Lead - ETL
Responsibilities:
- Worked closely with data modelers to create external tables and views in HIVE Environment.
- Developed standards and procedures for automation process of registration through Unified Data Services.
- Created Hive external tables and views based on Hadoop Distributed File System.
- Created Technical design specification documents based on the functional design documents and the physical data model.
- Created Control-M jobs in order to load data into Hive Partitions.
- Involved in Unit testing, User Acceptance Testing to check whether the data is loading from Hadoop files to Hive, same way as its loading into Teradata.
- Involved in code migration process to higher environments.
- Peer reviewed the code developed by other developers.
Environment: Ab Initio, Informatica, Informatica Metadata Manager, Teradata, Hadoop, Hive, Query-It, SQL Developer, PL/SQL, Linux.
Confidential
Senior Informatica Developer /Lead
Responsibilities:
- Worked closely with the end users in writing the functional specifications based on the business needs.
- Worked closely Business Analysts and Data Architects to understand the functional requirements.
- Developed standards and procedures for transformation of data as it moves from source systems to the data warehouse.
- Created Technical design specification documents based on the functional design documents and the physical data model.
- Created ETL Source to target document to show data flow between Source System and Target Warehouse using business requirements.
- Extensively Used Informatica Data Quality (IDQ) Tool for analyzing and data profiling.
- Extensively used Informatica Metadata Manager for impact analysis and data lineage.
- Developed UNIX shell scripts to control the process flow for Informatica workflows to handle high volume data.
- Involved in performance tuning and optimization of Informatica mappings and sessions using features like partitions and data/index cache to manage very large volume of data.
- Involved in Unit testing, User Acceptance Testing to check whether the data is loading into target, which was extracted from different source systems according to the business requirements.
- Developed mappings to extract data from Oracle, DB2, SQL Server, Flat files, XML files and load into Data warehouse using the Mapping Designer.
- Used Source Analyzer and Target designer to import the source and target database schemas, and the Mapping Designer to map the sources to the target.
- Used Informatica Power Center Designer to create complex mappings using different transformations like Filter, Router, Connected & Unconnected lookups, Stored Procedure, Joiner, Update Strategy, Normalizer, Expressions and Aggregator transformations to pipeline data to Data Warehouse.
- Involved in versioning the whole process and retiring the old records using the built-in's DD UPDATE, DD DELETE, and DD INSERT
- Extensively used DB2 database Log Analyzer Files to load data into the Confidential database and integrated data coming from outside the Enterprise and managed the business process.
- Involved in design and development of data warehouse environment, liaison to business users and/or technical teams gathering requirement specification documents and presenting and identifying data sources, targets and report generation.
- Worked on Informatica Power Center 9.6.1 HotFix2 tool - Source Analyzer, Target designer, Mapping Designer, Workflow Manager, Mapplets, and Reusable Transformations.
- Involved in ETL Code Migration to upper environment using Repository Manager.
- Involved in peer review process, to review the code developed by other team members.
- Using Informatica Power Center Designer designed Mappings, which populated the Data into the Target Star Schema on Oracle 11g Database and Confidential Database.
- Optimized Query Performance, Session Performance and Reliability.
- Extensively used Normalizer, Router, Lookup, Aggregator, Expression and Update Strategy Transformations.
- Translation of Business processes into Informatica mappings for building Data marts.
- Involved in the Migration process from Development, Test and Production Environments.
- Designed and developed the logic for handling slowly changing dimension tables load by flagging the record using update strategy for populating the desired.
- Used SQL tools like TOAD to run SQL queries and validate the data.
- Used Aginity Workbench GUI to run SQL Queries/Scripts for Confidential database.
- Wrote stored procedures and triggers in Oracle 8 11g or managing consistency and referential integrity across data mart.
- Debugging invalid mappings using break points, testing of stored procedures and functions, testing of Informatica sessions, batches and the target Data.
- Developed shell scripts, PL/SQL procedures, for creating/dropping of table and indexes of performance for pre and post session management.
- Used DTS package to import and export data to from the database.
- Implemented various Performance Tuning techniques on Sources, Targets, Mappings, and Workflows.
- Identified sources, targets, mappings and sessions and tuned them to improve performance.
- Written triggers enforcing Integrity constraints, stored procedures for Complex mappings, and cursors for data extraction and to carry out updates of new fields
- Used Debugger in troubleshooting the existing mappings
- Tuning the Mappings for Optimum Performance, Dependencies and Batch Design.
- Schedule and Run Extraction and Load process and monitor sessions using Informatica Workflow Manager.
- Scheduled the batches to be run using the Workflow Manager.
- Involved in identifying bugs in existing mappings by analyzing the data flow, evaluating transformations and fixing the bugs so that they conform to the business needs
Environment: Informatica Power Center, Informatica Data Quality (IDQ), Informatica Metadata Manager, Oracle, DB2, SQL Server, Confidential, TOAD, Aginity, SQL Server Management Studio, SQL, PL/SQL, Linux
