We provide IT Staff Augmentation Services!

Software Developer Lead - Etl Resume

2.00/5 (Submit Your Rating)

SUMMARY

  • 8+ years of experience in ETL process using Informatica Power Center.
  • Good knowledge of Informatica Data Quality (IDQ) Tool.
  • Good knowledge of Data warehouse concepts and principles Star Schema, Snowflake, SCD, Surrogate keys, Normalization/De normalization.
  • Extensively used Informatica Metadata Manager for impact analysis and data lineage.
  • Experience in integration of various data sources with Multiple Relational Databases like Oracle, SQL Server and Worked on integrating data from flat files like fixed width and delimited.
  • Have extensively worked in developing ETL for supporting Data Extraction, transformations and loading using Informatica Power Center.
  • Well acquainted with Informatica PowerCenter Designer Components - Source Analyzer, Target Designer, Transformation Developer, Mapplet and Mapping Designer.
  • Worked extensively with complex mappings using different transformations like Source Qualifiers, Expressions, Filters, Joiners, Routers, Union, Unconnected / Connected Lookups, Normalizers and Aggregators etc.
  • Strong Experience in developing Sessions/tasks, Worklets, Workflows using Workflow Manager Tools - Task Developer, Workflow & Worklet Designer.
  • Experience in using the Informatica command line utilities like pmcmd to execute workflows in non-windows environments. Extensively used Informatica Repository Manager and Workflow Monitor.
  • Experience in debugging mappings. Identified bugs in existing mappings by analyzing the data flow and evaluating transformations.
  • Hands on experience in Performance Tuning of sources, targets, transformations and sessions.
  • Good experience in documenting the ETL process flow for better maintenance and analyzing the process flow.
  • Worked with Stored Procedures, Triggers, Cursors, Indexes and Functions.
  • Strong in UNIX Shell scripting. Developed UNIX scripts using PMCMD utility and scheduled ETL load using utilities like CA7 passport, Autosys and Control-M.
  • Strong Knowledge in optimizing database performance.
  • Good knowledge of external tables and sql loader.
  • Migrating data mappings/workflows to production and monitoring, troubleshooting and restarting batch processes using Informatica Power Center
  • Have knowledge of Hadoop, Hive.
  • Have knowledge of AbInitio ETL Tool.
  • Demonstrated ability to work and communicate effectively with both business and technical audiences.
  • Highly motivated to take independent responsibility as well as ability to contribute and be a productive team member.

TECHNICAL SKILLS

ETL Tools: Informatica Power Center, Abi Initio, Oracle Warehouse Builder. Informatica Data Quality (IDQ), Informatica Metadata Manager

Databases: Oracle, SQL Server, DB2, Confidential, Teradata, Hive

GUI Tools: Toad, SQL Navigator, SQL* PLUS, SQL Developer, SQL Assistant, SQL Server Management Studio, Aginity Workbench for Confidential

Scheduling Tools: Informatica Scheduler, Autosys, Control-M, CA7 Passport

Scripting Languages: UNIX/Linux Shell Scripting

Operating Systems: Windows NT/2000/XP Professional/2003 Server, LINUX, UNIX

Oracle Tuning: SQL Tuning, Explain Plan, Table Partitioning, Materialized views, Hints.

PROFESSIONAL EXPERIENCE

Confidential

Software Developer Lead - ETL

Responsibilities:

  • Worked closely with data modelers to create external tables and views in HIVE Environment.
  • Developed standards and procedures for automation process of registration through Unified Data Services.
  • Created Hive external tables and views based on Hadoop Distributed File System.
  • Created Technical design specification documents based on the functional design documents and the physical data model.
  • Created Control-M jobs in order to load data into Hive Partitions.
  • Involved in Unit testing, User Acceptance Testing to check whether the data is loading from Hadoop files to Hive, same way as its loading into Teradata.
  • Involved in code migration process to higher environments.
  • Peer reviewed the code developed by other developers.

Environment: Ab Initio, Informatica, Informatica Metadata Manager, Teradata, Hadoop, Hive, Query-It, SQL Developer, PL/SQL, Linux.

Confidential

Senior Informatica Developer /Lead

Responsibilities:

  • Worked closely with the end users in writing the functional specifications based on the business needs.
  • Worked closely Business Analysts and Data Architects to understand the functional requirements.
  • Developed standards and procedures for transformation of data as it moves from source systems to the data warehouse.
  • Created Technical design specification documents based on the functional design documents and the physical data model.
  • Created ETL Source to target document to show data flow between Source System and Target Warehouse using business requirements.
  • Extensively Used Informatica Data Quality (IDQ) Tool for analyzing and data profiling.
  • Extensively used Informatica Metadata Manager for impact analysis and data lineage.
  • Developed UNIX shell scripts to control the process flow for Informatica workflows to handle high volume data.
  • Involved in performance tuning and optimization of Informatica mappings and sessions using features like partitions and data/index cache to manage very large volume of data.
  • Involved in Unit testing, User Acceptance Testing to check whether the data is loading into target, which was extracted from different source systems according to the business requirements.
  • Developed mappings to extract data from Oracle, DB2, SQL Server, Flat files, XML files and load into Data warehouse using the Mapping Designer.
  • Used Source Analyzer and Target designer to import the source and target database schemas, and the Mapping Designer to map the sources to the target.
  • Used Informatica Power Center Designer to create complex mappings using different transformations like Filter, Router, Connected & Unconnected lookups, Stored Procedure, Joiner, Update Strategy, Normalizer, Expressions and Aggregator transformations to pipeline data to Data Warehouse.
  • Involved in versioning the whole process and retiring the old records using the built-in's DD UPDATE, DD DELETE, and DD INSERT
  • Extensively used DB2 database Log Analyzer Files to load data into the Confidential database and integrated data coming from outside the Enterprise and managed the business process.
  • Involved in design and development of data warehouse environment, liaison to business users and/or technical teams gathering requirement specification documents and presenting and identifying data sources, targets and report generation.
  • Worked on Informatica Power Center 9.6.1 HotFix2 tool - Source Analyzer, Target designer, Mapping Designer, Workflow Manager, Mapplets, and Reusable Transformations.
  • Involved in ETL Code Migration to upper environment using Repository Manager.
  • Involved in peer review process, to review the code developed by other team members.
  • Using Informatica Power Center Designer designed Mappings, which populated the Data into the Target Star Schema on Oracle 11g Database and Confidential Database.
  • Optimized Query Performance, Session Performance and Reliability.
  • Extensively used Normalizer, Router, Lookup, Aggregator, Expression and Update Strategy Transformations.
  • Translation of Business processes into Informatica mappings for building Data marts.
  • Involved in the Migration process from Development, Test and Production Environments.
  • Designed and developed the logic for handling slowly changing dimension tables load by flagging the record using update strategy for populating the desired.
  • Used SQL tools like TOAD to run SQL queries and validate the data.
  • Used Aginity Workbench GUI to run SQL Queries/Scripts for Confidential database.
  • Wrote stored procedures and triggers in Oracle 8 11g or managing consistency and referential integrity across data mart.
  • Debugging invalid mappings using break points, testing of stored procedures and functions, testing of Informatica sessions, batches and the target Data.
  • Developed shell scripts, PL/SQL procedures, for creating/dropping of table and indexes of performance for pre and post session management.
  • Used DTS package to import and export data to from the database.
  • Implemented various Performance Tuning techniques on Sources, Targets, Mappings, and Workflows.
  • Identified sources, targets, mappings and sessions and tuned them to improve performance.
  • Written triggers enforcing Integrity constraints, stored procedures for Complex mappings, and cursors for data extraction and to carry out updates of new fields
  • Used Debugger in troubleshooting the existing mappings
  • Tuning the Mappings for Optimum Performance, Dependencies and Batch Design.
  • Schedule and Run Extraction and Load process and monitor sessions using Informatica Workflow Manager.
  • Scheduled the batches to be run using the Workflow Manager.
  • Involved in identifying bugs in existing mappings by analyzing the data flow, evaluating transformations and fixing the bugs so that they conform to the business needs

Environment: Informatica Power Center, Informatica Data Quality (IDQ), Informatica Metadata Manager, Oracle, DB2, SQL Server, Confidential, TOAD, Aginity, SQL Server Management Studio, SQL, PL/SQL, Linux

We'd love your feedback!