Etl Architect Resume
Frederick, MD
SUMMARY:
- 13 + years of work experience in IT Industry in Analysis, Development and Maintenance of various software applications in Data warehouse environment.
- Strong experience in providing Business Intelligence solutions using Informatica Power Center 10.x/9.x/8.x/7.x/6.x, Oracle, SQL Server, Tableau, ERwin.
- Good knowledge of Data warehouse concepts and principles (Ralph Kimball / Inman), Star Schema, Snowflake, SCD, Surrogate keys.
- Experience in integration of various data sources with multiple Relational Databases like Oracle, SQL Server, and XML files, Main Frames, IBM DB2, SAP R/3 and worked on integrating data from flat files like fixed width and delimited.
- Strong experience in activities related to the development, implementation, administration and support of ETL processes for large - scale data warehouses using Power Center and Power Exchange.
- Supported activities related to migrating the ETL code to Informatica Could Servers on AWS.
- Well acquainted with Informatica Designer Components - Source Analyzer, Warehouse Designer, Transformation Developer, Mapplet and Mapping Designer.
- Worked extensively with complex mappings using different transformations like Source Qualifier, Expression, Filter, Joiner, Router, Normalizer, Union, Unconnected / Connected Lookups and Aggregator.
- Strong Experience in developing Sessions/tasks, Worklets, Workflows using Workflow Manager Tools - Task Developer, Workflow & Worklets Designer.
- Strong experience in performance Tuning of Informatica Mappings, processes and load routines.
- Used informatica NORMALIZER Transformation to convert the data from Legacy systems.
- Expertise in several key areas of Enterprise Data Warehousing such as Change Data Capture (CDC), Data Quality, and lookup Tables and ETL data movement.
- Experience in identifying Bottlenecks in ETL Processes and Performance tuning of the production applications using Database Tuning, Partitioning, Index Usage, Aggregate Tables, and Normalization/ Denormalization strategies.
- Used IDQ for Data Quality. Used IDE. Worked on Address Validator, Parser, Serializer, Standardizer and Profiler.
- Extensively worked with Oracle PL/SQL Stored Procedures, Functions Cursors, Indexes and Triggers and involved in Query Optimization.
- Worked on Dimensional Modelling using CA Erwin r9.8/9.6.
- Developed Logical Data Models and Physical Data Models using ER-Studio. Enforce standards and best practices around data modeling efforts. Ensure data warehouse and data mart designs efficiently support BI and end user.
- Strong hands on experience using Teradata utilities including: Fast Export, MultiLoad, Fast Load, Tpump, BTEQ and Query Man.
- Proficient on effectively developing complex Teradata SQL code using complex joins, temp/volatile, and intermediary tables
- Experience in UNIX shell scripting, CRON, FTP and file management in various UNIX environments.
- Scheduling the jobs using Tidal, Autosys.
- Good Working knowledge in Oracle Designer, ERwin and Visio design tools
- Good understanding of BIG DATA concepts.
- Worked on NOSQL databases like MongoDB.
- Responsible for generating all scripts required to transform the source data into the Teradata physical tables including the associated processes necessary to provide robust recovery and performance
- Created personalized version of reports as well as statements for customers using the data from Informatica metadata and then generated Business Objects reports using slice and dice capabilities.
- Highly Motivated to take independent responsibility as well as ability to contribute and be a productive team member
- Ability to work in multiple projects simultaneously.
TECHNICAL SKILLS:
ETL Tools: Informatica Power center 10.0/9.6/8.6.1/8.1/7.1/6.2 , Talend 5.5/6.0, SQL*Loader, MS SSIS.
Reporting Tools: Tableau 7.0, Microstrategy 9.0, Business Objects XI, MS SSRS, OBIEE, Crystal Reports.
Languages: PLSQL/SQL, T-SQL, NOSQL.
Databases: Oracle11g/10g/9i/8i/7.x, MS SQL Server 2012/2008, MongoDB, DB2, MYSQL, Exadata, SAP R/3.
Data Modeling: Erwin 4.0/4.1/5.0.
Scripting: Unix Shell Scripting, JCL.
GUI: Toad 9.x/7.4,Oracle Designer 2000.
OS: UNIX(Sun Solaris 2.x,HP/UX 11), Win 95/NT/98/2000/XP, MVS,MS-DOS, IBM AIX 4.2.
Scheduling: JOBTRAC, Maestro, Tidal, Autosys.
Other: SQL* PLUS,SQL Developer, Toad, SVN, MS-Office Tools, Visio.
PROFESSIONAL EXPERIENCE:
Confidential, Frederick, MD
ETL Architect
Responsibilities:
- Designed and Developed ETL mappings using transformation logic for extracting the data from various sources systems like Oracle, Flat files from various other sources systems.
- Worked with Reporting team to get to an agreement on what level of complexity to be handled by ETL and reporting side.
- Extensively used Informatica Power Center and created mappings using transformations like Source Qualifier, Joiner, Aggregator, Expression, Filter, Router, Normalizer, Lookup, Update Strategy, and Sequence Generator .
- Involved in performance tuning and optimization of Informatica mappings and sessions using features like partitions and data/index cache to manage very large volume of data.
- Performance tuning of SQL queries and stored procedures using SQL Profiler and Index Tuning Wizard.
- Developing UNIX shell Scripts to generate parameter files and executed oracle procedures as batch jobs.
- Optimized and Tuned SQL queries and PL/SQL blocks to eliminate Full Table scans to reduce Disk I/O and Sorts.
- Worked on Dimensional Modelling using CA Erwin r9.8/9.6.
- Developed Logical Data Models and Physical Data Models using ER-Studio. Enforce standards and best practices around data modeling efforts. Ensure data warehouse and data mart designs efficiently support BI and end user.
- Designed and built the Facts and Dimensions as per the reporting requirement.
- Involved in Unit testing, User Acceptance testing to check whether the data is loading into target, which was extracted from different source systems according to the user requirements.
- Created scripts for Batch test and set the required options for overnight, automated execution of test scripts
- Responsible for regression testing ETL jobs before test to production migration.
- Provided support in handling file validation errors and database down and connectivity errors.
- Investigated and fixed problems encountered in the production environment on a day to day basis.
- Troubleshoot the data and performance issues raised by user community, designed, developed and deployed the code to fix them.
Environment: Informatica Power Center 10.1, CA ERwin r9.8/9.6, Tableau 10.3, Cognos, Oracle 11g, SQL, PL/SQL, LINUX.
Confidential, Harrisburg, PA
ETL Developer
Responsibilities:
- Designed and Developed ETL mappings using transformation logic for extracting the data from various sources systems like SAP R3, DB2, JD Edwards, SQL Server, Oracle, Flat files from various other sources systems.
- Worked on migrating the ETL code to Informatica Could Servers on AWS.
- Supported the database team in creation of Informatica Users/Schemas on AWS Cloud Servers.
- Validated and verified the ETL code after migration to AWS Cloud Servers.
- Supported the post migration activities after migration to AWS Cloud Servers.
- Worked with Reporting team to get to an agreement on what level of complexity to be handled by ETL and reporting side.
- Extensively used Informatica Power Center and created mappings using transformations like Source Qualifier, Joiner, Aggregator, Expression, Filter, Router, Normalizer, Lookup, Update Strategy, and Sequence Generator .
- Involved in performance tuning and optimization of Informatica mappings and sessions using features like partitions and data/index cache to manage very large volume of data.
- Performance tuning of SQL queries and stored procedures using SQL Profiler and Index Tuning Wizard.
- Involved in Developing UNIX shell Scripts to generate parameter files and executed oracle procedures as batch jobs.
- Optimized and Tuned SQL queries and PL/SQL blocks to eliminate Full Table scans to reduce Disk I/O and Sorts.
- Worked on conversion of existing BODI Acta jobs to ETL jobs using informatica.
- Converted the daily sqlldr jobs to ETL using informatica.
- Automated UNIX shell scripts to verify the count of records added everyday due to incremental data load for few of the base tables in order to check for the consistency.
- Involved in Unit testing, User Acceptance testing to check whether the data is loading into target, which was extracted from different source systems according to the user requirements.
- Created scripts for Batch test and set the required options for overnight, automated execution of test scripts
- Responsible for regression testing ETL jobs before test to production migration.
- Provided support in handling file validation errors and database down and connectivity errors.
- Investigated and fixed problems encountered in the production environment on a day to day basis.
- Troubleshoot the data and performance issues raised by user community, designed, developed and deployed the code to fix them.
Environment: Informatica Power Center 10.1/9.6, SAP R3, Tableau 10, Cognos, Oracle 11g Exadata, SQL, PL/SQL, LINUX.
Confidential, Fairfax, VA
ETL Developer
Responsibilities:
- Designed and Developed ETL mappings using transformation logic for extracting the data from various sources systems.
- Worked with Reporting team to get to an agreement on what level of complexity to be handled by ETL and reporting side.
- Extensively used Informatica Power Center and created mappings using transformations like Source Qualifier, Joiner, Normalizer, Aggregator, Expression, Filter, Router, Normalizer, Lookup, Update Strategy, and Sequence Generator .
- Have used NORMALIZER Transformation heavily to convert the data in flatfile tile RDBMS structures.
- Involved in performance tuning and optimization of Informatica mappings and sessions using features like partitions and data/index cache to manage very large volume of data.
- Performance tuning of SQL queries and stored procedures using SQL Profiler and Index Tuning Wizard.
- Involved in Developing UNIX shell Scripts to generate parameter files and executed oracle procedures as batch jobs.
- Used IDQ for Data Quality. Worked on Address Validator, Parser, Serializer, Standardizer and Profiler.
- Worked on informatica IDE.
- Developed PL/SQL procedures, functions to facilitate specific requirement.
- Implemented SCD-2 to store the Historical data.
- Optimized and Tuned SQL queries and PL/SQL blocks to eliminate Full Table scans to reduce Disk I/O and Sorts.
- Automated UNIX shell scripts to verify the count of records added everyday due to incremental data load for few of the base tables in order to check for the consistency.
- Involved in Unit testing, User Acceptance testing to check whether the data is loading into target, which was extracted from different source systems according to the user requirements.
- Created scripts for Batch test and set the required options for overnight, automated execution of test scripts
- Responsible for regression testing ETL jobs before test to production migration.
- Provided support in handling file validation errors and database down and connectivity errors.
- Investigated and fixed problems encountered in the production environment on a day to day basis.
- Troubleshoot the data and performance issues raised by user community, designed, developed and deployed the code to fix them.
Environment: Informatica Power Center 9.6/9.1, OBIEE 10/11, Oracle 11g, MS SQL Server 2012, XML Files, Erwin 5.0 TOAD, SQL, PL/SQL, Windows, UNIX.
Confidential, Irving, TX
ETL Architect
Responsibilities:
- Designed and Developed ETL mappings using transformation logic for extracting the data from various sources systems.
- Worked with Reporting team to get to an agreement on what level of complexity to be handled by ETL and reporting side.
- Extensively used Informatica Power Center and Talend Open Source and created mappings using transformations like Source Qualifier, Joiner, Normalizer, Aggregator, Expression, Filter, Router, Normalizer, Lookup, Update Strategy, and Sequence Generator .
- Involved in performance tuning and optimization of Informatica mappings and sessions using features like partitions and data/index cache to manage very large volume of data.
- Used IDQ for Data Quality. Worked on Address Validator, Parser, Serializer, Standardizer and Profiler.
- Performance tuning of SQL queries and stored procedures using SQL Profiler and Index Tuning Wizard.
- Worked on informatica IDE.
- Involved in Developing UNIX shell Scripts to generate parameter files and executed oracle procedures as batch jobs.
- Developed PL/SQL procedures, functions to facilitate specific requirement.
- Optimized and Tuned SQL queries and PL/SQL blocks to eliminate Full Table scans to reduce Disk I/O and Sorts.
- Automated UNIX shell scripts to verify the count of records added everyday due to incremental data load for few of the base tables in order to check for the consistency.
- Involved in Unit testing, User Acceptance testing to check whether the data is loading into target, which was extracted from different source systems according to the user requirements.
- Created scripts for Batch test and set the required options for overnight, automated execution of test scripts
- Responsible for regression testing ETL jobs before test to production migration.
- Provided support in handling file validation errors and database down and connectivity errors.
- Investigated and fixed problems encountered in the production environment on a day to day basis.
- Troubleshoot the data and performance issues raised by user community, designed, developed and deployed the code to fix them.
Environment: Informatica Power Center 9.5, Talend 6.0, OBIEE 10/11, Power Exchange 9.5, Oracle 11i/10g, MS SQL Server, XML Files, Erwin 4.0 TOAD, SQL, PL/SQL, SQL Developer, Windows XP, UNIX.
Confidential, Alpharetta, GA
Informatica / Oracle Consultant
Responsibilities:
- Interacted with the Business users to identify the process metrics and various key dimensions and measures.
- Involved in dimensional modeling to design and develop STAR schemas by identifying the facts and dimensions.
- Experience working with enterprise-wide conformed dimensions.
- Designed and Developed ETL mappings using transformation logic for extracting the data from various sources systems.
- Worked heavily on processing the unstructured data.
- Worked on OBIEE Reporting tool.
- Recommended physical tuning strategies for overall better performance of database, queries and load process by suggesting vertical and horizontal partitioning of existing tables and changes in data types where possible for saving space.
- Involved in collection of statistics on original query and analyze them to set up a test environment.
- Made changes to the original sql query and tested the new query.
- Extensively used PL/SQL programming in backend and front-end functions, procedures, packages to implement business rules and test cases for the project.
- Used informatica NORMALIZER Transformation to convert the data from Legacy systems to DBMS.
- Developed UNIX shell Scripts to generate parameter files and executed oracle procedures as batch jobs.
- Reviewed the Testing progress and issues to be resolved by conducting walkthroughs.
- Involved in Unit testing, User Acceptance testing to check whether the data is loading into target, which was extracted from different source systems according to the user requirements.
- Documented ETL test plans, test cases, test scripts, test procedures, assumptions, and validations based on design specifications for unit testing, system testing, expected results, preparing test data and loading for testing, error handling and analysis.
- Used IDQ for Data Quality. Worked on Address Validator, Parser, Standardizer and Profiler.
- Responsible for regression testing ETL jobs before test to production migration.
- Involved in migration of ETL code from development repository to testing repository and then to production repository.
- Scheduling the jobs using Tidal.
- Strong hands on experience using Teradata utilities including: Fast Export, MultiLoad, Fast Load, Tpump, BTEQ and Query Man.
- Proficient on effectively developing complex Teradata SQL code using complex joins, temp/volatile, and intermediary tables
- Worked on NOSQL databases like MongoDB.
- Handled the dead lock errors that occurred due to dependency of jobs running simultaneously.
- Provided support for daily and weekly batch loads.
- Prepared Run book for the daily batch loads giving the job dependencies and how to restart a job when it fails for ease of handling job failures during loads.
Environment: Informatica Power Center 8.6.1, Talend 5.5/6.0, Netezza, Microstrategy 7.0, Business Objects XI, Oracle 11i/10g, Netezza, SAP R/3, Teradata V2R6, XML Files, MongoDB, OBIEE 10, TOAD, SQL, PL/SQL, Erwin 4.1 Windows XP, UNIX, Visio.
Confidential
Informatica / Oracle Consultant
Responsibilities:
- Involved in developing mapping from the design documents.
- Extracted data from different sources such as Oracle, DB2, XML, flat files using Power Center.
- Created stored procedures, packages, triggers, tables, views, synonyms, and test data in Oracle.
- Used mapping designer to generate different mappings for different loads.
- Developed mappings, sessions and workflows (ETL) for SCD types I, II and III to meet the requirements
- Worked on performance tuning and optimization of the Sessions, Mappings, Sources and Target.
- Created Informatica mappings with PL/SQL procedures/Functions to build business rules to load the data.
- Used PMCMD command to start, stop and ping server from UNIX and created UNIX Shell scripts to automate the activities.
- Responsible for Unit Test, System Integration Test and UAT to check the data quality and documenting the test results.
- Used parallel processing capabilities, Session-Partitioning and Target Table partitioning utilities.
- Used PL/SQL procedures and UNIX shell scripts to run along with daily/weekly/monthly batches to reduce or eliminate manual testing effort.
- Responsible for writing unit test cases and performing the unit testing for data validity based on business rules.
- Member of on call team for providing support for daily and weekly batch loads.
- Involved in design and development of data models using Erwin data modeler.
- Develop PL/SQL packages, procedures, functions and triggers for the Customer Support System.
- Involved in Analysis, Documentation and Testing.
- Troubleshoot existing PL/SQL Scripts.
- Responsible for Unit Test, System Integration Test and UAT to check the data quality and documenting the test results.
Environment: Informatica Power Center 7.1.4, Netezza, Unix, DB2, Erwin, Oracle 10g/ 9i/ 8i, TOAD 7.8, UNIX, SQL, PL/SQL, MS SQL Server.
