Etl Tech Lead / Architect Resume
Moline, IL
SUMMARY
- 10 years of experience in the field of Information Technology, with extensive experience in analysis, design, development, data conversion, Data Warehouse/Data Mart design, testing and documentation
- Four Years of strong experience in using ETL (Extraction, Transformation, Loading) utilizing Informatica 9.x,8.x/7.x/6.x (Power Mart/Power Center)
- Experience in AWS (Amazon Web Services), S3.
- Experience in Redshift (AWS Relational Database).
- Experience in Hadoop (Big Data) systems.
- Extensive experience in creation of ETL Mappings and Transformations using Informatica Power Mart/ Power Center to move data from multiple sources into target area.
- Worked extensively with complex mappings using Informatica designer components like Expressions, Routers, Lookups, ERP Source Qualifiers, Aggregators, Filters and Joiners.
- Strong Experience on Workflow Manager Tools - Task Developer, Workflow & Worklet Designer.
- Experience in Change Data Capture.
- Experience in creation of sessions, batches using Informatica workflow manager to run with the logic embedded in the mappings.
- Worked with Oracle Stored Procedures, Table Partitions and experienced in loading data into Data Warehouse/Data Marts using Informatica, SQL*Loader, Export/Import utilities.
- Knowledge in Data Modeling (Logical, Physical, Star Schemas) with Erwin and Power Designer.
- Very strong knowledge in Relational Databases (RDBMS), Data modeling and in building Data Warehouse, Data Marts using Star Schema and Snow Flake Schema.
- Strong experience in production support of Informatica mappings and workflows.
- Strong experience in Database Performance & Tuning and Extensive experience in SQL * Loader, Imports/Exports
- Extensive experience in coding using SQL, PL/SQL Procedures/Functions, Triggers and Packages in Oracle.
- Excellent working knowledge of UNIX shell scripting, job scheduling on multiple platforms like windows NT/2000, HP-UX, Sun Solaris.
- Extensive experience in reporting tools like Cognos, Tableau.
- Extensive experience in using Netezza appliance.
- Excellent interpersonal and communication skills, self-learner.
TECHNICAL SKILLS
ETL Tools: Informatica Power Center 9.x/8.x/7.x./6.x, Kettle 3.x/4.x/6.x (Pentaho Data Integration)
Databases: Oracle 10g/9i/8x, SQLServer 7.0/2000/2005 , DB2, MS Access, MySQL, Netezza, Redshift, PostgreSQL
Languages: SQL, PL/SQL, Python, C, C++, UNIX Shell, MATLAB, XML
Methodologies: Star Schema, Snowflake Schema
Packages: SQL*PLUS, Toad, SQL * Loader
Operating Systems: Windows 95/98/NT/00/XP/7, UNIX, Solaris
Reporting Tools: Cognos 10/8, Tableau 8/9, Actuate, Birt
Data modeling Tools: Sybase power Designer, Erwin
Big Data Eco systems: Hadoop, Kettle
Cloud Computing: Amazon Web Services(AWS), EC2, S3, Redshift
Methodologies: Agile
PROFESSIONAL EXPERIENCE
Confidential, Moline, IL
ETL Tech Lead / Architect
Responsibilities:
- ETL Tech Lead responsible for sending files daily to Hadoop and applying rules and loading into PostgreSQL for reporting purposes.
- Working on Power designer tool to design the scalable and flexible model to address most of the business cases.
- Using Kettle (Pentaho Data Integration) as ETL tool to extract data from DB2 and load into Hadoop System as files.
- Using Kettle (Pentaho Data Integration) to apply rules on the raw data with in Hadoop and create end files in the table structure.
- Using PostgreSQL as target database, which can be easily converted to Redshift when migrate to AWS.
Environment: Kettle 6.1 (Pentaho Data Integration), Hadoop, PostgreSQL, DB2, TOAD Quest Software, Power Designer.
Confidential
Responsibilities:
- ETL Tech Lead responsible for sending files daily to AWS.
- Working on Power designer tool to design the scalable and flexible model to address most of the business cases.
- Using Informatica as ETL tool to extract data from different sources like DB2, Oracle, Netezza, Flat files and load into AWS.
- Using Python scripting to apply rules on the raw data with in AWS.
- Using Redshift with in AWS.
Environment: Informatica 9.6.1, AWS, Redshift, Netezza, DB2, Oracle, TOAD Quest Software.
Confidential
Responsibilities:
- ETL Tech Lead responsible for building a Data Mart for ISG group.
- Working on Power designer tool to design the scalable and flexible model to address business needs of Analytics and Marketing team.
- Using Informatica as ETL tool to extract data from different sources like DB2, Oracle, Netezza, Flat files and load into Netezza appliance.
- Using Tableau reporting tool to create reports needed for Analytic team.
Environment: Informatica 9.1.0/9.6.1 , Netezza, DB2, Oracle, TOAD Quest Software, Tableau 8.2/9.0.
Confidential, Phoenix, AZ
Informatica Architect
Responsibilities:
- System Architect responsible in bringing four new locations into SPM from SAP.
- Worked in informatica to create/change existing code to accommodate these four new locations.
- Worked on Oracle database packages and procedures where there is lot of custom code.
Environment: Informatica, ORACLE 11i, PL/SQL, TOAD Quest Software, Java.
Confidential, Phoenix, AZ
Informatica Architect
Responsibilities:
- System Architect involved in upgrading the existing 9.4 to 10.4 version of SPM.
- Worked on issues found while upgrading.
Environment: Informatica, ORACLE 11i, PL/SQL, TOAD Quest Software, Java.
Confidential, Atlanta, GA
Informatica Architect / ETL Technical Lead
Responsibilities:
- System Architect involved integrating SL data to SPM database.
- Worked on Java extensions to implement customizations.
- Worked in Oracle database environments.
Environment: Informatica, ORACLE 11i, PL/SQL, TOAD Quest Software.
Confidential, Atlanta, GA
Responsibilities:
- System Architect involved in Informatica mapping development.
- Is responsible for design/development of the application's ETL layer which includes data movement to and from SPM core tables.
- Worked in SQL server database environments.
Environment: Informatica, ORACLE 11i, PL/SQL, TOAD Quest Software.
Confidential, Atlanta, GA
Responsibilities:
- System Architect involved in simple Java extensions.
- Worked in Oracle database environments.
Environment: ORACLE 10g, PL/SQL, TOAD Quest Software, Informatica, Java.
Confidential, Columbus, OH
Responsibilities:
- Data analyst for implementing iWarranty product on SQL Server environments.
- Was responsible for design/development/maintenance of the application's ETL layer which includes data extraction for data warehouse purposes.
- Involved in Data warehouse design changes.
- Development/Maintenance of Warehouse ETLs using Kettle (Pentaho Data Integration)
- Responsible for ETL scheduling and data validations.
- Worked on Cognos framework and model changes.
- Developing reports using COGNOS 10.1.
- Regular Build Support which includes Data Base Structure Changes, Data ZAPs as part of data clean up, scripts to create mandatory data with respect to new change requests.
Environment: ORACLE 10g, PL/SQL, TOAD Quest Software, Kettle 3.2, Power Designer, Cognos.
Confidential
Data Analyst
Responsibilities:
- Data analyst/DBA for implementing iWarranty product on Oracle 10g environments.
- Was responsible for design/development/maintenance of the application's ETL layer which includes data extraction for data warehouse purposes.
- Involved in Data warehouse designs.
- Development/Maintenance of Warehouse ETLs using Kettle (Pentaho Data Integration)
- Responsible for ETL scheduling and data validations
- Developing reports using BIRT.
- Involved in writing Store Procedures for report developing.
- Involved in regular build activities.
Environment: ORACLE 10g, PL/SQL, TOAD Quest Software, Kettle 3.2, BIRT, Power Designer.
Confidential
Data Analyst
Responsibilities:
- Data analyst/DBA for implementing iWarranty product on SQLSERVER environments.
- Develop, build, test and port DB2UDB queries, stored procedures, and user defined functions for SQL Server.
- Was responsible for design/development/maintenance of the application's ETL layer which includes data extraction for data warehouse purposes.
- Involved in Data warehouse designs.
- Development/Maintenance of Warehouse ETLs using Kettle (Pentaho Data Integration)
- Responsible for ETL scheduling and data validations
- Developing reports using COGNOS 8.
- Regular Build Support which includes Data Base Structure Changes, Data ZAPs as part of data clean up, scripts to create mandatory data with respect to new change requests.
Environment: Kettle 3.1, SQL Server 2005, UNIX, Windows NT 4.0, UNIX Shell Programming, COGNOS 8.4.
Confidential
Data Analyst
Responsibilities:
- Data analyst/DBA for implementing iWarranty product on ORACLE environments.
- Was responsible for design/development/maintenance of the application's ETL layer which includes data extraction for data warehouse purposes.
- Involved in Data warehouse designs.
- Development/Maintenance of Warehouse ETLs using Kettle (Pentaho Data Integration)
- Responsible for ETL scheduling and data validations
- Developing reports using COGNOS 8.
- Regular Build Support which includes Data Base Structure Changes, Data ZAPs as part of data clean up, scripts to create mandatory data with respect to new change requests.
Environment: ORACLE 10g, PL/SQL, TOAD Quest Software, Kettle 3.2, COGNOS 8.4.
Confidential, Iselin, NJ
Informatica Developer
Responsibilities:
- Worked with business analysts to identify appropriate sources for Data warehouse and to document business needs for decision support data
- Extensively worked with the sources which are extracts from Oracle, TERADATA, flat files and XML files
- Star Schema was used to design the warehouse.
- Worked extensively on Source Analyzer, Mapping Designer, Warehouse Designer and Transformation Developer.
- Developed several Mappings and Mapplets using corresponding Source, Targets and Transformations.
- Designed, developed and deployed new data marts along with modifying existing marts to support additional business requirements
- Configured and used FTP by the Informatica Server to access source and target files.
- Schedule, Run and Monitor sessions by using Informatica Scheduler.
- Used PL/SQL whenever necessary inside and outside the mappings.
- Involved in writing SQL Stored procedures and Shell Scripts to access data from Oracle.
- Created, launched & scheduled sessions. Involved in the Performance Tuning of Informatica mappings.
- Wrote PL/SQL Packages and stored procedures to implement business rules and validations.
- Involved in writing the UNIX scripts to schedule the Informatica workflows, which were in turn used by the scheduling team to schedule the workflows using the cntrl-m.
- Migration of Informatica objects from Development to QA and from QA to production and setting up the UNIX directories for Parameter files, Logs and Bad files
- Worked with testing team for creation of Test environment and introduced them to Informatica Workflow manager and Workflow monitor
- Created Repository folders, User accounts and assigned privileges using Repository Manager.
- Closely interacted with the reporting team which uses Business Objects for reporting team to explain the tables and relation between the tables.
Environment: Informatica 8.1/7.1, ORACLE 10g, UNIX, Windows NT 4.0, UNIX Shell Programming, PL/SQL, TOAD Quest Software, Business Objects.
Confidential
ETL Developer
Responsibilities:
- Worked with business analysts to identify appropriate sources for Data warehouse and to document business needs for decision support data
- Designed the ETL processes using Informatica to load data from Oracle, SQL Server, Flat Files and Excel files to target Oracle Data Warehouse database.
- Performed data manipulations using various Informatica Transformations like Joiner, Expression, Lookup, Aggregate, Filter, Update Strategy, and Sequence Generator etc.
- Written SQL overrides in source Qualifier according to business requirements.
- Written pre session and post session scripts in mappings.
- Created sessions and workflow for designed mappings.
- Redesigned some of the existing mappings in the system to meet new functionality.
- Used Workflow Monitor to monitor the performance of the jobs.
- Extensively worked in the performance tuning of the programs, ETL Procedures and processes.
- Developed PL/SQL procedures for processing business logic in the database.
- Migrated the mapping to the testing and production department and introduced the concepts of Informatica to the people in testing department
- Involved in creating logical and physical data modeling with Star and Snowflake schema techniques using Erwin in Data warehouse as well as in Data Mart
- Provided on-call support for the nightly load process that run from 12a.m to 9p.m.
- Developed Pre-Session and Post-Session UNIX scripts to automate the data load processes to target Data warehouse.
Environment: Informatica 7.1/6.2, ORACLE 9i, Solaris 10, Windows NT 4.0, UNIX Shell Programming, PL/SQL, TOAD, Quest Software.
Confidential
Software Engineer
Responsibilities:
- Involved in analyzing user requirements, Preparing testing specs, database designing.
- Developed User Interface screens (GUI's) with MATLAB.
- Customized the stored procedures and database triggers in PL/SQL.
- Involved in Exception handling and cursor management in PL/SQL.
- Implemented and tuned the indexes.
- Designed the cursors and packages and implements code reusability.
- Coded triggers at various levels, cross checking and for referential integrity.
Environment: Oracle 8, VB6, Crystal Reports 5, Windows 2000, MATLAB
