Etl Lead Resume
CO
SUMMARY:
- More than 9 years of experience in HADOOP,Data warehouse Development using ETL tool like Informatica PowerCenter, Pentaho.
- Extensively worked with various source systems like Teradata, Oracle, SQL server, MYSQL, DB2, Faltfiles, and MS Access.
- Experience in using various Teradata Utilities like Teradata Parallel Transporter, Mload, FastExport, BTEQ, FastLoad, Tpump and SQL Assistant.
- Experience in creating Logical and Physical Data Model design using Erwin.
- Experience of writing ETL Specifications based on the DA/Technical specs to have an evolved picture of the ETL design.
- Good working knowledge of UNIX.
- Good working knowledge of Star Schema Dimensional and Third Normal Form Data models. Well versed with all the concepts/stages of SDLC.
- Performed Data Profiling and Analysis to identify source tables to meet the business requirements.
- Excellent Communication, analytical, problem solving, time management and Technical writing skills.
- Goal - oriented, dedicated self-starter and dependable individual with a high degree of technical adaptability, initiative and reliability.
TECHNICAL SKILLS:
Big Data Ecosystems: Hadoop, MapReduce, HDFS, HBase, Hive, Pig, Sqoop.
ETL Tools: Informatica PowerCenter 9.1/ 8.x/7.x, Pentaho 4.2/3.2.4,Data Stage 8.7, FACT 2.3.2, COSORT9.53
RDBMS: Teradata V2R5/V2R6/R12/R13, Oracle 11i/9i/8i, MS SQL Server 2005/2008/2012 and MS Access.
Languages: UNIX Shell scripting,PYTHON,SQL.
Technologies: XML, XSL, ODBC, and JDBC1.0.
Operating Systems: SUN Solaris 5.8/5.9, HP-UX B.11.11, Windows NT and Windows 95/98/2000/XP
Web Skills: ASP .Net, HTML4.0, DHTML, Java Script, and VB Script
PROFESSIONAL EXPERIENCE:
Confidential, CO
ETL LEAD
Responsibilities:
- Worked with business to identify the appropriate data elements for required capabilities.
- Created Logical Data model and physical Data models.
- Developing the BRDS and ETL detail design documents for each process.
- Created DDL, DML to create required objects.
- Did Data analysis to generate reports for business team.
- Did data mining to assist the business team.
- Loaded data into HDFS, used Sqoop to import and export data.
- Written Hive,Imapala queries.
- Designing ETL jobs using Informatica and Pentaho.
- Written BTEQ, Fast Load and Multi Load scripts for data exchange.
- Written UNIX scripts based on the requirements.
- Written PYTHON scripts based on the requirements.
- Created stored procedure,Presto Views.
- Used Fact and Cosort to extract and sort data to flat files.
- Creating the deployment documents and migrating the code to the production environment.
- Scheduled jobs using UC4
Environment: Erwin 4.2, Teradata 14,Informatica 9.6, Oracle 11g, Sql Server 2012, HDFS,Hive,Sqoop,MapReduce,Hbase,pig,UNIX, UC4,Pentaho 4.2,Tableau 9.0, FACT 2.3.2, COSORT9.53,Pentaho 6.1,Pentaho 4.2, Python 2 X,3.5,Presto.
Confidential, GA
Sr.ETL Developer
Responsibilities:
- Performed Data profiling .
- Designed, Developed and Tuned ETL mappings.
- Created outbound data extracts for third party vendors from data mart.
- Created and maintained process flow documents, ETL design documents and Run books for ETL processes.
- Developed unix scripts.
- Created test cases for unit testing.
- Wrote BTEQ,MLOAD,FLOAD,TPUMP scripts.
- Designed and developed UNIX wrapper scripts for the Integration process.
Environment: Informatica 9.1, Teradata 12 Oracle 10g, Sql Server 2012, UNIX, PYTHON,Windows XP,Pentaho.
Confidential, GA
ETL Developer
Responsibilities:
- Developed, supported and maintained ETL processes.
- Developed mappings using transformations like Filter, Database lookup, lookup, Switch case, Merge etc.
- Written stored procedures.
- Written Unix scripts.
- Unit tested the code and fixed any defects.
- Created, updated and maintained ETL technical documentation.
Environment: Informatica 9.1, SQL Server 2000, Oracle 9i, TOAD, Erwin 4.1.4, MS Excel,pentaho.
Confidential, GA
ETL Developer
Responsibilities:
- Redesigned existing mappings to meet new functionality and enhance the performance using multiple sources and to Flat files and oracle
- Created Sessions, Worklets and Workflows for designed mappings.
- Wrote Unix Shell Scripts for parameters and automating the FTP and SFTP Processes.
- Responsible for Unit Testing and fixing the defects.
- Created, updated and maintained ETL technical documentation.
- Scheduled the workflows for execution using Informatica Workflow Manager.
Environment: Informatica Power Center 9.1, UNIX, SQL Server 2008, Oracle 11i, SQL Assistant, WinSCP.
Confidential, NJ
Teradata Developer
Responsibilities:
- Created physical data model using Erwin data modeling tool for the staging tables.
- Created mappings using transformations like Source Qualifier, Aggregator, Expression, Lookup, Filter, Router, Union and Update Strategy.
- Extracted data from various sources, cleaned the data before applying business logic and loaded them into central Target Data Warehouse.
- Worked with CMS dataset.
- Created ETL Mapping based on CMS standards for IDR database.
- Created Session, Worklets and Workflows for designed mappings.
- Created and modified BTEQ Scripts to meet the business requirement.
- Created stored procedure.
- Used debugger to test the data flow and fixed the mappings.
- Performed Data Profiling and Analysis on Source Systems to verify data availability to support the business requirements.
- Unit tested the developed code.
- Proficient in using Informatica Client tools.
Environment: Informatica Power Center 9.1, Oracle 11i, Teradata 12, SQL Assistant, Erwin.
Confidential, NJ
ETL/Teradata Developer
Responsibilities:
- Developed mappings by implementing business rules to extract data from sources to operational staging targets and fine-tuned the same for better performance.
- Responsible for unit testing the mappings.
- Extracted and scrubbed data from sources like Oracle and Flat Files to load Teradata.
- Created sessions, database connections.
- Involved in writing scripts for loading data to target data warehouse with BTEQ, Fast Load and Multi Load.
- Involved in production support a troubleshooting data quality and integrity issues.
Environment: Informatica Power Center 8.1.1, UNIX, SQL Server 7.0, Oracle 8i, DB2, Flat Files, Sun Solaris, Windows NT, Teradata V2R5
Confidential, OH
ETL/Teradata Developer
Responsibilities:
- Developed Informatica Mappings, Mapplets and Transformations to load data from different relational sources like Oracle, Teradata, DB2, and flat files sources into the data mart.
- Proficient in using DB client tools like SQL Navigator, TOAD, Teradata SQL Assistant, etc.
- Used various transformations like Source Qualifier, Lookup, Update Strategy, Router, Filter, Sequence Generator, and Joiner on the extracted source data according to the business rules and technical specifications.
- Optimized the Mappings using various optimization techniques and also debugged some existing mappings using the Debugger to test and fix the mappings.
- Schedule, Run and Monitor sessions by using Informatica Workflow Manager.
- Wrote Unix Shell Scripts for automating the FTP and SFTP Processes.
Environment: Informatica 8.1.1, UNIX, Teradata V2R6, Oracle 8i.
Confidential
Jr.Database Developer
Responsibilities:
- Involved in all aspects of software development life cycle.
- Generated DDL's of new database objects like tables, views, indexes, triggers, packages, stored procedures.
- Produced SQL reports, data extractions, data loading, and scripts for various schemas.
- Involved in performing backend testing by writing SQL queries to extract the data from SQL database using oracle.
- Worked on UNIX Environment.
- Wrote DDL, DML scripts for Schema, Table space, Cluster creation and Alteration.
Environment: Oracle 8i, UNIX, TOAD, SQL SERVER 2000, SDLC.
