Sr. Etl Consultant Resume
Columbus, OH
SUMMARY
- 8+Years of IT experience in Programming and maintenance of Software with designing of Data Warehousing Projects.
WORK EXPERIENCE
Confidential, Columbus, OH
Sr. ETL Consultant
Responsibilities:
- Working on a migration project where I have to design and decommission the existing Oracle to a Teradata db.
- Interact with Business and have to create the data models, design them and create the ETL components.
- Perform an impact analysis from end to end to decommission the existing Oracle tables.
- Worked on Informatica power center tools - designer, repository manager, workflow manager, and workflow monitor.
- Extracted the data from the flat files and other RDBMS database into staging area and populated onto data warehouse.
- Used Type1 SCD and Type2 SCD mapping to update slowly changing dimensions tables
- Have used BTEQ, FLOAD, MLOAD teradata utilities to export and load data to/from Flat files.
- Wrote UNIX shell scripts commands for FTP of files remote server and backup of repository and folders.
- Logical and physical data modelling was done using Erwin for data warehouse database in STAR SCHEMA.
- Involved in performance tuning at source, target, mapping, sessions and system levels
- Successfully migrated and decommissioned 15 tables to help the reporting team to use a single source of truth.
- Created data models and updated the Meta data for future references.
Environment Used: Informatica 9.5, Oracle 11g, Teradata 14.10, Linux, Erwin 9.2,Toad Data point, Microsoft Office 2010,T load utilites, Teradata Viewpoint, Salesforce, Performance tuning.
Confidential, Columbus, OH
ETL Lead Developer
Project Details:
- Involved directly with the Business and Business Analyst to create DMD’s and handling the BRD’s.
- Developed the ETL processes using Informatica Power Center to load data into the Teradata database from Flat Files.
- Developed shell scripts to handle file watcher, file transfer using (SCP, SFTP), trigger the process and sending email task based on file availability.
- Worked as an ETL Admin and production support on rotation basis during the implementation of project.
- Developed mapplets and reusable transformations to reduce the redundancy of transformation usage.
- Administered logins for the group members and assigning necessary privileges.
- Experience in integration of heterogeneous data sources like Oracle, DB2, SQL Server and Flat files (fixed & delimited).
- Extensively worked on Facts and slowly changing dimensions(SCD) tables.
- Implemented Performance tuning logic on Targets, sources, Mappings and Sessions to provide maximum efficiency and performance.
- Performed the data profiling and analysis making use of Informatica Data Quality (IDQ).
- Prepared UNIX Shell scripts and these shell scripts will be scheduled in AUTOSYS for automatic execution at the specific timings.
- Successfully implemented HOM and 24BY7 project, by creating a new design altogether which made the project to go live successfully on time.
- Worked on performance improvements of old ETL objects to decrease the production load time.
Environment Used: Informatica 9.0.1,Teradata 13, Oracle 10g,T Load Utilities, IDQ, SVM, Unix, Visio, Microsoft Office 2010, Toad, Autosys, Clear quest, SSIS.
Confidential, Denver, CO
Onsite Lead Developer
Responsibilities:
- Lead a team of 7 members to do the ETL Design and Development.
- Designed ETL process to handle intraday transactions from the source and building an SCD in Teradata.
- Interact with Data Modelers to understand and finalize the conversion strategies.
- Interaction with the Business Partners to understand the business of the application, gather requirements analyzed and put into technical design documents.
- Performed unit testing on the Informatica code using the Informatica Debugger and by manually checking through Sql queries.
- Worked on performance improvement for weblogs project. Redesigning the existing ETL’s to use pushdown optimization and use TPT instead of regular Teradata utilities.
- Came up with new design templates to create the ETL components.
- Managed the account to grow from 2 onsite, 5 offshore to 5 onsite and 34 offshore developers.
Environment Used: Power Center 8.6.1, UNIX Shell, Flat Files,Agile, SQL Server, Teradata, IDQ, ESP, Remedy, TFS, Salesforce,DB2,T Load Utilities, Performance tuning.
Confidential, St Louis, MO
Programmer Analyst
Responsibilities:
- Lead a team of 10 offshore resources to do the development and maintenance of ETL projects.
- Designed technical documents & review documents based on the Functional/Business requirements and receiving
- Signoff from the Business Users on the Mapping Documents.
- Used Teradata utilities such as BTEQ, Fast Load, Multi Load, Fast Export, DDL and DML commands (SQL).
- Extensively worked with scheduling and design flow for Informatica components through a 3rd party tool WLM.
- Worked as a maintenance coordination to debug the production issues and fixing them to reach the SLA time.
- Tuning of Ab Initio graphs for better performance.
- Developed Ab Initio scripts for data conditioning, transformation, validation and toading.
- Responsible for cleansing the data from source system using Ab Initio components such as Join, Normalize, Denormalize.
- Managed and reviewed Hadoop log files.
- Shared responsibility for administration of Hadoop.
- Managed the production environment by scheduling and maintaining the ETL workflows efficiently.
- Managed the account to grow from 4 offshore to 16 offshore developers.
Environment Used: Power Center 8.6.1, Ab initio, Hadoop, Teradata SQL Assistant 12.0,T Load Utilites, Unicenter WLM, Planview Enterprise 9 ServiceCenter6.2, Ipswitch WS FTP Professional 2007, Windows XP Professional.
Confidential, Jersey City, NJ
Developer
Responsibilities:
- Involved in design, development and maintenance of database for Data warehouse project.
- Involved in Business Users Meetings to understand their requirements.
- Converted business requirements into technical documents - BRD, explained business requirements in terms of technology to the developers.
- Developed ETL Mappings and Test plans.
- The Data flow diagrams ranged from OLTP systems to staging to Data warehouse.
- Developed Test plans to verify the logic of every Mapping in a Session. The test plans included counts verification, look up hits, transformation of each element of data, filters, and aggregation and target counts.
- Developed Complex Informatica Mappings using various transformations- Source Qualifier, Filter, Update strategy, Router, Aggregator, Sequence Generator, Reusable sequence generator transformation.
- used SCD’s (Slowly Changing Dimension) to handle the Incremental Loading for Dimension tables, Fact tables.
- Designed various Mappings for extracting data from various sources involving Flat files, Oracle and SQL Server, IBM DB2.
- UsedTeradata utilities fast load, multiload, t pumpto load data
- Wrote BTEQ scripts to transform data Wrote Fastexport scripts to export data
- Worked on Debugging and Troubleshooting of the Informatica application. For debugging utilized Informatica debugger.
- Worked on Performance Tuning to optimize the Session performance by utilizing, Partitioning, Push down optimization, pre and post stored procedures to drop and build constraints.
- Worked on Teradata utilities BTEQ, MLOAD, FLAOD and TPUMP to load staging area.
- Created UNIX Script for ETL jobs, session log cleanup and dynamic parameter.
- Created and scheduled Sessions, Jobs based on demand, run on time and run only once
- Monitored Workflows and Sessions using Workflow Monitor and Scheduler alert editor.
- Performed Unit testing, Integration testing and System testing of Informatica mappingscomplete Module and coded