Etl Resume
New York, NY
SUMMARY
- Over 6+ years of Experience in all the phases of the Data warehouse life cycle involving design, development & analysis and testing of Data warehouses using ETL.
- Designed and developed different slowly changing dimension procedures for multiple data extracts based on business requirements.
- Strong in DWH concepts, Dimensional Table, Fact Table, Dimensional Data Modeling, Star Schema and Snowflakes Schema methodologies.
- Extensive knowledge in design of Extract, Transform, Load environment usingInformaticaPowerCenter9.1/8.x/7.x/6.x.
- Extensively worked on ETL process consisting of data transformations, data sourcing, mapping, conversion and loading.
- Extensive experience in implementation of Data Cleanup procedures, transformations, Scripts, Stored Procedures and execution of test plans for loading the data successfully into the targets.
- Have RDBMS concepts experience in Oracle 11i/10g/9i/8i/7.x, WinSQL, SQL*Loader,Netezza
- Extensively worked withNetezzadatabase to implement data cleanup, performance tuning techniques.
- Experience in managing SSIS packages and DTS 2000 packages within SQL Server Management Studio(SSMS)
- Expertise in creating reports using SQL Server Reporting Services (SSRS), Crystal Reports and Excel Spreadsheet.
- Experienced in Performing Unit testing, system testing and system integration testing.
- Have excellent written and oral communication skills with the ability to communicate appropriately in business and technical situations at all levels.
- Have Experience in designing and developing UNIX shell scripts as part of the ETL process to compare control totals, automate the process of loading, pulling and pushing data from & too different servers.
- Have ability to understand and interact with technically-oriented team members. Skilled in using MS Office applications for day to day activity, MS Visio for drawing flow diagrams.
- An excellent team member with an ability to perform individually, good interpersonal relations, strong communication skills, hardworking and high level of motivation.
TECHNICAL SKILLS
Operating Systems: UNIX, Linux, Windows XP/2000/98/95
Databases :Netezza4.6.8, Oracle 10g/9i/8i/7.x,
ETL Tool:InformaticaPower Center 9.x/8.6/8.5/8.1, 7.1, 6.2/6.1
BI Tools: Business Objects, Micro Strategy 8x/9x
Office Tools: MS Excel, Access, Visio, PowerPoint, Word
Confidential, Manchester, NH May 2011-Present
Sr. ETL Developer
Responsibilities:
- Expertise in of the Extract, Transform and Load process and development of transformation standards and processes usingInformaticabest practices.
- Designed the architecture of customer master Project in team.
- Usedinformaticapower center 9.0.1 to Extract, Transform and Load data into Netezza Data Warehouse from various sources likeOracle and flat files.
- Used various transformations like Source Qualifier, Lookup, Router, Filter, Update, Expression, Aggregator, Sorter, Sequence Generator etc.
- Used unconnected lookup where different expressions used the same lookup and had multiple targets, which use same logic executed and return one value.
- Developed mappings of Customer, Specialty, State license number, Organization, Provider and Location dimensions implementing the ETL logic.
- Loaded Data into target Data warehouse from 12 different sources.
- Created and Configured Workflows, Worklets, and Sessions to transport the data to target warehouseNetezzatables usingInformaticaWorkflow Manager.
- Used workflow monitor to see the work flows running and get the session properties and session log.
- Developed all the mappings according to the design document and mapping specs provided and performed unit testing.
- Created workflow documentation for each of the developed mapping.
Environment:Netezza4.x, Oracle 10g,InformaticaPower Center 9.0.1 , Flat Files, Unix Shell scripts, Windows XP.
Confidential, MI Jan’10 – Mar’11
Informatica Developer
Responsibilities:
- Interacted with business users and gathered requirements based on the changing needs. Incorporated identified factors into Informatica mappings to build the DataMart.
- Developed a standard ETL framework to enable the reusability of similar logic across the board. Involved in system documentation of dataflow and methodology.
- Created technical design specification documents based on the functional design documents and the physical data model.
- Responsible for design and developing of ETL (Extract, Transform and Load) processes usingInformatica PowerCenter8.6.1/8.5.1.
- Extracted data from data Sources like Flat files, Relational Databases and Heterogeneous sources.
- Maintained source and target mappings, transformation logic and processes to reflect the changing business environment over time.
- Used transformations like Source Qualifier, Aggregator, Filter, Router, Sequence Generator, Lookup, Rank, Joiner, Expression and Update Strategy in the mappings to meet business needs.
- Worked on Mapping parameters, Mapping variables and passing parameters between sessions.
- Worked extensively on schema (Star schema) creations in data warehouse.
- Created sessions, batches for incremental load into staging tables, and schedule them to run daily.
- Involved in performance tuning in the ETL processes.
- Worked on slowly changing dimensions(Type1 and 2)
- Developed shell scripts, PL/SQL procedures, for creating/dropping of table and indexes of performance for pre and post session management.
- Used SQL tools likeWinSQL to run SQL queries and validate the data in warehouse.
Environment: Informatica Power Center 8.6.1/8.5.1, Oracle 10G/9I, WinSQL, Windows XP/2008, Microsoft Office 2007, Unix Shell Scripting.
Confidential, New York, NY Jul’08 – Dec’09
Role:ETL Consultant
Responsibilities:
- Analyzed the source data coming from Oracle, Flatfile . Worked with Data Warehouse team in developing Dimensional Model.
- UsedInformaticaDesigner to create mappings using different transformations to move data to a Data Warehouse. Developed complex mappings inInformaticato load the data from various sources into the Data Warehouse, using different transformations like Source Qualifier, Expression, Lookup, Aggregator, Update Strategy, Joiner, and Rank.
- Responsible for creating different sessions and workflows to load the data to Data Warehouse usingInformaticaWorkflow Manager.
- Involved in identifying the bottlenecks in Sources, Targets & Mappings and accordingly optimized them.
- Worked with NZLoad to load flat file data intoNetezzatables.
- Good understanding aboutNetezzaarchitecture.
- Assist DBA and Architect to identify proper distribution keys forNetezzatables.
- Created mappings using pushdown optimization to achieve good performance in loading data intoNetezza.
- Created and Configured Workflows, Worklets, and Sessions to transport the data to target warehouseNetezzatables usingInformaticaWorkflow Manager.
Environment:InformaticaPower Center (Designer 7.x, Repository Manager 7.x, Workflow Manager 7.x), Flat files,Netezza4x, UNIX, WinSQLand Shell Scripting
Confidential, NY July 07 - Jun’08
Informatica Developer
Responsibilities
- Worked closely with the Data Modelers for Designing and customizing data models for Data warehouse, supporting data from multiple sources in real time.
- Involved in building the ETL architecture and Source to Target mapping to load data into Data warehouse.
- Created mapping documents to outline data flow from sources to targets.
- Extracted the data from the flat files and other RDBMS databases into staging area and populated onto Data warehouse.
- Used various transformations like Filter, Expression, Sequence Generator, Update Strategy, Joiner, and Union to develop robust mappings in the Informatica Designer.
- Developed Mapping parameters and Variables to support SQL override.
- Created Mapplets to use them in different mappings.
- Developed mappings to load into staging tables and then to Dimensions and Facts.
- Used existing ETL standards to develop these mappings.
- Worked on different tasks in Workflows like sessions, events raise, event wait, decision, e-mail, command, Worklets, Assignment, Timer and scheduling of the workflow.
- Created sessions, configured workflows to extract data from various sources, transformed data, and loaded into data warehouse.
- Used Type 1 SCD and Type 2 SCD mappings to update slowly Changing Dimension Tables.
- Involved in performance tuning for sources, targets, mappings and sessions.
- Involved in preparing the migration document to move the mappings from development to testing and then to production repositories.
Environment: Informatica Power Center 7.1.4/7.1.1, Oracle 9i, SQL Plus, Windows 2005/XP, Microsoft Office 2003, Shell Scripting.
Confidential, Los Angeles, CA March 06 - July 07
Role: ETL Developer
Responsibilities
- Worked with business analysts to identify appropriate sources for Data warehouse and to document business needs for decision support data.
- Designed the ETL processes usingInformaticato load data from Flat Files to target Oracle Data Warehouse database.
- Performed data manipulations using variousInformaticaTransformations like Joiner, Expression, Lookup, Aggregate, Filter, Update Strategy, and Sequence Generator etc.
- Involved in creating logical and physical data modeling with STAR and SNOWFLAKE schema techniques using Erwin in Data warehouse as well as in Data Mart.
- Written SQL overrides in source Qualifier according to business requirements.
- Written pre session and post session scripts in mappings.
- Created sessions and workflow for designed mappings.
- Redesigned some of the existing mappings in the system to meet new functionality.
- Used Workflow Manager for Creating, Validating, Testing and running the sequential and concurrent Batches and Sessions and scheduling them to run at specified time with required frequency.
- Extensively worked in the performance tuning of the programs, ETL Procedures and processes.
Developed PL/SQL procedures for processing business logic in the database. - Migrated the mapping to the testing and production department and introduced the concepts ofInformaticato the people in testing department.
- Produced documentation as per the company standards and SDLC.
Environment:Informatica6.x,Netezza, ORACLE9i ,UNIX, Windows NT, UNIX Shell Programming.