Etl Developer Resume
OH
SUMMARY
- Over Nine years of IT experience in System Analysis, Design Development, Implementation and testing of Databases, Data Warehouse Applications on client server technologies in Pharma, Health care, Banking and Finance Domains.
- Experience in Extraction, Transformation and Loading (ETL) of Data into Data Warehouse using Informatica Power Center 9.x versions. Designed the Workflows, Mappings, creation of Sessions and scheduling them using Informatica Power Center 9.x.
- Experience in Designing and developing the complex mappings from various Transformations like Source Qualifier, Joiner, Aggregator, Router, Filter, Expression, Lookup, Sequence Generator, Java Transformation, Update Strategy, XML Transformations and Web Services.
- Experience with relational and dimensional data modeling, fact constellations and snowflake schema.
- Extensive ETL tool experience using IBM Infosphere/WebSphere DataStage, Ascential DataStage.
- Worked on DataStage tools like DataStage Designer, DataStage Director and DataStage Administrator.
- Strong understanding of the principles of Data Warehousing using fact tables, dimension tables and star/snowflake schema modeling.
- Experience with ETL design and development of DataMarts /Enterprise wide Data Warehouses/Operational Data Stores.
- Experience in Designing and developing the complex mappings from various Transformations like Source Qualifier, Joiner, Aggregator, Router, Filter, Expression, Lookup, Sequence Generator, Java Transformation, Update Strategy, XML Transformations and Web Services.
- Experience with relational and dimensional data modeling, fact constellations and snowflake schema.
- Experience in Extracting the data from legacy systems such as Netezza and Flat files into PowerCenter mappings and crawled through Glue, an Amazon ETL tool.
- Designing logical and physical databases using Erwin and developed data Mappings between source systems and target components using Mapping Design Document.
- Experienced in understanding the components of Informatica Data Quality (IDQ).
- Involved in creating complex physical/logical data objects and creation of Profiles and Scorecards.
- Experience in Debugging sessions and mappings; Performance Tuning of the Sessions and mappings, implementing the complex business rules, optimizing the mappings.
- Experience in Data cleansing, Slowly Changing Dimensions. Implemented data warehousing techniques for Data cleansing, Slowly Changing Dimension Phenomenon’s (SCD) and Change Data Capture (CDC).
- Experience in creating, deploying and troubleshooting SSIS packages. Experience in managing OLAP Database warehouse by using services like Analysis Services (SSAS).
- Experience in creating, automating, scheduling and monitoring SQL jobs with SQL Server Agent.
- Creating User Permissions, Logins and Maintaining DB Security Issues.
- Extensive development, support and maintenance experience working in all phases of the Software Development Life Cycle (SDLC) especially in Data warehousing.
TECHNICAL SKILLS
Data Warehousing Tools: Power Center v10,2, v9.6, InfoSphere DataStage11.X/9.X/8.X, Informatica, Metadata Manager, Business Glossary Desktop and Power Exchange 9.x, 8.x, 7.x, 6.x and 5.x, Business Objects XIR2, 5.1, 6.5, Informatica Analyst, AWS S3,Redshift, Glue
Databases/RDBMS/Others: MS SQL Server 2008/ 2005/2000 , Oracle 8i/9i/10g/11g, DB2 UDB, Teradata V2R5.0/V2R6.0, XML, Mainframe, Flat Files
Microsoft Suite: Excel, Word, PowerPoint
Data Modeling Tools: CA Erwin, MS Visio
Scripting Languages: UNIX Shell scripting, Korn Shell Scripting (K - Shell) and Perl
Job Control/Other Tools: Control-M, Autosys, TOAD, Putty and CVS
Programming Languages: SQL, PL/SQL, BTEQ and T-SQL.
GUI Tools: SSIS, SSRS, SSAS
PROFESSIONAL EXPERIENCE
Confidential, OH
ETL Developer
Responsibilities:
- Developed and maintained Data Extraction, Transformation and Loading of mappings using Informatica Designer 10.2 to extract the data from multiple source systems that comprise databases like Teradata, SQL Server, flat files to the Staging area and then into Enterprise Data warehouse.
- Involved in a full Software Development Life Cycle (SDLC) - Business Requirements Analysis, preparation of Technical Design documents, Data Analysis, Logical and Physical database design, Coding, Testing, Implementation, and deployment to business users.
- Worked closely with the Requirements Manager and business Analysts on the requirements collection process.
- Used the DataStage Designer to develop processes for extracting, cleansing, transforming, integrating and loading data into staging tables.
- Extensively used ETL to load data from IBM DB2 database, XML & Flat files Source to Informix Database Server.
- Involved in analysis, planning, design, development, and implementation phages of projects using IBM Web Sphere software (Quality Stage v8.0.1, Web Service, Information Analyzer, Profile Stage, WISD of IIS 8.0.1).
- Developed complex jobs using various stages like Lookup, Join, Transformer, Dataset, Row Generator, Column Generator, Datasets, Sequential File, Aggregator and Modify Stages.
- Developed ETL Processes in AWS Glue to migrate Campaign data from external sources like S3, ORC/Parquet/Text Files into AWS Redshift.
- Loaded data into Amazon Redshift and use AWS Cloud Watch to collect and monitor AWS RDS instances
- Extracted the data from legacy systems such as Mainframe tables, Netezza, Flat files and IBM DB2 into Power Center mappings and crawled through Glue, an Amazon ETL tool.
- Designed data extraction processes to meet business application requirements and data sources.
- Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on an ad hoc or scheduled basis.
- Created shared container to incorporate complex business logic in job.
- Monitoring the DataStage job on daily basis by running the UNIX shell script and made a force start whenever job fails.
- Created and modified batch scripts to ftp files from different server to data stage server.
- Extensively used slowly changing dimension Type 2 approach to maintain history in database.
- Created Job Sequencers to automate the job.
- Worked with normal forms including first, second and third normal forms and maintained historical data.
- Generated queries using SQL to check for validity of the data in the tables and updated the tables according to the Business requirements document.
- Resolved troubleshooting problems relating to ETL applications and data issues.
Confidential, OH
ETL/Informatica Developer
Responsibilities:
- Involved in a full Software Development Life Cycle (SDLC) - Business Requirements Analysis, preparation of Technical Design documents, Data Analysis, Logical and Physical database design, Coding, Testing, Implementation, and deployment to business users.
- Worked closely with the Requirements Team and business Analysts on the requirements collection process.
- Extracted the data from legacy systems such as Netezza and Flat files into PowerCenter mappings and crawled through Glue, an Amazon ETL tool
- Designed data extraction processes to meet business application requirements and data sources.
- Assisted in designing and development of complex ETL structures for transformation of data sources into data warehouses.
- Developed shared objects in Informatica for source/target/lookup transformations, developed complex mappings, sessions/workflows/worklets, database connections.
- Generated queries using SQL to check for validity of the data in the tables and updated the tables according to the Business requirements document.
- Involved inworking with Data Marts, Data warehousing, Operational Data Store ODS, OLAP, Star Schema Modeling, Snow-Flake Modeling, Fact and Dimensions Tables using MS Analysis Services.
- Worked with MDX to query cube’s data which in turn send the data to down streams.
- Created new cubes and modified existing cubes using SSAS 2008 to make data available.
- Resolved troubleshooting problems relating to ETL (SSIS,Informatica)applications and data issues.
- Conducted validation testing and design reviews for suggesting and approval of design specifications.
Confidential, OH
ETL Developer
Responsibilities:
- Extracted the data from legacy systems such as Mainframe tables, Netezza, Flat files and IBM DB2.
- Used Informatica as ETL tool to design and develop parallel jobs to process more than 40 million records on weekly basis.
- Designed and developed DataStage extraction, transformation, and loading of jobs from three source systems into the data warehouse (Oracle tables, SQL server and Mainframe DB).
- Used DataStage Manager for importing metadata into repository, creating new job categories, exporting and importing the jobs between the production and the development servers.
- ETL IBM DataStage Developer with emphasis on Hadoop Data Processing - Coding and testing complex (data from multiple sources such as SQL databases and Hadoop) IBM DataStage jobs.
- Design and development of enterprise systems making specific determination about system performance, reliability and scalability.
- Determine the appropriate code for ETL applications based on information gathered including data sources, data targets, data definitions, data relationships, and business rules.
- Work closely with project management, analysts, data modelers and the existing ETL design and developers to understand project requirements and contribute to the project solution.
- Provide technical expertise on ETL design, Data modeling, Data Warehousing, and Data integration.
- Collaborate with Business Intelligence and business operational teams to understand data sources and implement new requirement.
- Analysis of system specifications and translates system requirements to mapping documents and system code.
- Analyze and summarize data to facilitate business intelligent decision.
- Responsible to Build ETL code, prepare Unite test case scenarios, Functional testing, Cross product Integration Testing, EDU/UAT testing, Production deployment, Production support of Current ETL components and future deployments.
- Responsible for the ongoing operational stability of the ETL processes ensuring they are properly monitored and audited to provide data integrity and timeliness of delivery.
- Extensively worked on building DataStage jobs using various stages like Oracle Connector, Funnel, Transformer stage, Sequential file stage, Look Up, Join and Peek Stages.
- Used Alteryx for XML comparison for DEV, QA, EDU environments.
- Worked on upgrading DataStage jobs from v9.1 to v11.5
