Sr. Datastage Developer Resume
Minneapolis, Mn
SUMMARY:
- Over 6+ years of total IT experience in the business requirements analysis, application design, data modeling, development, testing and implementation of business applications with RDBMS, Data Warehouse/Data marts, ETL, and client/server environment applications for Inventory, Retail, financial domain.
- Hands on experience with Star and Snowflake Schema, Data Modeling, Fact and Dimensional Tables and Slowly Changing Dimensions.
- Have clear understanding of Data warehousing and Business Intelligence concepts with emphasis on ETL and life cycle development Using IBM INFOSPHERE DATASTAGE
- Experience in Oracle Data Warehouse applications testing using IBM Infosphere Datastage on multiple platforms.
- Extensively worked on different Datastage versions 11.3/9.1/8.5
- Involved in complete Software Development life - cycle (SDLC) of various projects, including requirements gathering, system analysis, design, development, implementation, deployment, testing, migration, support and maintenance.
- Good working knowledge on Business intelligence, OLAP, Dimensional modeling, Star and Snowflake schema, extraction, transformation and loading (ETL) process
- Expert in designing and developing Parallel jobs using various stages like Join, Lookup, Remove duplicates, Filter, Sequential file, Dataset, Copy, Funnel, Sort, Aggregator, CDC, Transformer, Pivot.
- Experience in integration of various data sources like Oracle, MS Excel and Flat files into the Staging Area.
- Worked on Slowly Changing Dimensions (SCD's) and its implementation to keep track of historical data.
- Extensively worked on Performance Tuning of Datastage jobs using best IBM standards by identifying and resolving performance bottlenecks at various levels.
- Strong knowledge of UNIX Shell Scripting, Pearl and Ruby programming.
- Experience in data extraction & validation in SQL and UNIX Shell Scripting.
- Knowledge in using PL/SQL to write stored procedures, functions, and triggers.
- Good expertise in using TOAD and SQL*Plus.
- Good analytical, problem-solving, and communication skills (verbal/written)
TECHNICAL SKILLS:
ETL Packages: IBM DataStage 11.3/9.1/8.7 ( Designer, Director, Manager) Parallel Extender.
Data Modeling: Power Designer, Erwin.
Operating System: UNIX, Windows 98/NT/2003/XP/2008.
Languages/Tools: SQL, PL/SQL, C, C++, Perl, UNIX Shell Scripting, SqlDbx, DB Visualizer.
RDBMS: Teradata V2R13.10, Oracle 11g/10g/9i, DB2 10/9/8, SQL Server 2012/2008.
PROFESSIONAL EXPERIENCE:
Confidential, Minneapolis, MN
Sr. DataStage Developer
Responsibilities: •
- Involved in gathering business requirements for existing jobs and for the new development processes.
- Actively interacted with data modeler in developing data mart design with Facts and Dimension tables for data warehouse.
- Created jobs using Datastage designer to import data from heterogeneous sources like Db2, Oracle, Flat files and SQL server.
- Used technical specifications and business rules for transforming the extracted data.
- Worked with Datastage Manager for importing and exporting table definitions/metadata and routines between Datastage projects.
- Extensively created user defined routines in addition to the Datastage in - built routines and transforms to handle various special and complicated data manipulations.
- Performed source data analysis and data cleansing.
- Involved in performance tuning of the Datastage jobs.
- Created ELT jobs using UNIX scripts and standard re-usable pearl scripts.
- Used Datastage Director to schedule, monitor and run jobs.
- Used Administrator for creating Datastage projects and setting up purging criteria.
- Involved in unit testing, system and integration testing.
- Modified UNIX shell scripts for file validations and job scheduling.
- Created detailed technical documentation for the jobs developed.
Environment: IBM InfoSphere DataStage 11.3,SQL Microsoft Visio, Teradata, SQL serever, CRON and UNIX Shell Scripting, XML, Perl, Power Designer.
Confidential
Sr. DataStage Developer
Responsibilities: •
- Participated in gathering the user requirements and involved in writing technical design documents.
- Active participation in decision making and QA meetings and regularly interacted with the Business Analysts & development team to gain a better understanding of the Business Process, Requirements & Design.
- Participated in writing Data Mapping Document from Functional Specification Document.
- Created Dimensions and loaded the Facts with the appropriate calculations as per business logic. Generated key values for the dimensions using DB Sequence.
- Used Datastage Designer for developing various jobs to extract, cleansing, transforming, integrating and loading data into Data warehouse database.
- Implemented logic for Slowly Changing Dimensions Type II by using Date methodology.
- Extensively used stages such as Oracle Connector, Transformer with loop function, Sort, Pivot, join, Lookup, Filter, Copy, Aggregator, Funnel, Peek, Dataset, Sequential file, Remove duplicate etc.
- Maintained Data Warehouse by loading dimensions and facts as part of project. Also worked for different enhancements in FACT tables.
- Used Data Stage designer to manage the Metadata repository and for import/export of jobs.
- Extensively worked on Job Sequences to Control the Execution of the job flow.
- Responsible for validating the Datastage jobs against the pre - defined ETL design standards.
- Participated in weekly status meetings.
- Performed tuning on sluggish ETL jobs by introducing manual partitioning, reducing stages, tuning Source and Target SQL queries, creating indexes on tables etc.
- Involved in Production Support to resolve the issues in a timely and efficient manner.
- Worked with Control-M team to schedule the Datastage job sequences in test and production environments.
Environment: IBM Infosphere Datastage 9.1, Oracle 11g, UNIX, Windows 7, Erwin, Cognos
Confidential
Datastage Developer
Responsibilities:
- Extensively used DataStage for extracting, transforming and loading databases from sources including Oracle and Flat files.
- Maintained Data Warehouse by loading dimensions and facts as part of project. Also worked for different enhancements in FACT tables.
- Generation of Surrogate Keys for the dimensions and fact tables for indexing and faster access of data in Data Warehouse.
- Extracted data from flat files and then transformed according to the requirement and Loaded into target tables using various stages like sequential file, Look up, Aggregator, Transformer, Join, Remove Duplicates, Change capture data, Sort, Column generators, Funnel and Oracle Enterprise.
- Created Batches (DS job controls) and Sequences to control set of jobs.
- Created shell script to run data stage jobs from UNIX and then schedule this script to run data stage jobs through scheduling tool.
- Delivered ETL test plans, test scripts, and validated based on design specifications.
- Extracted data from source systems transformed and loaded into Oracle database according to the required provision.
- Used Data Stage designer to manage the Metadata repository and for import/export of jobs.
- Used Partition methods and collection methods for implementing parallel processing.
- Develop complex SQL queries and build views for business to monitor performance.
- Tuned Datastage transformations and jobs to enhance their performance.
Environment: IBM Infosphere DataStage 8.5, Oracle 10g, UNIX, Autosys, Windows XP, HP Quality Center, Cognos
