We provide IT Staff Augmentation Services!

Sr. Etl Datastage Developer Resume

5.00/5 (Submit Your Rating)

Chicago, IL

SUMMARY:

  • A Dynamic IT professional with 6 years of work experience in Data Integration and migration for Data Warehouses including IBM Info Sphere/Web Sphere/Ascential DataStage Server Edition, Enterprise Edition (Manager, Designer, Director, Administrator, Parallel Extender), Profile Stage/ Information Analyzer, Quality Stage
  • Experience in Analysis, Design, Development and Implementation of Relational Database (OLTP) and Data Warehousing Systems (OLAP)
  • Worked extensively with different processing stages of DataStage like Filter, Sort, Aggregator, Copy, Transformer, Funnel, Join, Look Up, Merge, Pivot, Modify, Switch, Change Capture, Surrogate Key Generator, Remove Duplicates
  • Strong experience in Data warehouse development life cycle and Design of Data marts with Star Schemas, Snowflake Schemas and Integrated Schemas
  • Used the DataStage Designer to develop processes for extracting, transforming, and loading data into data warehouse databases
  • Extensively worked with Parallel Extender for parallel processing to improve job performance while working with bulk data sources
  • Experience in integration of various data sources like Flat files, Oracle, Teradata into staging area and then into DataMart’s / EDW.
  • Worked extensively with different database stages of DataStage like Oracle Enterprise, Dynamic RDBMS, Stored Procedure, ODBC
  • Worked extensively with different file stages of DataStage like Sequential, Dataset, File set, Lookup File set
  • Performed tuning and optimization of complex SQL queries using Teradata Explain.
  • Worked extensively with different development/debug stages of DataStage like Head, Tail, Row Generator, Column Generator, Peek
  • Expertise in all the phases of System development life Cycle (SDLC) using different methodologies like Agile, Waterfall.
  • Extensively Worked on Job Sequences to control the flow of job execution using various activities like Job Activity, Email Notification, Sequencer, Routine activity and Exec Command
  • Excellent problem - solving and trouble-shooting capabilities. Quick learner, highly motivated, result oriented and an enthusiastic team player. Good interpersonal skills, experience in handling communication and interactions between different teams

SKILL:

ETL Packages: IBM Info Sphere/Web Sphere DataStage and Quality Stage, Ascential DataStage 11.3/9.1 (Designer, Director, Manager, Administrator), Information Analyzer/ Profile Stage, Quality Stage, Audit Stage

Databases: DB2, Teradata 13.11 client, MS Access, Oracle 12g/11c/10i, MS SQL Server

Database Modeling: Star-Schema Modeling, Snowflakes Modeling,E-R Modeling, FACT and Dimension Tables, Microsoft VISIO, ERWIN 4/7.1/8

Operating Systems: Windows NT / 2000 / XP Pro / Vista, 7, Windows Server / 2008, UNIX - Solaris/AIX/UX, Linux - Mint, Ubuntu

Languages: SQL, PL/SQL, UNIX Shell scripting, Java

PROFESSIONAL EXPERIENCE:

Confidential, Chicago, IL

Sr. ETL DataStage Developer

Responsibilities:

  • Worked closely with Business analysts and Business users to understand the requirements and to build the technical specifications.
  • Designed DataStage Parallel jobs involving complex business logic, update strategies, transformations, filters, lookups and necessary source-to-target data mappings to load the target
  • Design, build and test ETL jobs for extracting, transforming and loading data from different sources to a target database.
  • Widely Used different types of DataStage stages like modify, sequential file, Copy, Aggregator, Surrogate key, FTP stage Transformer, dataset, look up, join, Remove Duplicates, sorter, Column generators and Funnel.
  • Used DataStage as an ETL tool to extract data from sources systems, aggregate the data and load into the DB2 database, implemented bulk loading method for loading of data.
  • Working on Job Sequences to control the flow of job execution using various activities like Job Activity, Email Notification, Sequencer, Nested Condition, Routine activity and Exec Command
  • Working on DB2 QMF tools to extract the data from the Source AIW and the target DB2 database.
  • Developed DataStage sequences to load the data into database and send the success/Failure reports via emails.
  • Wrote different types of queries for validating data between different stages.
  • Created Before/After Job Sub routines, and various batch jobs Using Job sequencer
  • Worked with Data Modelers, Technical Architects, Customer/end user, Business analysts, and Data analysts to design Technical Specification documents / Mapping documents.
  • Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.
  • Working on error handling, data cleansing and performing lookups for faster access of data.
  • Used ticketing tool RTC for creating stories and proving status of each task.
  • Extensively used Intouch Scheduler Tool to schedule Data Stage jobs. Following AGILE methodology to produce the results and to perform the ETL jobs.

Environment: IBM Infosphere DataStage 11.5, DB2, QMF, AIW, Putty, Unix Shell scripting, SQL/PLSQL, RTC, Intouch,Windows.

Confidential, Boston, MA

DataStage Developer

Responsibilities:

  • Involved with Application and Database Support Teams to maintain system and database which supports current data scenarios and easily adapts to changing business needs.
  • Involved in all phases including Requirement Analysis, Design, Coding, Testing, Support and Documentation
  • Extensively used DataStage Designer to develop processes for extracting, transforming, integrating and loading data from various sources into the Data Warehouse database.
  • Widely Used different types of DataStage stages like modify, sequential file, Copy, Aggregator, Surrogate key, Transformer, dataset, look up, join, Remove Duplicates, sorter, Column generators and Funnel.
  • Used Parallel Extender extensively by using Processing, Development/Debug, File and Real Time Stages.
  • Extracted data from Heterogeneous source systems like Oracle, Teradata, SQL Server and flat files.
  • Used database stage like DB2, DB2 bulk load, DRS, ODBC Connector.
  • Responsible for the management, design, and continuous development of the Data Migration Extensively used SQL
  • Designed and developed the process for real time data movement of reference data from Sybase to DB2 using mix of DataStage jobs.
  • Extensively tested all the developed jobs based on the requirements of the project and deployed the code.
  • Experience in creating UNIX scripts for file transfer and file manipulation .
  • Created and used Shared Containers to reuse the logic in another Job. Developed staging and Data Mart DS jobs using Data Stage Designer on parallel environment.
  • Extensively used SQL in DataStage jobs for processing data.
  • Experience in writing different complex types of SQL’s for validating the data between different stages with in the data warehouse.

Environment: IBM DataStage 11.3, DB2 Z/OS, MS SQL Server 2008, Oracle 11g/12c, Rapid SQL 8.1.1, HP Quality Center 11/10, OLAP, OLTP, Business Objects.

Confidential, Chicago, IL

DataStage Developer

Responsibilities:

  • Worked closely with Business analysts and Business users to understand the requirements and to build the technical specifications.
  • Responsible to create Source to Target (STT) mappings.Responsible to design, develop and built DataStage parallel jobs using DataStage designer.
  • Developed and supported the Extraction, Transformation and Load process (ETL) for a data warehouse from various data sources using DataStage Designer.
  • Designed and developed Parallel jobs to extract data, clean, transform, and to load the target tables using the DataStage Designer
  • Designed developed job sequential to run multiple jobs
  • Used DataStage Designer for importing the source and target database schemas, importing and exporting jobs/projects, creating new job categories and table definitions.
  • Designed and developed the Routines and Job Sequence for the ETL jobs
  • Responsible for running jobs using Job Sequencers, Job Batches.
  • Developed Parallel jobs using various stages like Join, Merge, Funnel, Lookup, Sort, Transformer, Copy, Remove Duplicate, Filter, Peek, Column Generator, Pivot and Aggregator stages for grouping and summarizing on key performance indicators used in decision support systems
  • Extensively worked on Teradata MLoad, Teradata Enterprise Stage, and Teradata API Stage to extract, transform and load data.
  • Extensively used Reject Link, Job Parameters, and Stage Variables in developing jobs
  • Used the DataStage Director to run, schedule, monitor, and test the application on development, and to obtain the performance statistics.
  • Developed Packages and customized functions and Triggers based upon the business logics.
  • Involved in Performance tuning of complex queries.
  • Developing Oracle PL/SQL stored procedures, Functions, Packages, SQL scripts to facilitate the functionality for various modules. Involved in Unit testing and integration testing.

Environment: IBM InfoSphere DataStage/Quality Stage 9.1 (Designer, Director and Administrator), Teradata V2R12, AIX 5.3, SQL Server, SQL Assistant, Windows XP, Visio

Confidential

ETL DataStage Developer

Responsibilities:

  • Designed the ETL jobs using IBM Info sphere Data Stage 9.1 to Extract, Transform and load the data into staging, ODS and EDW.
  • Designed and developed the ETL jobs using Parallel Edition which distributed the incoming data concurrently across all the processors, to achieve the best performance.
  • Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture (CDC), Modify, Row Generator and Aggregator.
  • Responsible for generation of DDL statements which are executed for database creation.
  • Responsible for preparing Physical/logical data models.
  • Responsible for data analysis, requirements gathering, report analysis, source-to-target mapping, frequency analysis, process flow diagrams, and documentation.
  • Handled Performance Tuning of Jobs to ensure faster Data Loads.
  • Designed sequence jobs using the activities such as Job Activity, Nested Condition, Notification Activity, Sequencer Activity, Terminator Activity and Execute Command.
  • Performed the Integration and System testing on the ETL jobs. Responsible for preparing ad hoc jobs.
  • Created Job Parameters and Environment variables to run the same job for different sources and targets.
  • Worked with Developers to troubleshoot and resolve issues in job logic as well as performance.

Environment: IBM WebSphere DataStage 9.1(Designer, Director), IBM Information Analyzer 8, Microsoft SQL 2005/2008.

We'd love your feedback!