We provide IT Staff Augmentation Services!

Sr Datastage Developer Resume

0/5 (Submit Your Rating)

Boston, MA

SUMMARY

  • Around 8 years of experience in Data warehousing in the areas of ETL Design and Development. Proficient in all stages of Software Development life - cycle including System Analysis, Design, Development, Implementation, Production Support and Maintenance.
  • Extensive experience in UNIX based applications (IBM DataStage 7.5/8.0.1/8.5/11.3 ) in Data warehousing (ETL) projects.
  • Worked on technologies and tools like IBM DataStage 7.5/8.0.1/8.5/11.3 ,Oracle 9i,10g, DB2,Sql Server, UNIX Shell Scripting, Mainframe, Autosys, Tivoli, Tidal, Clear Case, Window Batch Scripts and PVCS
  • Strong understanding of the principles of DataWarehouse using fact tables, dimension tables and Dimensional modeling.
  • Familiar in using highly scalable parallel processing infrastructure using parallel jobs.
  • Used Enterprise Edition/Parallel Extender stages like Datasets, Sort, Remove Duplicate, Join, Lookup, Change Capture, Funnel and many other stages in accomplishing the ETL Coding
  • Created and implemented common UNIX shell scripts to FTP the files from/to different servers, validate, process the Flat Files for different projects.
  • Experience in troubleshooting of jobs and addressing production issues like performance tuning and enhancement.
  • Expertise in Unit testing, Integration testing and maintenance.
  • Expert in performance analysis of the jobs, queries and performance enhancement and tuning of jobs.
  • Experience working with offshore and onsite co-ordination.
  • Familiar with SQL and PL/SQL
  • Having good experience version control scheduling tool like Clear Case.
  • Having good experience in the preparation of JIL scripts to schedule the jobs through Autosys.
  • Extracted the data from the Mainframe applications which is the hierarchy file system by using the complex flat file stage.
  • Having an excellent quality of adapting to latest technologies.

TECHNICAL SKILLS

ETL Tools: IBM Info Sphere Data Stage 11.3/8.5/8.0.1/7. x,Informatica,Bigdata

Data Modeling: Data Modeling, Star Schema Modeling, Snow-Flake Modeling, Fact and Dimensions.

Databases: Oracle 10g/9i/8i,SQL Server,DB2

Utilities: Putty, Toad, SQL Developer.

Operating system: Windows, Unix

Languages: SQL, PL/SQL, Unix Shell Scripting

Scheduling Tools: Autosys, Tivoli, Tidal

Version Control Tool: Clear Case, PVCS

PROFESSIONAL EXPERIENCE

Confidential, Boston, MA

Sr DataStage Developer

Responsibilities:

  • Worked with business analyst to identify, develop business requirements, transform it into technical requirements and responsible for deliverables.
  • Distributing work to Onsite Developers and offshore.
  • Designed ETL jobs with complete understanding on how GRID work and how to reduce the job wait time in the queue before getting submitted to grid.
  • Using Shell programming, worked on development of batch programming, where data stage jobs called from UNIX shell programs in batches.
  • Create multiple shell scripts to pass required parameters to ETL jobs and run.
  • Used different stages like Oracle connector, Sequential File, Data set, Aggregate, Filter, Join, Lookup, Funnel in developing the DataStage jobs.
  • Designed and developed DataStage jobs for Loading Staging Data from different sources like Oracle, SQL Server DB into Data Warehouse applying business rules which consists data loads, data cleansing, and data massaging.
  • Created Shared Container to simplify the Datastage Design, and used it as a common job component through out the project.
  • Responsible for performance tuning of DataStage code to increase the performance.
  • Ensured smooth deployment during production releases through Clear Case.
  • Design Autosys scheduling scripts to schedule DataStage jobs and run then through Autosys scheduler.
  • Provided support to the QA team to run all the respective objects in DEV, UAT environments during scheduled Cut-over’s at various phases of the project.
  • Documented all the implementation process in detail describing the overall DataStage process and Part of the Production Support team to monitor and fix any production issues/failures and making sure that the SLA’s are being met on a timely manner.
  • Write and Optimize complex SQL queries for better performance of ETL jobs.
  • Working with offshore and onsite co-ordination.

Environment: IBM DataStage 11.3, Oracle10g, Putty, Toad, SQL Server 2008, UNIX Schell Scripting, Windows XP, Autosys, Clear Case, Window Batch Scripts

Confidential, Chicago, IL

DataStage Developer

Responsibilities:

  • Business model Analysis, analyzing existing Data Model and Data dictionary.
  • Requirements gathering, source system analysis to merge multiple source systems into a single entity.
  • Design the entire ETL process and jobs considering all the existing enterprise process and guidelines.
  • Responsible to create Source to Target (STT) mappings.
  • Extracted Data from Various Source Systems like Oracle, DB2 and SYBASE.
  • Prepared ETL Technical design document and mapping documents.
  • Developed and supported the Extraction, Transformation and Load process (ETL) for a data warehouse from various data sources using DataStage Designer.
  • Developed the Datastage parallel Jobs using various Processing Stages like Join Stage, Connector Stages, Copy Stage, Merge Stage, Aggregator Stage, Filter Stage, Look up Stage, Transformer Stage, Modify, Filter Stage, Funnel Stage, Change capture stage, Row Generator and Column Generator Stage ..
  • Responsible to develop job sequences to run multiple jobs with correct dependency and using various Activity stages like like Job Activity, Execution Command, Start Loop Activity, End Loop Activity, Notification Activity, User Variables Activity Stage, Routine Activity Stage.
  • Expertize in converting PL/SQL Codes into Datastage Codes.
  • Worked withMDM tool Siperianto Match and Merge the data and also used the data from Siperian tables as the source and also used as the target to Siperian tables.
  • Design of ETL process using IBM Datastage (Data Integrator) to create golden customer record and load into MDM
  • Used DataStage Designer for importing the source and target database schemas, importing and exporting jobs/projects, creating new job categories and table definitions.
  • Developed a Datastage Jobs to extract data from SYBASE Database and load into the Oracle Database using the existing Java code loading data from SYBASE Database to DB2 Database.
  • Worked on Converting the Oracle enterprise stage to Oracle Connector stages.
  • Experience with all the new features in Datastage 11.3 and migrated all the jobs from 8.7 to 11.3.
  • Implemented logical and physical data modeling with Star and Snowflake techniques using Erwin in Data warehouse.
  • Hands on experience using various partitioning methods like Hash by, Entire and Range for bulk data loading and for performance boost
  • Developed parallel jobs using various Development/debug stages (Peek stage, Row generator stage, Column generator stage, Sample Stage) and processing stages.
  • Developed Unit testing, System testing and integration testing.
  • Extensively used Control-M for automation of scheduling Datastage Jobs and UNIX shell script jobs on daily, weekly monthly basis with proper dependencies
  • Used the DataStage Director to run, schedule, monitor, and test the application on development, and to obtain the performance statistics

Environment: IBM DataStage and Quality Stage 11.3/8.7(Manager, Designer, Director, Administrator), MDM Siperian, Fast track, Oracle connector migration, Oracle 11g,SYBASE, DB2 UDB, SQL, PL/SQL, Toad, SQL * Loader, UNIX, Control m, Erwin 3.5

Confidential, Boston

ETL Developer

Responsibilities:

  • Extracted data from heterogeneous source systems transformed and loaded into Oracle database according to the required provision.
  • Involved in system analysis, design, development, support and documentation.
  • Extensively using DataStage Designer stages such as Aggregator, Transformer, Join, Dataset, Lookup and Modify.
  • Involved in database development by creating Joins, Sub-queries, Hierarchical Queries, Views, Functions and Procedures.
  • Created various indexes on tables to improve the performance by eliminating the full table scans.
  • Involved in the DataStage Designer to develop processes for extracting, cleansing, transforming, integrating and loading data into Data Marts.
  • Implemented parallel extender jobs for better performance using stages like Join, Merge, Sort and Lookup, transformer with different source files complex flat files, XML files.
  • Created shell script to run data stage jobs from UNIX and then schedule this script to run data stage jobs through scheduling tool.
  • Developed Test Plan that included the scope of the release, entrance and exit criteria and overall test strategy. Created detailed Test Cases and Test sets and executed them manually.
  • Solid experience in usingUNIXcommands and writingUNIXshell scripts.
  • Extensive experience in loading high volume data andperformance tuning.

Environment: IBM DataStage 8.5, Oracle10g, Putty, Toad, SQL Server 2008, UNIX Schell Scripting, Windows XP, Tidal, PVCS

Confidential, Phoenix

ETL Developer

Responsibilities:

  • Understanding Business process flow and existing jobs
  • Mapping sheet analysis before start developing job
  • Designed the ETL jobs using IBM WebSphere Information Server 8.1 to Extract, Transform and load the data into Staging and then into Oracle Database.
  • Extensively used the designer to develop various parallel jobs to extract, transform, integrate and load the data into Data warehouse.
  • Extracted the data from the mainframe applications which is the hierarchy file system by using the complex flat file stage.
  • Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture (CDC), Modify, Row Generator and Aggregator.
  • Handled Performance Tuning of Jobs to ensure faster Data Loads.
  • Extensively worked with Shared Containers for Re-using the Business functionality.
  • Created Job Parameters and Environment variables to run the same job for different schemas.
  • Used Director to monitoring jobs, run and validating its components.
  • Performed the Integration and System testing on the ETL application.
  • Participated in Unit testing and Integration testing of DataStage jobs.
  • Created objects like tables, views, Materialized views procedures, packages using Oracle tools like PL/SQL, SQL*Plus

Environment: IBM DataStage 8.1, DB2, Oracle, Mainframe, Putty, Toad, UNIX Schell Scripting, Control M

Confidential, California

Program Analyst/Production Support

Responsibilities:

  • Understanding the Technical specifications and Mapping Sheets provided by the Client.
  • Mapping sheet analysis before start developing job
  • Investigate data to identify errors and validate the contents of fields in a data file
  • Troubleshoot the designed jobs using the DataStage Debugger
  • Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup and Sort, Change Data Capture (CDC), Modify, Row Generator and Aggregator.
  • Handled Performance Tuning of Jobs to ensure faster Data Loads.
  • Created Job Parameters and Environment variables to run the same job for different schemas.
  • Used Director to monitoring jobs, run and validating its components.
  • Performed the Integration and System testing on the ETL application.
  • Responsible for creating the Database Tables, Constraints in Oracle.
  • Involved in writing Joins and Sub-queries.
  • Created objects like tables, views, Materialized views procedures, packages using Oracle tools like PL/SQL, SQL*Plus

Environment: IBM DataStage 7.5, Oracle, Putty, Toad, UNIX Schell Scripting

We'd love your feedback!