Sr. Datastage Developer Resume
Parsippany, NJ
SUMMARY:
- 5+ years of total IT experience in Analysis of data, designing the data, Development of structured data, Documentation and Implementation of Business Intelligence applications.
- Strong knowledge in Agile/ Scrum methodologies.
- Expert in Extraction, Transformation and Loading (ETL) experience using IBM Info sphere DataStage 11.3/ 9.1/8.5/8.1/7.5.
- Expert Level experience in DataStage Client components - DataStage Designer, DataStage Manager, DataStage Director and DataStage Administrator
- Extensively worked on Server Edition, Enterprise Edition (Parallel Extender) and Development of Data Warehouse/Data Mart Applications.
- Extensively made use of all stages Aggregator, Sort, Merge, Join, Change Capture, Peek stages in Parallel Extender job.
- Used Data Stage Manager to import/export Data Stage projects and jobs to define table definition in repository.
- Used Data Stage Director to debug, validate, schedule, run and monitor Data Stage Jobs
- Experience in designing Job Batches and Job Sequences for scheduling server and parallel jobs using DataStage Director, UNIX scripts.
- Expertise in writing UNIX shell scripts and hands on experience with scheduling of shell scripts using AUTOSYS/CONTROL-M.
- Expertise in Data Migration and Upgrading.
- Expertise in using ERWIN for data modeling.
- Strong Knowledge of Data Warehouse architecture in Designing Star Schema, Snow Flake Schema, FACT and Dimensional Tables. Physical and Logical modeling using Erwin.
- Extensive experience in developing strategies for Extraction, Transformation, Loading (ETL) data to various sources into data warehouse and Data Marts using Data Stage.
- Involved in Performance Fine Tuning of ETL programs. Tuned DataStage and Stored Procedures Code.
- Excellent experience in Relational Database (RDBMS), Oracle 11g,10g,9i, Microsoft SQL Server, Teradata Load and MultiLoad, SQL, PL/SQL, TOAD.
- Involved in Logical and Physical Design, Backup, Restore, Data Integration and Data Transformation Service and Creating Database Objects (Tables, Index, Triggers, Views, and Store Procedures).
- A well-organized, goal-oriented, highly motivated effective team member with excellent analytical, troubleshooting, and problem solving skills.
TECHNICAL SKILLS:
ETL tools: IBM Information Server DataStage 9.1/8.7/8.5/8.1
Data Modelling: E-R Modelling, Star and Snowflake Schema Modelling
Databases: Oracle 11g/10g/9i/8i, SQL Server 2008/2005, Teradata V2R5.0, DB2 UDB
Languages: C/C++, SQL, PL/SQL and Shell Scripting
Operating System: Unix, Linux, Windows XP,7,8 server
Scheduling Tools: Autosys, Control-M
PROFESSIONAL EXPERIENCE:
Confidential, Parsippany, NJ
Sr. DataStage Developer
Responsibilities:
- Creating Low Level Design documents by understanding the requirements and there by develop jobs.
- Worked in Data Acquisition project, where we need to extract data from different sources, process the data and generate the files and transfer these files to Target Systems.
- Worked on several change requests, which were created because of production incidents and requirement changes to the code in production environment.
- Responsible for using different types of Stages such as ODBC Connector, Oracle Connector, DB2 Connector, Teradata Connector, Transformer, Join, Sequential File to develop different jobs.
- Developing DataStage Parallel and Sequence Jobs.
- Developed common Jobs, Shared containers and Server Routines which are used across the project in most of the interfaces.
- Created Unix Shell Scripts that take care of end to end automation.
- Developed UNIX shell Scripts that trigger DataStage jobs, transfer the output files, perform basic validations on file.
- Prepared Unit Test Cases and executing them.
- Fix the defects raised by testing team and maintain the status in HP Quality Center.
- Extensively used SQL tuning techniques to improve the performance of Data Stage Jobs.
- Tuned DataStage transformations and jobs to enhance their performance.
- Provide Post Implementation Support.
- Developed Multi-Instance reusable Datastage jobs.
- Involved in performance tuning by rewriting the queries and modifying existing Datastage jobs.
Environment: IBM InfoSphere 9.1.2, IBM InfoSphere DataStage 8.7v, UNIX shell Script, ORACLE 10g, SQL Developer, DB2,Teradata, AQT (for accessing SQL Server and DB2), Office.
Confidential, NYC, NY
Sr. DataStage Developers
Responsibilities:
- Handling production issues and working on developing new design specifications into ETL coding and mapping standards.
- Extensively used Datastage Designer to develop processes for extracting, transforming, integrating and loading data from various sources into the Data Warehouse.
- Created ETL processes composed of multiple Datastage jobs using job sequencer and developed shell scripts to automate the process and tested the processes.
- Extensively worked on different databases like Oracle, Db2 and SQL Server to extract and load the data from one another.
- Used different types of stages like Transformer, CDC, Remove Duplicate, Aggregator, ODBC, Join, Funnel, dataset and Merge for developing different jobs.
- Extensively used Parallel stage like row generator, column generator and Peek Stages for debugging purpose.
- Used the Director and its run-time engine to schedule running the job, testing and debugging its components, and monitoring the resulting executable versions.
- Documented data sources and transformation rules required to populate and maintain Data Warehouse content.
- Customized UNIX scripts as required for preprocessing steps and to validate input and output data elements.
- Effectively implemented Partitioning and Parallelism techniques to fully utilize the resources and enhance job performance.
- Wrote SQL scripts to extract and load data from source and target databases.
- Implemented slowly change dimensions (SCD) type 1, type 2.
- Designed and developed various jobs for scheduling and running jobs under job sequencer and DataStage Director.
- Extensively implemented import/export utilities for migrating code.
- Replaced transformer stages with other stages to improve performance of job.
- Attended daily meetings to review the status of the schedule and go through pending issues.
- Coordinated with Release manager and DA to migrate the components from one environment to another environment. Integrated with other Projects, for sharing the table structures and data.
- Involved in performance tuning by rewriting the queries and modifying existing Datastage jobs.
- Involved in production support for production cycle runs and ETL related issues.
- Communicated data availability with users and management.
- Documented the purpose of mapping so as to facilitate the personnel to understand the process and incorporate the changes as and when necessary.
- Also involved in ETL test plans, test scripts and validation based on design specifications for unit testing and functional testing.
Environment:IBM Websphere Datastage 9.1/8.1, Oracle 10g,Netezza, DB2, SQL, PL/SQL, UNIX Shell Scripting, Datastage Version Control, MS SQL server, Control M 7.5, RTC.
Confidential, Bloomington, IL
DataStage Developer
Responsibilities:
- Understanding the requirements and preparing Low Level Design documents and there by developing parallel and sequence jobs.
- Developed Shared containers and Server Routines which are used across the project in most of the interfaces.
- Worked in Data Migration project.
- Involved in Each Phase of project - End to End module.
- Written complex queries to facilitate the supply of data to other teams.
- Responsible for using different types of Stages such as Sequential File, Sort Aggregator, Transformer and ODBC to develop different jobs.
- Designed jobs using different parallel job stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup File Set, Change Data Capture, Modify, and Aggregator.
- Used DataStage Director for Schedule jobs in production for some of the projects.
- Prepared Unit Test Cases and executing them.
- Provide support to Testing Team and fix defects raised in different phases of testing.
- Developed DataStage Parallel and Sequence Jobs.
- Developed UNIX shell Scripts used to validate the files.
- Understand the existing PL/SQL procedures to extract data loaded by People Soft.
- Created Error Files and Log Tables containing data with discrepancies to analyze and re-process the data.
- Tuned DataStage transformations and jobs to enhance their performance.
- Used Control-M for Scheduling jobs and monitor the same.
Environment: IBM InfoSphere DataStage 8.1v, UNIX shell Script, ORACLE 10g, ORACLE 11g, SQL Developer Client for Oracle 10g, Office, Visio.
Confidential
Programmer
Responsibilities:
- Studying the business requirement, preparing the impact analysis document.
- Prepared technical specification document, upon review of the solution developed the solution using Datastage jobs and sequencers.
- Used sequential file stage as the source for most of the source systems.
- Used aggregator, look up, join, merge, dataset, transformer, sequencer, sequential file DB2 bulk load, hashed file stage, surrogate key generator.
- Created DDL statements for new tables, changes to table structure, index changes, and creation of triggers and stored procedures.
- Prepared unit test cases and test plans.
- Executed the test cases, captured the results.
- Supported the system post production and worked in co-ordination with the production support teams to resolve any issues.
Environment: DataStage 8.1 (Designer, Director, Manager, Administrator) Enterprise Edition, SQL Server 2005, IBM DB2, MS Visio 2000.
