Sr. Datastage Developer Resume
Marietta, GA
SUMMARY
- Datastage/ETL Developer wif over Seven years of work experience in Information Technology, wif expertise in and warehousing and business intelligence.
- Participated in all aspects of a systems development life cycle wifin teh development team (Analysis, Design, Development, Test, QAT, Implementation and Production Support).
- Extensively worked on designing and administrating Datastage jobs in V 9.x, 8.x, 7.x, worked in detail wif different stages in Datastage like Transformer, Lookup, Merge, Join, Funnel, Aggregator and successfully ran jobs from medium to high complexity levels.
- Worked wif Data modeler and Business analyst in gathering business requirements.
- Helped functional team in writing up of source to target mapping documents.
- Worked closely wif teh business systems analyst to develop teh tables. Used Erwin tool to convert from logical to physical data model.
- Knowledge in logical database designing (Schema building) and physical database designing (OFA standard) of Oracle databases.
- Familiar wif Enterprise wide Data warehouse Architecture & Expertise in Ralph KIMBALL methodology and good in warehousing concepts Star Schema, Snow Flake and identification of KPI, Dimensions and Facts
- Adept at running Datastage director, viewing job logs, finding errors and fixing them in given time.
- Worked on shell scripts in UNIX, executed them. Also worked wif scheduling tools like Tivoli scheduler, crontab utility.
- Has extracted data from various databases like SQL Server, Oracle, Teradata and DB2. Performed exporting and importing of jobs to and fro to various environments.
- Strong noledge on SQL, Stored Procedures, Functions, Triggers.
TECHNICAL SKILLS
ETL: IBM Information Server, Data Stage 9.x/8.x/7.5.2, Server Pack for SAP R/3, Server Pack for SAP BW
Operating Systems: IBM AIX, DG UNIX. Windows XP/Windows 7, Linux
Database: Oracle 10g/9i, Teradata, SQL Server 2005/2008, DB2
Database Tools: Toad 8.6.1
Scheduling Tools: Tivoli workload Scheduler 8.5.1, Corn tab utility, Autosys 11.3
Languages: Shell Scripts (Bourn), SQL, PL/SQL.XML, Java
Other Tools: Erwin 8.2, HPQC, Microsoft Visio 2007, Microsoft Office 2010
PROFESSIONAL EXPERIENCE
Confidential, Marietta, GA
Sr. Datastage developer
Responsibilities:
- Extensively involved in teh data migration team to build teh Re - usable Datastage job templates, common parameter sets, common Datastage job containers, SQL extract procedures and common re-usable shell scripts.
- Worked wif business analyst to identify, develop business requirements, transform it into technical requirements and responsible for deliverables.
- Provide teh staging solutions for Data validation and Cleansing wif PL/SQL and Datastage ETL jobs.
- Implemented Aggregate, Filter, Join, Lookup, Rank and Update Strategy transformations.
- Extensively worked wif DataStage 9.1 V - Designer and Director to load data from source extract files to warehouse.
- Worked wif SAP R/3 server pack to connect to SAP system and extract teh data using ABAP stages.
- Created Datastage jobs to load data from sequential files, CSV, Flat files, SQL Server and Oracle.
- Cleansed, Standardize data using Quality stage.
- Developed various jobs using ORA OCI, ODBC, Aggregator, Sequential file stages.
- Used Fast load, Multi load scripts to load data into Oracle from flat files and COBOL copybooks.
- Worked towards optimal performance when using Stages like LOOKUP, JOIN, and MERGE.
- Designed and developed DataStage jobs for Loading Staging Data from different sources like Oracle, SQL Server DB into Data Warehouse applying business rules which consists data loads, data cleansing, and data massaging.
- Used teh Datastage Director and its run-time engine to schedule running teh solution, testing and debugging its components, and monitoring teh resulting executable versions
- Created Shared Container to simplify teh Datastage Design, and used it as a common job component throughout teh project.
- Worked wif Metadata Definitions, Import and Export of Datastage jobs using Datastage tools functionality.
- Created Parameters and Parameter sets where necessary.
- Tuned DataStage jobs for better performance by creating DataStage Hash files for staging teh data and lookups.
- Scheduled teh server jobs using DataStage Director, which are controlled by DataStage engine and also for monitoring and performance statistics of each stage.
- Performed functional testing for new release enhancements.
- Participated actively in teh team meetings wif teh developers for bug reviews.
- Developed Shell Scripts to automate file manipulation and data loading procedures.
Environment: Information server - Datastage 9.1, SAP ECC, SQL Server, DB2, Oracle 10g, UNIX AIX and Windows 7.
Confidential, San Francisco, CA
Sr. Datastage Developer
Responsibilities:
- Extensively used IBM Info sphere Datastage Designer and Director for creating and implementing jobs. Designed complex Data Stage mappings (Parallel Extender and Server) between sources (external files and databases) to teh target-using Oracle as teh target database.
- Wrote scripts to invoke theDatastage jobs.
- Used teh Datastage Director and its run-time engine to schedule teh jobs, testing and debugging its components, and monitoring teh resulting executable versions (on an ad hoc or scheduled basis).
- Designed Proof of Concept (POC) for certain jobs which required heavy manipulations to be performed as part of fine tuning.
- Created Parameter sets and parameters for migrated jobs.
- Used Datastage to transform teh data to multiple stages, and prepared documentation.
- Developed various jobs using stages using OCI, Sequential file, XML.
- Modified old jobs which had hashed files, replaced them wif datasets to improve performance.
- Worked wif SAP R/3 server pack to connect to SAP system and extract teh data using ABAP stages. Worked on several integrations involving pulling teh data from teh SAP modules like MM, SD
- Worked wif multiple sources which Oracle, Flat files, DB2.
- Created containers to use in multiple jobs.
- Used debugger to test teh data flow and fix jobs.
- Defined data base triggers & PL/SQL stored procedures for business validations.
- Extensively wrote Routines.
- Created and Monitored sequences using Datastage Sequencer.
- Wrote Comparative statements.
- Tested if teh data is seen correct in teh User Interface (ICM).
- Changed slow performing jobs to high efficient jobs by analyzing and making necessary manipulations.
Environment: Information server -Datastage 8.5, SAP ECC, ESP Scheduler, AIX, Windows XP, Oracle 10g, DB2, WINSCP
Confidential, Hempstead, NY
Sr. ETL Developer
Responsibilities:
- Developed Datastage Parallel Jobs using required stages, and teh obtained data from different sources like flat files, source tables were formatted, Cleansed, summarized, aggregated, transformed and loaded into data warehouse.
- Involved in design and development of parallel jobs, sequences using teh Designer.
- Interacted wif Business Analysts to finalize teh requirements and documented teh technical design document for Coding.
- Designed several parallel jobs using Sequential File, Dataset, Join, Merge, Lookup, Change Apply, Change Capture, Remove duplicates, Funnel, Filter, Copy, Column Generator, Peek, Modify, Compare, Oracle Enterprise, Surrogate Key, Aggregator, Transformer, Row Generator stages.
- Extensively worked wif all teh new features in IBM information Server.
- Worked wif SCD stage for implementing slowly changing dimensions.
- Involved in teh installation of IBM Information Server.
- Encompasses Database designing, ETL phases of Data Warehousing. This is achieved wif an emphasis on relational data modeling and dimensional data modeling for OLTP and OLAP systems.
- Tuned DataStage jobs for better performance by creating Datastage Lookup files for staging teh data and lookups.
- Used teh Manager to import, export jobs and routines.
- Created Shared Containers to increase Object Code Reusability and to increase throughput of teh system.
- Experience developing complex transformations, surrogate keys, routines, dimension tables and fact tables.
- Used Environment Variables, Stage Variables and Routines for developing Parameter Driven Jobs and debugging them.
- Performed extraction, transformation and loading of data using different types of stages and by performing derivations over teh links connecting these stages.
- Enhanced teh Job Performance by using proper Partitioning methods and analyzing teh resources utilized using Job Monitor.
- Created Master Job Sequencers to control sequence of Jobs using job controls.
- Used Data Stage Director for running and monitoring performance statistics.
- Scheduled existing UNIX shell scripts using crontab.
- Modified UNIX shells according to teh latest business requirement.
Environment: IBM-InfoSphere Datastage 8.1, Erwin 4.2, Oracle 9i/10g, Quality Stage, Profile Stage,TOAD, UNIX- AIX, Windows XP, MS Word, Excel, Crontab, Clear Quest.
Confidential, VA
ETL/Datastage Developer
Responsibilities:
- Developed Datastage server jobs to extract, transform and load data into data Warehouse from various sources like relational databases (DB2), Oracle 9i, flat files etc.
- Worked wif Business Analysts to analyze teh business requirements and functional specifications.
- Involved in creating teh projects.
- Developed Parallel jobs using Stages such as Aggregator, Compare, Funnel, Join/Merge, Lookup, Sort, Filter and Transformer.
- Performed through data profiling by using teh Investigate stage of QualityStage and also by writing PL/SQL queries to identify and analyze data anomalies, patterns, inconsistencies etc.
- Used Datastage Manager for importing metadata from repository, new job categories and creating new data elements.
- Used Information Analyzer for column analysis, primary key analysis and foreign key analysis.
- Used teh Datastage Designer to develop processes for extracting, cleansing, transforms, integrating and loading data into data warehouse database.
- Teh job required implementation of various in-built procedures.
- Generations of Surrogate IDs for teh dimensions in teh fact table for indexed, faster data access.
- Implemented shared containers to use in multiple jobs, which has same business logic.
- Created job sequences to automate teh ETL process.
Environment: Datastage 7.5.2/EE (Parallel Extender), Quality Stage, DB2-UDB, Oracle9i, UNIX, IBM (AIX), Shell Scripting, TOAD, PL/SQL, SQL Server.
Confidential, Englewood Cliffs, NJ
Data stage Developer
Responsibilities:
- Work wif functional unit staff to write user cases and develop process flow and diagrams.
- Work wif functional unit staff to capture query requirements, design and implement business reports and data management interfaces.
- Developed Oracle PL/SQL, DDL's, and Stored Procedures. Performance and fine Tuning of SQL & PL/SQL stored procedures.
- Developed various Mappings wif teh collection and gathering of all teh Sources, Targets and Transformations.
- Created Datastage jobs using Designer and extract data from various sources, transformed teh data according to teh requirement and loaded into data warehouse.
- Used various stages such as transformer, ODBC, Link Partitioner, Aggregator, Merge, Join stages.
- Designed Datastage jobs wif environmental variables to process initial /daily batch data and prepare errors response files.
- Design specifications and develop automated data retrieval and extraction programs and data sets for data management and analysis systems.
- Review Designs and test data system enhancements (Write test specifications, perform system testing, document test results).
- Built mappings by using SQL Override, Connected/Unconnected Lookup, Lookup Override, Normalizer, Expression, Joiner, Router, Update Strategy, Stored Procedure transformation, Sequence Generator transformation, etc.
- Create ad hoc SQL queries to extract and develop reports for various levels of users/customers.
- Created Stored Procedures by using PL/SQL and call stored procedures from Datastage.
- Prepare feasibility studies, proposals, cost/benefit analysis documents and other documentation under teh direction of Project Manager.
- Utilize ASD-established Software development life cycle process and control procedures.
- Create and modify database entities (tables, views, stored procedures packages, database links and ODBC connections).
- Developed UNIX Shell scripts for running teh pre/post processes and PL/SQL procedures for performing different database tasks.
- Document entities, relationships, and expected access patterns.
Environment: Oracle 9i, PL/SQL, UNIX Shell Scripting, Windows NT 4.0/2000, SQL *Loader, UNIX, SQL *Plus SQL *Loader, TOAD 7.6, DataStage 7.0, Windows XP.
Confidential
ETL Developer
Responsibilities:
- Participated extensively in both Design team and Engineering Team.
- Handling Multi-tasks on a wide variety of functionality, issues, and projects.
- Prepared DMS (i.e., Functional specs), Test Cases and Unit test plans.
- Performing Data Quality on source systems.
- Loading Data in Oracle database deemed as Staging area.
- Defining process flow using Data Stage job sequences.
- End to End testing of ETL jobs.
- Improved performance of poor performing data stage jobs and database ETL queries.
- Developed shared container jobs and template data stage jobs.
- Done Migrating and Troubleshooting.
- Adherence to project standards and processes and provide valuable suggestions.
- Developed ETL jobs, Harmonization & survivorship rules applied in transformation jobs and Load jobs wif Data Stage, and Oracle for C&IC and CCA-PLAN tracks.
- Strictly following Information Server Best practice methods.
Environment: IBM- Web sphere Data Stage 7.5, Oracle 9i, SQL plus, Visio 2003