We provide IT Staff Augmentation Services!

Sr. Data Stage Developer Resume

5.00/5 (Submit Your Rating)

Philadelphia, PA

SUMMARY

  • Over Seven years of IT experience with special emphasis on development, analysis and design of ETL methodologies using DataStage in all the phases of the Data Warehousing life cycle with knowledge in Data Modeling, ETL design and development, Data Warehousing, and OLAP technology.
  • Over Six Years experience using Data Stage 8.1/7.x/6.0 (Data stage Manager, Data stage Designer, Data stage Administrator and Data stage Director) and developing Data stage Parallel jobs
  • Extensive experience using DataStage stages such as Lookup, Join, Merge, Funnel, Remove duplicates, Aggregator, DB2 Enterprise, Oracle Enterprise, Sequential file, Dataset, File Set.
  • Extensive experience with data warehousing and business intelligence applications with participation in entire life cycle of projects.
  • Extensive knowledge in Pipeline/Partition concepts and techniques - Round Robin, Entire, Hash by Field, Modulus and Range.
  • Experience with ETL design and development of DataMarts /Enterprise wide Data Warehouses / Operational Data Stores.
  • Experience in creation of Star and Snowflake dimensional data marts using Microsoft Visio and ERWin.
  • Used job Sequencer to specify the network/sequence of jobs to run.
  • Extensive knowledge and experience in various parallel stages (Sort, Merge, Aggregator, and Transformer, Funnel, Filter, Look-up, Surrogate Key, Remove Duplicate, Transformer, Column/Row Generator and Peek) and Mainframe stages (Aggregator, Join, Look-up, Fixed Width Flat File).
  • Excellent skills in the development of Extraction, Transformation and Loading (ETL) solutions to meet the business needs of our clients and in providing technical leadership to outsourcing team members.
  • Excellent technical and analytical skills with clear understanding of design goals of ER modeling for OLTP and Dimension Modeling for OLAP
  • Proven track record in troubleshooting of DataStage jobs and addressing production issues like Performance Tuning and enhancement.
  • Responsible for interacting with business partners to identify information needs and business requirements for ETL jobs.
  • Worked with varied Stages like Lookup, Join Merge, Sort, Copy, Filter, Transformer, Aggregator and Funnel Stage.
  • Extensive knowledge in handling Slowly Changing Dimensions (SCD).
  • Experienced in writing complex SQL scripts, Stored Procedures, Views and Triggers using, PL/SQL.
  • Involved in writing UNIX Shell Scripts and experience in executing scripts from DataStage.
  • Execution of test plans for loading the data successfully into the targets.
  • Excellent communication, analytical, interpersonal skills and coordinated with other teams with immense leadership potentiality
  • Self-motivated, customer-focused, teamwork oriented and strategically focused experienced professional with strong analytical, pattern detection and problem solving abilities.

TECHNICAL SKILLS

ETL Tools: IBM WebSphere DataStage 8.1/7.5. (Administrator, Designer, Director,Manager, Parallel Extender).

Databases: Oracle 10g/9i/8i/8/7.x, MS Access

Modeling Tools: Erwin 4.5/4.0/3.5/3.0 , Physical and Logical Data Modeling, Dimensional Data Modeling

Programming: C, C++, SQL, PL/SQL, HTML, Visual Basic, .Net (C#, ASP.Net), Unix Shell Scripting

Database Tools: SQL Loader, SQL Plus, TOAD

Operation Systems: Windows NT/95/98/2000/XP/Vista/7.0, MS DOS,UNIX, Solaris, Unix-AIX 5.3, HP-UX

PROFESSIONAL EXPERIENCE

Confidential, Philadelphia, PA

Sr. Data Stage Developer

Responsibilities:

  • Created High Level specification of DataStage Jobs according to the business need.
  • Used the Data stage Designer to design jobs for extracting, cleansing, transforming, integrating, and loading data into data warehouse database
  • Reviewed the project scope, requirements, architecture diagram, proof of concept (POC) design and development guide lines
  • Interacted with business analysts and data modelers for better understanding of business requirements.
  • Reviewed the technical design documents (TDD) and created source to target mappings as per requirements.
  • Used Sequential files from the mainframe system as the sources for the data fields and developed the target Oracle DB files as per requirements.
  • Used Lookup to get the code values and Join to combine large data streams
  • Used Parameter set to bundle common parameters applicable for many jobs to implement reusability
  • Extensively used Oracle Enterprise stage for reading and loading tables
  • Created job sequence to batch DS jobs also Created Shared Containers to increase Object Code Reusability and to increase throughput of the system.
  • Created Unit test cases and performed unit testing
  • Performance testing of DataStage jobs with large data volume
  • Enhanced the Job Performance by using proper Partitioning methods and analyzing the resources utilized using Job Monitor.
  • Scheduled the DataStage ETL jobs via the Autosys on a daily, weekly and monthly basis.
  • Involved in Performance Tuning and troubleshooting of ETL programs, tuned DataStage and Stored procedures Code.
  • Worked with SCD stage for implementing slowly changing dimensions.
  • Designed several parallel jobs using Sequential File, Dataset, Join, Merge, Lookup, Change Apply, Change Data Capture(CDC), Remove duplicates, Funnel, Filter, Copy, Column Generator, Peek, Modify, Oracle Enterprise, Surrogate Key, Aggregator, Transformer Stages.
  • Developed SQL queries for development and testing
  • Involved in weekly Code Review meetings to ensure the code deliverables meet the standards.

Environment: IBM InfoSphere Data Stage 8.0.1, 8.1.2, Oracle 10g/11g, PL/SQL developer, DB2 /UDB Version 9.5, Windows XP, Unix- Solaris, Autosys, Visio.

Confidential, Dearborn, MI

DataStage Developer

Responsibilities:

  • Provided High Level Design, Detail Level Design Document.
  • Extensively used the DataStage designer to develop various parallel jobs to extract, transform, integrate and load the data into Enterprise Data warehouse (EDW).
  • Involved in preparing the mapping document from source to target .
  • Designed target tables as per the requirements from the reporting team, and also designed Extraction, Transformation and Loading (ETL) using Data stage.
  • Designed and developed the ETL jobs using Parallel Extender which distributed the incoming data concurrently across all the processors, to achieve the best performance.
  • Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, Sort, Surrogate key Generator, Change Data Capture, Modify, Row Generator and Aggregator.
  • Created Master controlling sequencer jobs using Data Stage Job Sequencer.
  • Used DataStage Director to monitoring jobs, run and validating its components.
  • Imported existing technical documented done with excel document converted to CSV.
  • Documented the jobs used in ETL processes with proper specifications.
  • Migrated projects from development to QA to Production environments
  • Performed the Integration and System testing on the ETL application.
  • Involved in writing, testing and implementation of the triggers, procedures, functions at Database level using PL/SQL.
  • Taking the regular backups of the jobs using DataStage Manager Export/Import utility.
  • Working with BI team to apply the business rules for OLAP,designing the Frame Work models.
  • Scheduled jobs using Autosys, based on the requirements and monitored the production closely for any possible errors.
  • Experience configuring, integrating and implementing DataStage version 8

Environment: IBM InfoSphere DataStage 8.0.1 (PX ), CSV files, UNIX- AIX, flat files, Oracle 10g, Autosys, PL/SQL developer, EXCEL, Windows NT.

Confidential, Miami, Florida

DataStage Developer

Responsibilities:

  • Interacted with end users in finalizing the requirements and documented the Program Specifications for the ETL jobs
  • Designed evolving strategies and developed Architecture for building functional OLTP systems from the OLAP systems.
  • Prepared Data Mapping Documents and Design the ETL jobs based on the Data Modeling Design with required Tables in the Dev Environment.
  • Provide the staging solutions for Data Validation and Cleansing data using DataStage ETL jobs.
  • Developed Data Stage Parallel Jobs using required stages, data from different sources formatted, Cleansing, summarized, aggregated and transform into data warehouse.
  • Designed several parallel jobs using Sequential File, Dataset, Join, Merge, Lookup, Change Apply, Change data Capture(CDC), Remove duplicates, Funnel, Filter, Copy, Column Generator, Peek, Modify, Compare, Oracle Enterprise, Surrogate Key, Aggregator, Transformer, Decode, Row Generator stages.
  • Analyzed and enhanced the performance of the jobs using standard techniques.
  • Interacted with architects and subject-matter experts to design comprehensive solutions.
  • Created Master Job Sequencers to control sequence of Jobs using job controls.
  • Extensively worked with Job sequences using Job Activity, Email Notification, Wait for File activities to control and execute the DataStage Parallel jobs.
  • Involved in implementing materialized views, Analyzed Query Plans, Partitioning and Indexing to increase the speed of queries.
  • Created PL/SQL Procedures, Functions and triggers on Database tables before loading to check some validations.
  • Used Teradata Bulk Load stages to Load the data into Teradata Database.
  • Extensively developed DataStage server routines using DataStage Basic Language as part of the development process.
  • Automated the scheduled Jobs using Autosys Scheduling tool.

Environment: DataStage 7.5.1 PX, Windows XP, TOAD, UNIX-AIX, Oracle 9i, SQL, PL/SQL, UNIX Shell Scripting

Confidential, Beaverton, OR

DataStage Developer

Responsibilities:

  • Interacted with business users in gathering the business requirements, identifying the relationship within and between the groups of data.
  • Created the Functional/Technical specification documents by maintaining standards of the enterprise
  • Designed the technical document for various jobs, unit test documents with various scenarios and acceptance level of test case results.
  • Actively participated in discussions and implementation of Error Handling and Reject management, Audit management process.
  • Designed and developed parallel jobs for extracting, cleansing, transforming and loading the data from the database and load into the ODS and GL
  • Used stored procedure stage in parallel jobs .
  • Worked Extensively on different stages like Aggregator, Merge, Join, Copy, Modify, Lookup, Lookup Fileset, Filter, Oracle Enterprise, Column Generator, Row generator stages for Data cleansing and Data Transformation.
  • Worked with disparate Sources such as Oracle, DB2 UDB and Flat files from Mainframe System.
  • Used Autosys to schedule the jobs. Wrote shell scripts to schedule the job.
  • Used DataStage Manager for importing & creating metadata definitions from repository, view and edit the contents of the repository.
  • Extensively worked in the performance tuning of the program, ETL Procedures and processes, tuning the SQL used in Transformations and fine-tuning the database.

Environment: Data Stage 7.5, WinCVS, Erwin4, Oracle 8i/9i, DB2 UDB 7.2, TOAD 7.4, PL/SQL, C++, Windows NT server, AIX Unix 5.2.

Confidential, Philadelphia, PA

DataStage Developer

Responsibilities:

  • Designed DataStage ETL jobs for extracting data from heterogeneous source systems, transform and finally load into the Data Marts.
  • Developed Parallel jobs using stages ODBC Enterprise, Oracle, join, modify, Aggregator, Transformer and lookup etc.
  • Designed ETL mappings for Change Data Capture CDC .
  • Defined the data definitions and created the target tables in the database.
  • Wrote Shell scripts to schedule batch jobs to obtain data overnight from various locations, through Scheduling tool called Control-M.
  • Involved in development of UNIX shell scripts for Batch jobs etc run.
  • Prepared test docs which involved preparation of test data, test case and unit testing of the jobs.
  • Collected and reviewed the available application-related information.
  • Performed comparison between the available documentation and the documentation requirements based on documentation category for this application. Defined the work that is required.
  • Experience on Performance Tuning.
  • Participated in the meeting with the Business Users and Support Analyst for getting the more information and understanding of the Applications.
  • Demonstrated the design and document conversion and system interface specifications.
  • Installed the DataStage, and DB2 to see the ongoingapplication maintenance. Involved in scheduling jobs using Autosys and DataStage Director.
  • Written Stored Procedures, Triggers, and Contexts and assisted in Security Management for fine user maintenance.
  • Created PL/SQL and object Libraries that can be used by most forms in the application.
  • Involved in Unit Testing, System Testing, Integration and Performance Testing of the jobs.
  • Provided production support.

Environment: DataStage 7.5(designer, Director, Manager, Administrator), Oracle 9i /8i, DB2, SQL server, PL/SQL, Erwin, Windows XP Professional,Control M, XML files.

Confidential

Programmer/Analyst

Responsibilities:

  • Involved in writingSQL Stored proceduresto access data fromOracle.
  • DevelopingSQL queriesto check the database
  • CreatingTriggers,Stored Procedures,Tables,Indexes, Rules, Defaults
  • Interactionwithusersand getting the enhancement requirements
  • Performance tuningofSQL queriesandStored Procedures
  • Involved in conducting theblack box testingof the application
  • PerformingManual testingof the application
  • Involved in conducting theFunctional, RegressionandIntegration testing
  • Involved instressandvolume testingof the application

Environment: Oracle 8i SQL, PL/SQL, MS SQL Server, Windows NT

We'd love your feedback!