Data Stage Developer Resume
Providence, RI
SUMMARY
- Over 8 years of IT Experience with Extensive experience in Data Warehousing with expertise on Extraction, Transformation and Loading of ETL design and development.
- Proficient in all stages of Software Development life cycle( SDLC )including System Analysis, Design, Development, Production Support, Implementation and Maintenance.
- Excellent written and communication skills and ability to work independently in a time sensitive environment.
- Extensive experience in using the Data - Warehousing tool, Extensive experience with Data Stage parallel extender.
- Experience in Design, Development and Implementation of Relational Database and Data Warehousing Systems using IBM Info sphere/Web sphere Data stage
- Expert in requirement gathering, Data-Warehousing/ETL programming, and analysis Data cleansing using Quality Stage.
- Having knowledge in all phases in Software Development Life Cycle (SDLC).
- Designed and developed parallel jobs with multi node configuration files, server and sequence jobs using Data stage Designer.
- Knowledge in Relational Database Management Systems, knowledge in using PL/SQL to write stored procedures, functions, and triggers.
- Having Experience in using data stage designer for exporting and importing jobs and in data stage director to run, and monitor the data stage jobs.
- Proven track record in addressing production issues like performance tuning, enhancement, data environment and memory issues.
- Experience in integration of various data sources like DB2, Oracle into staging area.
- Strong knowledge in OLTP/OLAP systems, normalized (OLTP), de-normalized (DW and ODS) models, dimensional strategies, surrogate key, star schema, snowflake schema.
- Experience in using different types of stages like Transformer, Aggregator, Merge, Remove duplicate, Local Containers, shared containers for developing jobs.
- Used Job Activity, Wait for file Activity, Execute Command, Notification, Terminator, Sequencer Activities While Implementing Job Sequence.
- Knowledge in using Erwin as leading Data modeling tool for logical (LDM) and physical data model (PDM).
- Used Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad hoc or scheduled basis).
- Good working knowledge in UNIX environment, HTML and Agile methodology.
- Creating data mappings and data dictionaries and understanding business data relationships.
- Implemented the complex business rules by creating reusable transformations and Mappings/Mapplets.
- Strong analytical and technical exposure working effectively as a team member.
- Extensively used BI Integration Services to design ETL process and BI Analysis Services to create cubes.
- Quick learner and adaptive in new and challenging technological environments
TECHNICAL SKILLS
ETL TOOLS: IBM Info sphere Data Stage 8.7/8.5, IBM Web sphere Data Stage 8.0.1(Designer, Director, Administrator), Ascential Data Stage 7.5.2 (designer, Director, Manager, Administrator)
Operating System: IBM AIX, UNIX, WINDOWS 2000/XP, 7, LINUX
Database: Oracle 11g/10g, 9i, DB2
Data Modeling: Star Schema Modeling, Snow-Flake Modeling, Facts and Dimensions, Physical and logical data modeling using Erwin
Database tools: SQL PLUS, TOAD
Languages: SQL, PL\SQL, Unix Shell scripting
PROFESSIONAL EXPERIENCE
Confidential, Providence, RI
Data Stage Developer
Responsibilities:
- Used Data Stage Designer to develop various jobs to extract, transform, integrate and load data into data warehouse database.
- Understanding the Technical specification and Mapping techs provided by the Client.
- Closely working with the business analyst to understand the specifications.
- Provided Support during the implementation of the project.
- Experienced in running jobs using Job Sequences, Job Batches.
- Extensively worked on Job Sequences to Control the Execution of the job flow using various Activities & Triggers (Conditional and Unconditional) like Job Activity, Wait for file, Email Notification, Sequencer, Exception handler activity and Execute Command.
- Developed several parallel jobs using various stages like change capture, Aggregator, Sort, Look up and Transformer for grouping and summarizing on key performance indicators used in decision support system.
- Developed jobs for incremental loading.
- Used Data Stage Administrator for setting-up properties, permissions, environment variables.
- Used the Data Stage Administrator to assign privileges to users or user groups (to control which Data Stage client application or jobs they see or run), move, rename or delete projects.
- Extracted data from sources such as oracle, Flat files to transform and loaded into target Databases.
- Responsible for requirements gathering, source-to-target mapping, process flow diagrams, and documentation for Data stage project.
- Worked on Information analyzer to profile the source data to identify the uniqueness, duplicates, primary keys etc.
- Designing the jobs and building the sequence jobs to schedule the daily loads.
- Exporting and importing the jobs from Development to production environment.
- Worked with Data stage Designer to import, Export Meta data, jobs, Routines from Repository.
- Worked on building UNIX shell scripts to handle and validate the inbound files.
- Provided Support during the implementation of the project
- Using the Execute command stage to back up the files once processed.
- Also worked on Developing Data stage server jobs. Used Data Stage manager to export the jobs.
- Used the Director to schedule running the job, testing and debugging its components, and monitoring.
Environment: IBM Info sphere Data Stage 8.7 (Designer, Director), Oracle 10g, SQL/PLSQL, DB2 UDB, Erwin 4.0 and UNIX, AIX 5.1
Confidential, Bentonville, AR
Data Stage Developer
Responsibilities:
- Designed and developed data stage jobs for extracting data transform and load into Data ware house (DWH).
- Created generation of Data Definition Language (DDL) Statements which are executed for database creation.
- Worked on designing and developing the Quality stage.
- Used multiple connection managers for source and destinations.
- Involved in development of various jobs using Sequential file, Oracle Enterprise, Look up, Merge, Funnel, Copy, Transformer, Filter stage for designing the jobs in the Data stage designer.
- Experience with design and development of Graphical reports using Jasper reports.
- Worked on SQl stored procedure for Jasper reports.
- Responsible for designing and maintaining ETL jobs that include extracting data from sequential files transforming the data according to business requirements and then loading data into Netezza data base.
- Deployed different partitioning methods like Hash, Round Robin, Entire, Module and Range for bulk data loading.
- Worked on retrieving data from different legacy systems such as Oracle, DB2.
- Involved in Performance Tuning of Parallel Jobs using Performance Statistics.
- Designed, Executed, Tested and validated the migration process.
- Implemented the business rules specified for Data extraction, Transformation and Load for various systems.
- Extensively worked on Data Stage jobs for splitting bulk data into subsets and to dynamically distribute to all available processors to achieve best job performance.
- Enhanced the reusability of the jobs by making and deploying shared containers and multiple instances of the jobs.
- Worked on troubleshooting, performance tuning and performances monitoring for enhancement of Data Stage jobs and builds across Development, QA and Production environments.
- Developed several transformations in the process of building Data ware house database.
- Interacted with User Groups/ Corporate Testing Groups/Business people.
- Actively participated in the Team meetings to gather the business requirements and developing the Specifications & Unit Test Cases.
Environment: IBM Info sphere Data Stage 8.1, Oracle 11g, UNIX, Oracle, DB2, Flat files, XML files, Autosys, V2R6, TOAD 9.6, ABAP Easy Access, and MS Excel.
Confidential, Hopewell, New Jersey
Data Stage Developer
Responsibilities:
- Understanding the technical specifications and develop jobs for Extraction, Transformation, Cleansing and Loading process of Data Ware house.
- Extracted data from various sources like Flat Files, SQL server and loaded into Corporate Data Warehouse.
- Converted complex job design to different job segments and executed through job sequencer for better performance and easy maintenance.
- Developed Data Stage parallel jobs to extract data from flat files, mainframe files, and XML files to load into landing tables.
- Used type II Slowly changing dimension table from several operational source files.
- Captured data from a variety of sources including Oracle, Flat Files, and XML.
- Design of Complex Data stage Jobs to cater business requirements.
- Involved in Re-designing the load flow by eliminating the intermediate steps and Optimizations in order to get significant ETL conversion performance gains.
- Extensively worked with Data stage Shared Containers for Re-using the Business Functionality.
- Enhanced the Job Performance by using proper Partitioning methods and analyzing the resources utilized using Job Monitor.
- Generated Surrogate ID’s for the dimensions in the fact table for indexed, faster data access.
- Used Data stage Manager for exporting & importing metadata definitions, creating Meta data Definitions and view and edit the contents of the repository.
- Created Parameters and Parameter sets where necessary.
- Experience in running jobs using Job Sequencers, Job Batches.
- Involved in unit testing of Data stage jobs and prepare Test Results Document.
Environment: IBM info sphere Data Stage 8.5, Flat files, SQL, PL\SQL, DB2, IBM AIX 5.2, UNIX, Windows 7
Confidential, Saginaw, MI
Data Stage Developer
Responsibilities:
- Extracted data from sources like Oracle and Flat files.
- Experienced in using SQL * Loader and import utility in TOAD to populate tables in the data warehouse.
- Successfully Implemented pipeline and partitioning parallelism techniques and ensured load balancing of data.
- Involved in building the base fact tables, aggregate fact tables, dimension tables, Data mart tables, change requests and defect issues related to Data Warehouse project.
- Debug, test and fix the transformation logic applied in the parallel jobs.
- Handled Performance Tuning of Jobs to ensure faster Data loads.
- Designed sequence jobs using the activities such as Job Activity, Nested Condition, Notification Activity, Sequencer Activity, Terminator Activity and Execute Command.
- Created Batches (DS Job controls) and Sequences to control set of jobs.
- Worked with Data Stage Server stages like OCI, ODBC, Transformer, Hash file, Sequential file, Aggregator, Sort, Merge, link Partitioner, Link Collector, IPC and other Stages.
- Implemented and hardcoded High Performance Data Stage Routines.
- Loading Data in Oracle database deemed as Staging area.
- Worked Closely with Data modeler and Database Administrator to understand the business process and participated in gathering of business requirements to build the data warehouse model
- Part of design team for design of STAR schema for data warehouse project.
- Interacted with the End users / Customers for creating Mapping documents.
- Implemented Shared Containers to use in multiple jobs, which have same business logic.
Environment: IBM - Info Sphere Data stage 8.1 (Designer, Administrator, Director) DB2, Oracle 9i, UNIX, IBM (AIX), TOAD, PL/SQL, Windows XP, MS Word, Excel
Confidential
Data Stage Developer
Responsibilities:
- Translated business process into Data stage jobs for building data marts.
- Worked with different sources such as Oracle, SQL server and Excel, Flat files.
- Designed Data stage ETL jobs for extracting data from heterogeneous sources systems, transforming and finally loading into data marts.
- Involved in designing and development of data warehouse environment.
- Identified source systems, their connectivity, related tables and fields and ensured data consistency for mapping.
- Created source table definitions in the Data stage repository by studying the data sources.
- Created error files and log tables containing data with discrepancies to analyze and re-process the data.
- Created jobs schedules to automate the ETL process.
- Used the Data stage Administrator to assign privileges to user or user groups (to control which data stage client application or jobs they see or run) move, rename or delete projects.
- Prepare Unit test case document and perform Unit testing and integration testing.
Environment: Data stage 7.5.2/EE (Parallel Extender), DB2, Oracle 9i, UNIX, IBM (AIX), TOAD, and PL/SQL