Sr. Data Stage Developer Resume Profile
Slc, UT
Professional Summary
- Looking for an IBM ETL DataStage Developer position in an organization which gives me an opportunity to utilize my technical and analytical skills to build solutions and deliver expectations thereby can put forth my effective contribution to the organization's growth.
- IBM Data Stage: 7 Years of strong Data Warehousing experience using IBM WebSphere Datastage 8.7/8.5/8.1/7.X Designer, Director, Administrator and Manager , Quality Stage Integrity , ETL, OLAP, OLTP, Oracle 11g/10g/9i/8i/7.x etc.
- End to end data warehousing experience in the areas of ETL design and development. Involved in complete Software Development life-cycle SDLC of various projects, including requirement gathering, system designing, data modeling, application development, enhancement development, maintenance and support.
- Extensively used DataStage Client components like DataStage Designer and Director, Administrator and Manager in Data Warehouse ETL development.
- Strong understanding of the principles of DW using fact tables, dimension tables and Star and snowflake schema modeling.
- Experienced in scheduling sequence, parallel and server jobs using Data Stage Director, UNIX scripts and scheduling tools.
- Experience with Star and Snowflake Schema, Data Modeling, Fact and Dimensional Tables and Slowly Changing Dimensions. Strong in Data warehousing concepts, dimensional Star Schema and Snowflakes Schema methodologies.
- Strong SQL and Oracle database knowledge.
- Created Functional, Technical, and Mapping specifications and documentation.
- Developed parallel jobs using different processing stages like Transformer, Aggregator, Lookup, Join, Sort, Copy, Merge, Funnel, CDC, Change Apply and Filter.
- Extensively involved in the development of DataStage ETL process for extracting data from different data sources, data transformation and loading the data into Data Warehouse.
- Extensively worked on CDC and Slowly Changing Dimensions techniques to maintain the historical details of the data.
- Expertise in using PL/SQL to write stored procedures, functions, and triggers.
- Experience in new enhancements in the IBM WebSphere DataStage Multiple Job Compile, Surrogate key generator Stage, Job Report, Message handler options.
- Excellent communication, interpersonal, analytical skills and strong ability to perform as part of a team.
Technical Skills
ETL Tools | IBM Infosphere DataStage 8.7/8/5, IBM Websphere DataStage 8.0.1 Designer, Director, Administrator , Ascential DataStage 7.5.2 Designer, Director, Administrator, Manager , Ascential DataStage 7.0/6.0. |
Data Modeling | MS Visio Diagram, IBM Rational Rose, ERwin R8.1. |
Databases | SQL Server 2003/2005/2008,IBM DB2/UDB, Teradata, Oracle 10g/9i/8i,Green Plum 1.10 |
Tools | SQL Server Management Studio, Win SQL, IBM DB2 Control Center, SQL Loader, TOAD. |
Operating system | IBM AIX 5.2/4.x, Linux, Windows 2000/2003/XP/2007. |
Languages | SQL, PL/SQL, Unix Shell Scripting, Java, HTML, XML. |
Work Summary
Confidential
Sr. Data Stage Developer
Responsibilities:
- Involved in design and development of Server Jobs using Data Stage 8.5.
- Involved with Business Analysts to understand the Business Requirement Specifications and implemented the ETL jobs in Data Stage.
- Designed Developed jobs using Data Stage Designer to extract data from different resources and involved in cleansing data.
- Sourced data from Mainframe Flat files, Unix Flat Files, Oracle system to Enterprise Data Warehouse EDW .
- Involved in developing Shell scripts for loading Format Files in to Green plum using SQL loader and Created control cards for this process.
- Developed user defined Routines and Transformations by using Universe Basic.
- Used Visual Sync Sort to sort, merge and join data.
- Developed various subroutines which implements different business logic.
- Used Data Stage Manager for importing metadata into repository and also used for Importing and exporting jobs into different projects.
- Provided On call support to the Production Application System.
- Used Control-M for scheduling and running the jobs.
- Used ATTASK as a defect tracking tool.
Environment
Data Stage 8.5, Green Plum 1.10, UNIX, SQL Loader, Control-M 6.4 , TOAD 9.5, ATTASK and Windows XP Prof.
Confidential
Sr. DataStage Developer
Responsibilities:
- Gathered all the information from existing ETL team and source providers.
- Participated in business meetings and understood the current job flow and their dependencies
- Used DataStage director to run the jobs manually.
- Worked closely with the Source system owners in getting the source files, and discussed the data related issues.
- Extensively used IBM Info sphere DataStage Designer and Director for creating and implementing jobs. Designed complex Data Stage mappings Parallel Extender and Server between sources external files and databases to the target-using Oracle as the target database.
- Used the DataStage Director and its run-time engine to schedule the jobs, testing and debugging its components, and monitoring the resulting executable versions.
- Created Parameter sets and parameters for migrated jobs.
- Used DataStage to transform the data to multiple stages, and prepared documentation.
- Developed various jobs using stages using Sequential file, XML.
- Modified old jobs which had hashed files, replaced them with datasets to improve performance.
- Worked with multiple sources which included Ingres, Oracle, Flat files, Teradata, Sybase.
- Extensively wrote Routines.
- Created and Monitored sequences using DataStage Sequencer.
- Changed slow performing jobs to high efficient jobs by analyzing and making necessary manipulations.
- Used sequential files, Flat files, oracle database, mainframe files as source and oracle 9i as the target.
- Extensively worked with Parallel Extender for parallel processing to improve job performance while working with bulk data sources.
- Developed jobs in Parallel Extender using different stages like Transformer, Aggregation, dataset, Filter, Lookup, Surrogate key, Sort, Remove Duplicates stages etc.,
- Involved in importing and exporting jobs category wise and maintaining the backup regularly.
- Performed the Unit testing for jobs developed to ensure that it meets the requirements.
- Developed UNIX shell scripts to automate file manipulation and data loading procedures.
- Extracted data from various sources like Teradata, Flat Files, XML files, Oracle and loaded into a Corporate Data warehouse
- Performed ETL coding using Hash file, Sequential file, Transformer, Sort, Merge, Aggregator stages compiled, debugged and tested. Extensively used stages available to redesign DataStage jobs for performing the required integration.
Environment: IBM Info Sphere Data Stage 8.7, UNIX, Erwin, DB2 UDB, Oracle 11g, Teradata, , SQL Server, SQL, PL/SQL, Shell Scripts, UNIX, Windows NT, Message Queues, Toad, Tidal Scheduling Tool, Quality Stage jobs, Flat files, Shell Scripting.
Confidential
ETL DataStage Developer
Responsibilities:
- Involved in extracting the data from different data sources like Oracle 8i and flat files.
- Involved in extracting the data from staging to Relational.
- Involved in creating and maintaining Sequencer and Batch jobs.
- For Parallel jobs, configured the multiple nodes and used parallel engine capacity efficiently as well as designed a master sequence to run multiple jobs in parallel.
- Developed Sequences to run Dimensions and Facts and also developed a Master Sequence to run the entire project. Designed and developed of Data stage Server and Parallel jobs.
- Imported Oracle schema in to data stage with Manager for data mappings.
- Installed Data Stage clients /Servers and maintained metadata in repositories.
- Used Shared containers for multiple jobs, which have same business logic.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements
- Tuned DataStage jobs for better performance by creating DataStage Hash files for staging data and lookups. Used DataStage Director for running Jobs.
- Used Manager to import, export jobs / routines.
- Used the Slowly Changing Dimension Stage itself to implement SCD Type-1 2.
- Error handling was done by loading the reject data into the metadata and error tables.
- Resolved the error tickets by revisiting the jobs and
- Used XML Parser to parse the data
- Designed and developed DataStage routines to populate the meta data tables
Environment: IBM InfoSphere DataStage 8.5, Oracle10i, Oracle, Teradata, Flat files, UNIX scripting, MS Visio, IBM Info Sphere Information Analyzer IBM AIX UNIX Shell, MS Office
Confidential
ETL DataStage Developer
Responsibilities:
- Extensively worked with Datastage Designer for developing various server jobs and parallel jobs using Sequential file, Teradata Connector, MQ Connector, XML Parser and Transformer stages.
- Developed BTEQ Scripts to process the data from staging to history database and from history to simulation database.
- Monitored the jobs in production for any possible errors.
- Assisted Datastage Admin to create environment variables and projects using Datastage Administrator.
- Used stage variables for source validations, to capture rejects and used Job Parameters for Automation of jobs.
- Loading the data into the Staging and moving the data from Staging to ODS.
- Written SQL queries to extract data from different tables and those queries used in Teradata stages.
- Using Teradata MultiLoad stage created log and error tables to rectify the issue during the data load.
- Following up deployment process of DataStage code migration on different environments development, test and production with admin team.
- Loading Data in MS SQL database deemed as Staging area.
- Defining process flow using Data Stage job sequences.
- Involved in testing of peers jobs and signed off.
- Improved performance of poor performing data stage jobs and database ETL queries.
- Developed shared container jobs and template data stage jobs.
- Done Migrating and Troubleshooting.
- Designed and developed jobs using Parallel Extender.
- Developed processes for extracting, cleansing, transforming, integrating and loading data into Oracle database using Datastage Designer.
- Developed various jobs using Oracle Enterprise, Transformer, Dataset, File set, Aggregator, Sequential file,
- Developed DataStage jobs using Lookup stage for Range Lookup
Environment: IBM WebSphere, DataStage 8.1, Quality Stage, Oracle 10g, Teradata V2R6, SQL, C ,XML, AIX, Erwin 6.1.0, UNIX scripting, DB2 DB, Win 2000/NT and UNIX.
Confidential
Software Developer
Responsibilities:
- Extensively used Oracle Loader and PL/SQL for ETL.
- Involved in Preparing Technical Design Documents for various interfaces between several applications that have been designed in the project.
- Identified business rules for data migration and perform data administration through data models.
- Performance tuning of SQL queries consisting of many tables with large amount of data.
- Created Packages, Procedures and Functions that extensively used PL/SQL cursors, user defined object types and exception handling.
- Enhancements and Functional Specifications.
- Optimized Query Performance, Session Performance and Reliability.
- Extensive query optimization and performance tuning.
- Verification of functional specifications and review of deliverables.
- Complex SQL queries are used for data retrieval.
Environment: Oracle, SQL, PL/SQL, Windows 95, UNIX, DB2, and SQL Plus