Senior Data Stage Developer Resume
Bellevue, WA
SUMMARY
- Over 8 years of experience in development and implementation of Relational Database (OLTP) and Data warehousing systems (OLAP) using Data stage, Teradata, ORACLE, DB2 and SQL server.
- Strong working experience on IBM Data Stage (8.5/8.1/7.5x2/7.5.1), SQL, PL/SQL, Stored Procedures and Triggers. Performed Debugging, Troubleshooting and performance Tuning.
- Proficient in Data analysis, Data modelling, Database design and Data migration.
- Collecting data from various source systems (Oracle, flat files, complex flat files, SQL SERVER, DB2 databases) and consolidating into one and kept in the staging area.
- Worked on operating systems like LINUX, UNIX, AIX and Windows.
- Designed and developed jobs using Parallel Extender for splitting bulk data into subsets and to dynamically distribute data to all available nodes to achieve best job performance.
- Worked on tools like Data Stage Designer, Data Stage Director, and Data Stage Manager.
- Worked extensively on different types of stages like ODBC, Sequential file, Aggregator, DB2UDB, Transformer, Merge, Join, Lookup, Change Capture, SCD, Sort, Pivot, Shared Containers for developing jobs.
- Experience in designing, compiling, testing, scheduling and running Data Stage jobs.
- Excellent knowledge on Dimensional Modelling, Star & Snowflake Schema, Slowly Changing Dimensions etc.
- Proficiency in data warehousing techniques for data cleansing, Slowly Changing Dimension, surrogate key assignment and change data capture
- Experience in usage of Information Analyser, Metadata workbench and Business Glossary using REST API.
- Experience in usage of Quality Stage for standardization and cleansing the data.
- Experience in designing Data Marts and Data Warehouse using Star Schema and Snowflake Schema, physical and logical Data modelling using Erwin in implementing Decision Support Systems.
- Efficient in various phases of the software development lifecycle.
- Efficient in coordination of overall development of solutions and 24/7 support.
- Exceptional verbal and written communication skills, excellent team player.
TECHNICAL SKILLS
ETL Tools: IBM Data Stage 9.1/8.5/8.1/7.5 x2/7.5.1 (Administrator, Manager, Designer, Director), Parallel Extender, Information Analyzer (IA), Metadata work Bench (MWB), Business Glossary, Metastage, Quality Stage, Profile Stage, Integrity, Data Stage Plug - In.
Databases: Oracle 8i/9i/10g, SQL Server 2000/2005/2008 , Teradata, DB2.
Data Modeling: Erwin 4.0/4.1/7.0
Programming Skills: UNIX Shell Scripting, K-Shell, C-Shell, SQL, PL/SQL
Operating Systems: LINUX, UNIX, AIX, Win 2000/2003/XP
PROFESSIONAL EXPERIENCE
Senior Data stage Developer
Confidential, Bellevue, WA
Responsibilities:
- Participated in gathering of business requirements and carry out a suitable data Model for DataMart and Data Warehouse.
- Used Parallel Extender for splitting and organizing the data into subsets and to achieve better job performance.
- Expensively involved in Extraction, Transformation and Loading (ETL) stages.
- Responsible for analysing and understanding Metadata and data.
- Responsible for setting-up IBM Data Stage DEV, TEST and UAT Environments.
- Designed and developed Data Stage Data flow integrating multiple sources.
- Drop index, Create Index to improve performance of Data Stage Jobs.
- Participated in discussions wif Project Manager, Team leader, Group Members and Technical Manager Regarding any Technical and/or Business Requirement issues.
- Writing documentation for detail transactions data for operational data store.
- Transformations including aggregation and summation construct from operational data source to Data warehouse.
- Created Database Views to use the code whenever it required.
- Extensively worked wif SQL Server Joins, Inner Join, Outer Join, Full Outer Join and Left Outer Join.
- Developed job sequencers and implemented restart ability using various checkpoints.
- Extensively worked on Data Stage Director, Designer and Data Stage Administrator.
- Used Data Stage Designer for developing various jobs to extract data from different sources and loading data into temp tables for validation testing and Production run.
- Developed PX jobs in using different stages likeChange Capture, SCD, Aggregator, Join, Merge, Lookup, Source Dataset, External Filter, Row generator, Column generator and Peak stages.
- Used Data Stage Director and the runtime engine to schedule running the server jobs, monitoring scheduling and validating its components.
- Worked exclusively on UNIX for developing start up scripts and audit scripts.
- Involved in Unit Testing, SIT and UAT Worked wif the users in data validations.
- Involved in the development of Common Error Management to capture and handle the error records.
- Preparing documentation for unit, regression, integration, and final end - to - end testing.
- Involved in the unit testing, regression testing, and integration testing for transition data.
Environment: IBM Data Stage 8.5 ETL tool, Information Analyzer (Profile Stage), ERwin 7.0, Linux, Oracle, 10g, Teradata and MS Windows 2003.
Senior Data stage Developer
Confidential, Plano TX
Responsibilities:
- Worked on customer individual, customer business under customer module, wires, ATM-AIH, ATM-Genled under transactions module,transtar, and ICMS modules.
- Extracted historical data using start loop, end loop logic in sequences. used exception handler and error handling routine(server routine) and terminate stages for job aborts used DB2 connector stage from reading data into data stage designer write db2 sql’s for extracting data fromViews used Info sphere information server manager 8.5 for creating packages, building packages and used Unix shell scripts for migrating and deploying the packages in QA, PROD environments create master job sequences for executing the data stage jobs write and execute Unix shell scripts for calling the master sequence data stage created parameter sets ps global, psd bank, psd common, psd subj, psd subjbank, psi src, psi tgt, psp debug, psp shell in data stage designer added parameter sets inside data stage sequences and data stage granular jobs so dat in runtime the parameters are read from value file which TEMPhas the values of all parameter sets design and develop the ACH,AFS,AP,ATM,CCD,MISL,POD,TELLER,WIRES modules data stage jobs in Landing zone project read from EBCDIC CFF (complex flat file) on Unix and write to a dataset on Unix read the datasets and load into db2 tables using db2 connector stage using bulk load append and message fileoptions used ODBC connector stage to read data from sql server tables for wires module and write to dataset load job for credit card CCD reads from these different datasets and writes into different segments of target table for credit card (as there are 3000 columns coming in from source and for ease of use and performance improvement, the target table is segmented into multiple segments and each target table is range partitioned on snapshot id so dat total of 8 partitions are maintained in table)
- Read from db2 source teller table using db2 connector stage and write to dataset in extract job
Environment: IBM Info sphere data stage 8.5,PLSQL Developer 9.0,UNIX, Oracle 10g
Data stage Developer
Confidential, St. Louis, MO
Responsibilities:
- Developed jobs between operational sources to Operational target tables.
- Data Warehouse is implemented using sequential files and db2, Oracle Tables.
- Developed DS Routines for checking transaction code types.
- Writing documentation for detail transactions data for operational data store.
- Transformations including aggregation and summation construct from operational data source to Data warehouse.
- Developed job sequencers and implemented restart ability using various checkpoints.
- Extensively worked on Data Stage Director, Data Stage Manager and Data Stage Administrator.
- Used Data Stage Designer for developing various jobs to extract data from different sources and loading data into temp tables for validation testing and Production run.
- Used Data Stage Director and the runtime engine to schedule running the server jobs, monitoring scheduling and validating its components.
- Used Data Stage Manager for managing Data Stage repository (view and edit), define custom routines & transforms.
- Involved in Unit Testing, SIT and UAT. Worked wif the users in data validations.
- Extensively worked in improving performance of the jobs by avoiding as many transforms as we can.
- Extensively worked on Data Stage Version control to do Change Control.
- Worked on datasets to source data.
- Involved in Designing and developing universes for generating reports from warehouse databases.
- Developed UNIX shell scripts to automate the Data Load processes through Autosys.
- Collecting the statistics for each load and implementing the exception handling as part of the load process.
Environment: Ascential Data Stage, Oracle 8.1.7, TOAD, SQL, PL/SQL, IBM AIX, and Windows 2000.
Sr Data stage Developer
Confidential
Responsibilities:
- Involved wif the end users / business analysts to collect the requirements of the project.
- Preparation of technical specification for the development of Extraction, Transformation and Loading (ETL) jobs to load data into various tables in Data Marts and defining ETL standards.
- Experienced wif Data Stage Parallel Extender for partitioning the data into subsets and load balancing across all available processors to achieve job performance.
- Extracted sources from oracle9i to transform and load into Teradata.
- Extensively used Data Set, File Set, CFF, Lookup File Set, Transformer, Sort, Join, Merge, Lookup, Funnel, Copy, and Modify stages.
- Received the master data and populated the Dimension Tables, Time generation, Surrogate key generation.
- As per Data Architect’s directions, created and executed the SCD Type 2 implementation on Dimensional data
- As per the data volume, presented the size requirements and partitioning requirements for ODS tables in Oracle.
- Extensively used Dataset management utility - viewing, copying, and deleting data.
- Exposure to Orchestrate - OSH scripts, Operators.
- Design and create stored procedures for the application
- Involved in setting up application and environment.
- Involved in designing UNIX shell scripts and use them in Data Stage.
- Requirement analysis and gathering.
- Provide technical and architectural support to the team.
- Primarily involved in job design, technical reviews and troubleshooting of jobs.
Environment: IBM Info sphere data stage 8.1
Data Stage ETL Developer
Confidential
Responsibilities:
- Used the Data Stage Designer to develop jobs to extract, transform and load data from Oracle Staging Database into the Data Warehouse.
- Extensively worked on the Job Sequences and Sequencer.
- Developed Autosys jobs and prepared Job Information Language (JIL) to schedule sequential running and start timing of those jobs.
- Performed unit and integrated testing and fixed the identified defects in the jobs.
- Involved in the design of the Job template dat provides the environmental parameters for the subsequent projects.
- Worked wif ETL architects and Business Analysts to prepare the ETL design specifications and unit test plans.
- Extensively used the Link Collector Stage, Sequential File Stage, Hash file Stage, Oracle OCI stage and developed Shared container jobs for reuse and modularity.
- Also used Teradata Plug-In Stages to utilize Teradata Fast load and Teradata Multi load utilities for Teradata table loads.
- Created user defined routines and transform functions (in Data Stage Manager) to carry out the complex transformations in the transformer stage.
- Exclusively used Stage Variables in Transformer stage for the purpose of reusability and to avoid repeated transformation logic.
- Developed Multiple-Instance Data stage jobs for reusability and performance gain by distributing source file into equal instance of source records.
- Wrote user defined SQL queries to extract the suitable data from Oracle sources and to perform join between various tables in the Oracle instance.
- Performed SQL Load & Partition Exchange operations using SQL Loader for High Volume data.
- Also developed PL/SQL blocks to perform row level cursor processing and multi-table bulk insert as post-load requirement.
- Excessively used and developed Perl JCS (Job Control Script) scripts dat works as a wrapper around the Data stage jobs or UNIX or SQL Command line.
- Augmented the performance of the job by tweaking array and transaction size in Data stage job and also changed job design to yield optimal performance.
- Worked wif Database Administrators (DBAs) to add some hints in Extract SQL as required per Explain plan of the SQL to gain efficient performance results.
- Used Data Stage Manager for importing metadata from repository and creating new table definitions and sequential file definitions.
- Carried primary pager duty for On-call Support of the Production system and other testing environment.
- Assisted other Data Stage developers wif design and development recommendations.
- Used the Rational Software Tools for versioning purposes.
Environment: Ascential Data stage 7.5.x, Oracle 10g/9i, Teradata V2R6.1, TOAD, Windows NT/XP, Rational Software, HP-UX 11i and Microsoft Visio.
Data stage Developer
Confidential
Responsibilities:
- Extensively used Data Stage Tools like Data Stage Designer, Data Stage Manager and Data Stage Director.
- Got the source data in the form of Oracle tables, Sequential files and Excel sheets.
- Developed processes to extract the source data and load it into the data warehouse after Cleansing, Transforms and Integrating.
- Imported metadata from repository, created new job categories, routines and data elements.
- Scheduled Running Testing and Debugging of jobs.
- Worked on programs for scheduling data loading and transformations using Data stage from source systems to Oracle 8i using PL/SQL.
- Worked on sales data, which comes from different countries.
- Created Job Sequencer to execute a set of jobs.
Environment: Ascential Data Stage 7.5.1, Oracle 8i, SQL Loader, PL/SQL, UNIX, Windows NT
