We provide IT Staff Augmentation Services!

Etl Resume

NC

SUMMARY:

  • Over 7+ years of professional IT experience and experience in Data Warehousing with expertise on Extraction, Transformation and Loading (ETL) process using IBM WebSphere DataStage 8.X/7.5.3/7.1r1/7.0/6.0XE/5.X (Manager, Designer, Director, and Administrator).
  • Designed and Implemented Server and Parallel Jobs including Batch Jobs and Sequencers.
  • Worked on various Stages like Transformer, Aggregator, Lookup, Join, Merge, Remove duplicates, Funnel Filter, Pivot, ODBC stages etc.
  • Expertise in data warehousing techniques for data cleansing, Slowly Changing Dimension phenomenon.
  • Knowledge in performing Regression testing and end to end Integration testing.
  • Experience in developing PX jobs that include both pipeline parallelism and partition parallelism techniques.
  • Extensively used multiple configuration files (environment variable) to increase the nodes according to the varying processing needs.
  • Experienced in working with the XML transformations and all types of files including the flat files.
  • Experience in integration of various data sources like IBM DB2, Oracle, SQL Server and Flat Files using Active/Passive Stages available in Data Stage Tool.
  • Experience in using the third party Scheduler like Autosys to schedule the jobs.
  • Excellent knowledge of studying the data dependencies using Metadata of Data Stage and preparing job sequences for the existing jobs to facilitate scheduling of multiple jobs.
  • Experience RDBMS, E_R model, Logical Model, Dimensional Model.
  • Experience in programming using SQL, PL/SQL and Unix Shell Programming/Scripting.
  • Experience in writing, testing and implementation of Stored Procedures, Functions, Cursors and Triggers at Database level using PL/SQL.
  • Expertise in using Oracle 6/8i/9i/10g databases
  • Proficient in SQL*Loader, SQL*PLUS, PL/SQL developer and TOAD applications to manage database.
  • Experienced in Tuning SQL Statements and Procedures for enhancing the load performance in various schemas across databases.
  • Excellent analytical, problem solving, communication and interpersonal skills, with ability to interact with individuals at all levels.

EDUCATION:

B.Tech, Electronics and Communication Engineering


COMPUTER SKILLS:

ETL Tools:

IBM WebSphere Datasatge8.X/7.5.3/7.1r1/7.0/6.0XE/5.X(Manager, Designer, Director, Administrator).

Languages:

SQL, PL/SQL, C, C++, Unix Shell Scripting.

Web Development:

Java Script XML, HTML, DHTML.

Operating Systems:

UNIX, Windows NT/95/98/2000/XP, MS DOS.

Database Tools:

SQL Plus, SQL Loader, Import, Export, TOAD.

Databases:
Reporting Tool:

DB2 7.1/6.1, Oracle 6/8i/9i/10g, Teradata, SQL Server2000/7.0/6.5, MS SQL, MS Access.
Micro Strategy

PROFESSIONAL EXPERIENCE:

Client: Confidential,NC
Period: Oct 2011 – Mar 2012
Role: ETL/Datastage Application Support

  • Used the DataStage Designer to debug processes for extracting, cleansing, transforming, integrating and loading data into data warehouse database and also the process of loading data into Data-mart.
  • Used the IBM WebSphere DataStage designer to develop jobs for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
  • Got the source data in the form of Oracle tables, Sequential files.
  • Handled errors using Exception Handling extensively for the ease of debugging and displaying the error messages in the application.
  • Used the Appworx job Scheduler to schedule the Datasatge jobs to run the daily jobs and weekly jobs.
  • Validated the current production data, existing data and the programming logic involved.
  • Experience in debugging ETL jobs to check in for the errors and warnings associated with each Job run.
  • Identified all data sources and size of the data load, analyzed data and Responsible in identifying data mapping rules.
  • Created Custom ETL to move data from the country offices which are in the form of flat files into target Teradata database. Used Teradata utilities such as FAST LOAD, BTEQ. Load data into ODS by running the Pre-defined ETL from both HRMS & Financials database.
  • Experience in using the XML transformations to get the desired results and used all types of files like the flat files and hash files.
  • Responsible in debugging Ticketing issues in the production phase.
  • Responsible for using the data mapping to direct into correct systems, data reconciliation and validations.
  • Used the DataStage Director and its run-time engine for testing and debugging its components, and monitoring the resulting executable versions
  • Experience in using the database objects like packages, procedures, and functions according to the client requirement.
  • Provided production support and performed enhancement on existing multiple projects.

Environment : DataStage Enterprise Edition (8 and 7.5, Designer, Director, Manager), DB2, Windows NT, UNIX, Oracle 10g/9i,PL/SQL, Toad, SQL Developer.

Client: Confidential,CA
Period: Jun 2009 – Oct 2011
Title: ETL/ Datastage Consultant

Responsibilities:

  • Worked on all phases of data warehouse development lifecycle, from gathering requirements to testing, implementation, and support.
  • Extracted data from Flat files and transformed it in accordance with the Business logic mentioned by the client and loaded data into the staging tables.
  • Used the IBM WebSphere DataStage designer to develop jobs for extracting, cleansing, transforming, integrating, and loading data into data warehouse database
  • Used the IBM WebSphere DataStage director for scheduling, validating, running and monitoring the jobs
  • Used PL/SQL Procedures and database triggers for the validation of input data and to implement business rules.
  • Created database objects like packages, procedures, and functions according to the client requirement.
  • Involved in performance tuning for several data stage jobs to reduce runtime in daily batch cycle.
  • Used several stages like sequential file stage, datasets, Copy, Aggregator, Row Generator, Join, Merge, Lookup, Funnel, Filter, Column Export etc in development of parallel jobs.
  • Create and Maintain Teradata Databases, Users, Tables, Views, Macros, Triggers and Stored Procedures
  • Worked on Fast load, Multi load for loading the data into the Teradata database
  • Reduce runtime for several existing jobs written in IBM WebSphere DataStage and PL/SQL packages.
  • Automate the process of data stage jobs to handle multiple day runs to catch up for any missed day runs.
  • Prepared a best practice document to use when designing data stage parallel jobs to gain optimum performance by using appropriate partitioning techniques.
  • Implementation of all jobs in production for all newly changed jobs to improve performance.
  • Involved in performance tuning of jobs to get data extracts, build reports and load data before 5.00 am of each day for daily batch jobs.
  • Written UNIX shell script to handle automation of daily batch runs to handle catch up runs by passing last run date, last pull date and use of infrastructure ETL run tables to accomplish daily batch runs catch-up.
  • Used several partitioning techniques in various stages to gain best performance on parallel jobs.
  • Handled errors using Exception Handling extensively for the ease of debugging and displaying the error messages in the application.
  • Involved in migration and implementation of data stage code from development to Test and Production environment
  • Prepare documentation for project estimates for all new developments to be done.
  • Involved in documentation for Design Review, Code Review and Production Implementation.
  • Attend all review meetings and explain the process of new implementations and their impact on existing systems and document back out plans for all the implementations performed.

Environment: IBM WebSphere DataStage 8.0/7.5.3/7.1 (Designer, Manager, Director), Parallel Extender, PL/SQL, Visio, Windows NT, UNIX, Oracle 10g/9i, Toad.

Client: Confidential,CA
Period: Jan 2007 – May 2009
Role: ETL/Datastage Developer

Responsibilities:

  • Extensively used DataStage Client components: DataStage Designer, DataStage Manager and DataStage Director.
  • Got the source data in the form of Oracle tables, Sequential files and Excel sheets.
  • Developed processes to extract the source data and load it into the data warehouse after cleansing, transforms and integrating.
  • Imported metadata from repository, created new job categories, routines and data elements
  • Transformations were used in DataStage to load data to Oracle and updated using PL/SQL.
  • Created Job Sequencer to execute a set of jobs.
  • Used DataStage Manager to create the table definitions for the CSV and Flat files, import the table definitions into the repository, import and export the projects, release and package the jobs.
  • Designed and developed jobs using DataStage Designer as per the mapping specifications using appropriate stages.
  • Validated the current production data, existing data and the programming logic involved
  • Released the jobs created and used them in packages for implementation in production phase
  • Designed high level ETL packages for overall data transfer from the source server to the Enterprise Information System (EIS) Data Warehouse which encompasses server name, database name, accounts, tables and direction of data flow, Column Mapping
  • Responsible in debugging Ticketing issues in the production phase
  • Wrote user-defined Functions, Routines and Transforms in DataStage.
  • Created various hash files for speeding up the look-ups.
  • Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad hoc or scheduled basis).
  • Wrote several complex SQL queries to extensively test the ETL process.
  • Built the shared container for use across different jobs.
  • Identified business needs, evaluated business and technical alternatives, recommended solutions and participated in their implementation.
  • Provided production support and performed enhancement on existing multiple projects.
  • Developed Data Stage Loads into Oracle for STAR Schema

Environment : DataStage Enterprise Edition (7.5, Designer, Director, Manager, Parallel Extender), Windows Server 2003, IBM DB2 Mainframe SQL Server 7.0, SQL, PL/SQL, Oracle 10g, Quality Center, SQL Loader, UNIX, Windows NT.

Client: Confidential,India
Period: July 2004-Dec 2006
Role: ETL/Datastage Developer

Responsibilities:

  • Worked with IBM WebSphere DataStage Designer to develop jobs for Extracting, Transforming and Loading the data into Target database.
  • Involved in the Creating, Designing and Documentation of the Data Warehouse
  • Worked with various stages like Sequential File, Hashed File, Aggregator, ODBC, Transformer, UDB DB2 and OraOCI Stages.
  • Developed user defined Routines and Transformations by using Universe Basic.
  • Experience in using IBM WebSphere DataStage and SQL*Loader to load the data into target databases.
  • Worked with DataStage Manager for importing metadata and DataStage Components.
  • Used the DataStage Director to validate, schedule and run the jobs.
  • Create Unix Shell Scripts for scheduling the jobs.
  • Worked with Hash files, Parallel Job Extender for jobs for parallel Processing and IPC stages to improve the performance of jobs.
  • Involved in Designing and developing universes for reporting generation from warehouse databases using Business Objects.
  • Developed various shared Container jobs for Re-Usability
  • Used Partition methods and collecting methods for implementing parallel processing.
  • Involved in Debugging and testing the jobs.

Environment: IBM Websphere DataStage 6.0, Universe Basic, Oracle9i, SQL Plus, PL/SQL, TOAD, DB2, Business objects, SQL * Loader, HP-Unix and Windows 2000.

Hire Now