Sr.datastage Consultant Resume
Bridgeport, CT
SUMMARY:
- Around 3 years of strong Data Warehousing experience on Extraction, Transformation and Loading (ETL) processes using Ascential Data Stage (Manager, Designer, Administrator, Director), Parallel Extender.
- Professional experience working with various industries such as Medical, Manufacturing, Telecom.
- Worked on Datastage client tools Datastage Designer, Datastage Director, Datastage Manager.
- experience on IBM Datastage , Qualitystage 7.5.2 EE ( Parallel Extender )
- Experience in Designing, Compiling, Testing, and Scheduling and Running DataStage jobs.
- Expertise in data warehousing techniques for data cleansing, Slowly Changing Dimension phenomenon.
- Developed Server jobs for extracting, transforming, integrating and loading data to targets.
- Excellent experience in using Stages like Aggregator, Merge, Joiner, Hashed File, Lookup, Transformer and ODBC etc.
- Involved in gathering Business requirement and Designing Functional specifications.
- Designed Mapping documents ETL architecture documents and specifications.
- Analyzed the Source Data and designed the source system documentation.
- Experience in analyzing Star Schema/Snowflake Schema, Dimensional Data Modeling, Logical and Physical Data Modeling using ERwin4.0/3.5
- Accessed and created SAP BW metadata objects such as source Systems, Info Sources, Info Objects using WebSphere Datastage pack
- Integrated WebSphere Datastage Pack for SAP BW for non-SAP data into SAP Business Information Warehouse.
- Used SAP staging Business API (BAPI) interfaces to load data from any source into SAP's Business Information Warehouse (BW).
- Hands on Experience in integration of various data sources like Oracle, Sybase, MS Access and SQL Server.
- Strong working knowledge with Oracle database Design and SQL Scripting, PL/SQL.
- Designed advanced SQL queries, stored procedures, packages, scripts, cursors Create, maintain, modify, and optimize Oracle databases.
- Developed complex functions, named and unnamed blocks by using PL/SQL.
- Experience with UNIX shell scripting, Unit testing, logical and physical database design, database security maintenance Shell scripts for batch processing.
- Excellent analytical, problem solving, communication and interpersonal skills, with ability to interact with individuals at all levels.
Education:
Masters in Electricals
Technical Skills:
ETL
IBM Datastage 8.x/7.5.2EE client components (Designer, Director, Manager, Administrator), Profilestage, & Information Analyzer 8.1
Data Modeling
Star Join Schema, Snow-Flake Schema, Dimensions & Fact Tables, Physical and Logical Data Modeling, Erwin (Forward & Reverse) engineering.
Databases
Oracle 11i/10g/9i/8i, DB2/UDB 8/9.1, MS Access and SQL Server 2005.
BI Tools
Business Objects XI.
Languages
SQL, PL/SQL, C, C++
Environment
Windows 2003/2000NT 4.0, AIX 5.2/4.3, HP-UX, Unix
Confidential, New York Aug 2010 - Till date
Sr.Datastage Consultant
Confidential, is a media conglomerate focused on broadcasting, publishing, billboards, and television production, with most of its operations in the United States.
As a Datastage consultant, was responsible for installing Datastage and building the Showtime and Shoogle Linear interfaces for the updating the online schedule and to deal with performance issues of the existing jobs.
- Involved with theclient and management team fordrafting the Functional specs for the interfaces.
- Developedthe Technical specs, mapping docs and job Designsfor the multipleinterfaces.
- Analysedsource data and imported themetadata data of the XML file thought XML Metadata imported.
- Created jobs reportsfor designed interfaces for high level management.
- Exclusively worked on the Oconv and Iconv Functions for data transformation.
- Redesigned existing interfaces to overcome the performance issues and to meet the new business needs (CR\'s).
- Installed Datastage 7.5x2 on client server.
- Redesigned existing server jobs in parallel version and led the team on parallel job design and performance turning.
Environment: Datastage 7.5x2, Oracle 11g, SQL server 2005, SQL Developer, Sybase Power Designer 15.1, MS Word, Excel.
Confidential, Chicago Feb 2010 - June 2010
IBM Datastage Consultant.
Confidential, develops, manufactures and markets products that save and sustain the lives of people with hemophilia, immune disorders, infectious diseases, Kidney diseases, trauma and other chronic and acute medical conditions.
The new solution delivered through Project ERP BI is enterprise system, serving the finance, Reference & supply Chain planning and forecasting processes across all Baxter divisions and geographies
Responsibilities:
- Involved in preparing tech specs and mapping doc. and converting them into Datastage jobs.
- Coordinated with the offshore team on development and testing the designed Datastage jobs.
- Designed and Developed Data stage Jobs to Extract data from heterogeneous sources, Applied transform logics to extracted data and Loaded into Data Warehouse Databases.
- Created Datastage jobs using different stages like Transformer, Aggregator, Sort, Join, Merge, Lookup, Data Set, Funnel, Remove Duplicates, Copy, Modify, Filter, Change Data Capture, Change Apply, Sample, Surrogate Key, Column Generator, Row Generator, Etc
- Worked with the QA team on fixing defects in global and regional jobs.
- Created new projects in datastage. Also wrote shell script to create directory structures according to the new project.
- Prepared and reviewed UTPs for the designed jobs.
- Migrated Datastage jobs and sequences from Development to Test environment.
- Implemented SCD 1 and SCD2 using CDC stage.
- Created global environment variable at project level. Migrated DSParam file in case of project migration to different environment and then setting up global parameters in administrator.
- Worked on Data profiling and Data Quality using Trillium Discovery. Closely worked with technical and business experts to solve data quality issues.
- Designed Datastage jobs for Dimension Tables and the fact table.
- Implemented slowly changing dimension in Datastage jobs using change data capture, filter processors.
- Validated the Datastage jobs in the Test environment.
- Prepared master sequences with a Routine Activity with a stored procedure called in it.
- Handled Email Notification in order to ensure the status of the Datastage sequence and Terminator Activity in a sequence when the job is aborted.
- Developed master sequences for the SCD1 and SCD2 tables.
- Explicitly working on processors such as Change Data Capture, Filter, Pivot, Modify etc.
- Developed complicated sourcing logic for the PSA to RDW jobs.
- Used the Datastage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on ad hoc or scheduled basis.
Environment: IBM WebSphere Datastage 8.0.1, JDE 7.2/8.13, Oracle 11g, DB2/UDB, UNIX AIX, SQL Developer, Cognos, Filezilla, Sybase Power Designer 15.1
Confidential, MN Oct 2009 - Jan 2010
IBM Info Server Consultant.
Confidential, serves physicians and their patients in over 100 countries around the world. The new solution delivered through Project Clearview is enterprise system, serving the financial planning and forecasting processes across all STJ divisions and geographies.
Responsibilities:
- Interacted with end users in finalizing the requirements and documented the Program Specifications for the ETL jobs.
- Involved in Requirements gathering, Developed mapping documents with modeling documents, written techno functional documents, test cases, test case scenarios based on the ETL PROCESS, functional specification documents.
- Involved in design and development of parallel jobs, sequences using the Designer.
- Involved in the identification and analysis of the source data for performing the ETL operations.
- Worked with various sources such as Oracle, SAP BW, Essbase, Flat files.
- Used IBM Information Server to extract data & Load into Data Warehouse
- Created Test Plans for Unit Testing for designed jobs.
- Used SAP Packs to Load & Extract pack for SAP BW.
- Used IDoc to move data between SAP instances for bulk data transfers.
- Designed and developed ETL Parallel Jobs using various stages like Join, Lookup, Lookup File Set, Change Capture, Filter, Funnel, Copy, Column Generator, Peek, Dataset, Sequential File, Oracle Connector, Essbase Connector, BW Load, Merge, Transformer, Aggregator, Remove Duplicates Stages etc to load data warehouse and Data Mart.
- Used Environment Variables, Stage Variables and Routines for developing Parameter Driven Jobs and debugging them.
- Used Essbase connector to load data into Essbase
- Used Development/Debugging stages like Row generator, Column Generator, Head, Tail and Peek.
- Used several stages in Sequencer like Abort Job, Wait for Job, Nested Condition and Mail Notification stages to build an overall main Sequencer.
- Loaded map tables using .CSV files.
- Used Data Stage Director for running and monitoring performance statistics.
- Converted XML files data to tabular data.
- Tuned Data Stage jobs for better performance by creating Data Stage Lookup files for staging the data and lookups.
- Used all stages like Sequential files, Hash files, Lookup hash, Join, Funnel, Filter, Transformer stage and Sequence Jobs using Job Activity and Mail Notification to send mail notifying the admin about the success or failure of the jobs.
- Performed unit testing of all monitoring jobs manually and monitored the data to see whether the data is matched, if matched send it to the frictionless database otherwise reject and also created migration of documents.
Environment: IBM Info Sphere Data stage, Quality stage & Information Analyzer 8.0.1, Oracle10g, Essbase, SAP, SQL Developer, UNIX- AIX, MS Word, Excel.
Confidential, New Jersey Mar 2009 - Sep 2009
Datastage Consultant.
Confidential, is a leading provider of Pure IP unified communications systems. NetzGate enables companies of any size to seamlessly integrate all communications-voice, data, messaging-with their business processes. Confidential, distributed software architecture eliminates the traditional costs, complexity and reliability issues typically associated with other solutions.
Responsibilities:
- Involved in all phases of the software development lifecycle(SDLC), coherent with Data Cleansing, Data Conversion, Performance Tuning, Unit Testing, System Testing, User Acceptance Testing
- Developed Data Stage Parallel Jobs where in using required stages, data from different sources formatted, Cleansing, summarized, aggregated and transform into data warehouse.
- Involved in design and development of server jobs, sequences using the Designer.
- Involved in the identification and analysis of the source data for performing the ETL operations.
- Designed several Data Stage server and parallel jobs using Sequential File, Dataset, Join, Merge, Lookup, Change Apply, Change Capture, Remove duplicates, Funnel, Filter, Copy, Column Generator, Peek, Modify, Compare, Oracle Enterprise, Surrogate Key, Aggregator, Transformer, Decode, Row Generator stages.
- Created Shared Containers to increase Object Code Reusability and to increase thru put of the system.
- Experience developing complex transformations, surrogate keys, routines, dimension tables and fact tables.
- Involved in the identification of Facts and dimensions for developing logical design of the data marts.
- Used Datastage as an ETL to extract data from sources like Sybase, DB2, VSAM files and flat files and loaded to target Oracle
- Imported metadata, table definitions and stored procedure definitions using the Manager.
- Performed extraction, transformation and loading of data using different types of stages and by performing derivations over the links connecting these stages.
- Enhanced the Job Performance by using proper Partitioning methods and analyzing the resources utilized using Job Monitor.
- Created Master Job Sequencers to control sequence of Jobs using job controls.
- Data Cleansing & Standardization, De duplication & Identification and address verification of customer and vendor data using Quality stage Stages.
- Using Multi Client Manager I worked on IBM Data stage 7.5.2 and IBM Info Sphere 8.0.1
- Implementing the SCD Type-2 using SCD stage & Change Capture stages.
- Supporting the existing jobs in Data stage 7.5.2.
- Develop the jobs new EDW environment by using IBM Info Sphere 8.0.1 & IBM Analyzer.
- Work with data modeler to analyze the existing tables to prepare the logical & physical tables.
- Implemented SAP packs delivered by Ascential for R/3 conversions.
- Used ABAP for large volumes of data from functional area to extract.
- Used SAP Packs to Load & Extract pack for SAP BW.
- Used IDoc to move data between SAP instances for bulk data transfers.
- Wrote UNIX shell scripts for initialization process, to solve deferred bugs and for process control mechanism and executed via Datastage.
- Assisted the report developers to troubleshoot the performance of the SQL code running the Web Intelligence reports by doing performance tuning of the SQL code.
- Written stored procedures for building reports using PL/SQL.
- Wrote stored procedures, functions and packages using TOAD to handle complex business logic.
Environment: IBM Info Sphere Data stage, Quality stage & Information Analyzer 8.0.1,,Oracle10g, Business Objects XIR2, SAP, TOAD, UNIX- AIX, MS Word, Excel, DB2.
Confidential, Hyderabad, India Jan 2007 - Nov 2007
System Specialist
Tecumseh Products Company\'s (TPC) global vision of providing comfort, health and convenience to millions worldwide, gives an impetus for the company\'s steady diversification into new frontiers. And today, this cooling giant\'s products are available in over a 100 countries across the globe. The superior products and services offered by TPC have made it the first choice of leading multinational brands in the Air Conditioning and Refrigeration business in India. TPIPL has also begun exports to Middle East, U.S.A, Pakistan, Bangladesh, Nepal, Sri Lanka and other countries.
Responsibilities:
- Developed and designed as per system requirement.
- Responsibility is to interact with the users, drawing up specifications after analysis, hardware selection, and design of database.
- Written stored procedures and functions using PL/SQL
- Used Data Access Objects (DAO) to do the data manipulations. Used Crystal Reports to generate the reports.
- Normalization, performance, tuning tests used on database.
Environment: Oracle 8i, PL/SQL, SQL*plus, Windows 2000, Crystal Reports.