Data Warehouse Developer Resume
SUMMARY:
- IT professional , around Seven plus years of experience in IBM DataStage v 8.5/8.1/ 7.x/6.x/5.2 (Server and Enterprise Edition) using Components like Administrator, Manager, Designer, and Director.
- 6+ years in the fields of data Warehousing, Data Integration, Data Migration using IBM Web sphere Data Stage, Oracle, PL/SQL, DB2 UDB, SQL Server 2000/2005. SQL procedural language and Shell Scripts
- Around Five years of experience in ETL methodologies in all the phases of the Data warehousing life cycle
- In Depth knowledge in Data Warehousing & Business Intelligence concepts with emphasis on ETL and full Life Cycle Development including requirement analysis, design, development, testing and implementation
- Expertise in all the phases of System development life Cycle (SDLC) using different methodologies like Agile, Waterfall.
- Expertise in OLTP/OLAP System Study, Analysis and Dimensional Modeling, E-R modeling. Involved in ODS/Designing Dimensional Model (Star Schema and Snowflake Schema) Designing logical and physical design data modeling with star schema using Erwin.
- Have good grasp of data warehousing fundamentals and have proven ability to implement them. Conversant with ETL processes.
- Extensively used SQL coding for overriding the generated SQL in Datastage and also tested the data loaded into the data base.
- Excellent experience in most of the RDBMS including Oracle 11g/11i,10g, SQL Server 7.0/6.5 & DB2 7.2/8.1/9.0
- Extensively used DataStage-Designer to design and develop Server and PX jobs to migrate data from transactional systems (Sybase, DB2UDB) into the Data Warehouse.
- Extensively used DataStage- Manager to Export/Import DataStage Job components and Import Plug in Table Definitions from DB2UDB, Oracle and Sybase databases.
- Designed Server jobs, Job Sequencers and Parallel jobs. Handled multiple pieces of a Project.
- Designed Parallel jobs using various stages like join, merge, lookup, remove duplicates, filter, dataset, lookup file set, modify, aggregator, Transformer.
- Good Experience in Extraction Transformation and Loading (ETL) processes using Data Stage ETL Tool, Parallel Extender, Metastage, Quality Stage, Profile Stage
- Experience in integration of various data sources like Oracle, Teradata, DB2, SQL Server, MS Access and Flat files into the Staging Area.
- Proven track record in troubleshooting of DataStage Jobs and addressing production issues such as performance tuning and enhancement
- Excellent analytical, problem-solving and communication skills
TECHNICAL SKILLS:
Data Warehousing
IBM DataStage 8.5/8.1/7.5(Designer, Director, manager, Administrator), Parallel extender, ETL, OLTP, SQL*Plus
Databases
Oracle11i/10g/9i,DB2UDB7.2/8.1/9.0,MS SQL Server 2005/2008
Tools
SQL Navigator, DB2 QMF V9, Control-M TOAD
Programming
SQL, PL/SQL, Unix, Korn, Shell Scripting
Analysis & Design
Agile, Waterfall
Others
MS Excel, MS Office
Environment
Sun Solaris IBM AIX 5.3/5.2/4.2, MS DOS 6.22, Win 3.x/95/98/2000, Win NT 4.0,Win XP
EDUCATION:
Bachelor of Technology Degree: Computer Science and Information Technology
PROFESSIONAL EXPERIENCE:
Client: Confidential,OH
Duration: JULY‘10 – Till date
Role: Datastage Developer
Confidential, is an online part reference tool providing dealers with primarily ship direct parts information, including part details, links to model where used, part images, promotions and ordering details, and electronic access to ship direct parts marketing materials. Although the tool focuses on ship direct products, dealers can view general parts data for any CNH part number. Feature of the tool include parametric search capability and cross- referencing from manufacturer or competitor part numbers to CNH parts.
Responsibilities:
- Gathering process information, business model and requirements
- Prepared ETL mapping and Low Level Design Documents for Policy and Consumer Conversion
- Analysis and design of ETL processes using DataStage
- Designed the Target Schema definition and Extraction, Transformation and Loading (ETL) using Data stage.
- Participated in Daily status meetings and conducting internal and external reviews as well as formal walkthroughs among various teams and documenting the proceedings.
- Developed various jobs using DRS, Modify, Aggregator, Sequential file, Transformer stages, LookUp, Sort, Join, Filter, DB2 stages, etc
- Used before and after job Sub Routines for auditing purpose
- Used Shared Containers and created reusable components for local and shared use in the ETL process.
- Imported and exported repositories across DataStage projects.
- Performed data analysis, data processing and cleansing through Error files and Log files.
- Used Data Stage Director Run Time engine to schedule and execute developed jobs and job sequences and use Log events to monitor job progress and performance.
- Troubleshot jobs using DataStage Debugger.
- Worked on performance tuning and enhancement of DataStage job transformations.
- Maintained the defects involved for proper documentation using Quality Control.
- Use to resolve all the QA defects related to design and documentation.
- Involved in 24/7 production support and was responsible for ETL process in production environment
Environment: IBM Infosphere Datastage 8.5/8.1,Oracle 11i, DB2 8.7, TOAD 9.0 ,SQL/PLSQL, Putty, Windows XP, Quality center, VISIO
Client: Confidential,NYC, NY
Duration: Nov 08 – June \'10
Role: Datastage Developer
Emblem health is a major health care client in NYC. Data migration from old system called Amysis was moved to Qcare system. Web feeds were designed to incorporate the new system. Siebel and Lake interim solution were two major platforms were the qcare system would rely on. Lake interim solution was part of Emblem health located at Lake Katrine. Claims, Members, Providers, Authorization, and Eligibility comprised Siebel system
Responsibilities:
- Worked closely with Project lead, System Analyst, Business Analysts to understand the business process and functional requirements
- Initial development was done on 7.5.2.
- Upgrading the tool from 7.5.2 to 8.0.1 was performed.
- Extensively Used the IBM Information Server Designer to develop jobs to extract, transform and load data from various source systems into the Data Warehouse.
- Designed the Datastage jobs based on the functional specifications provided by the Business analysts.
- Data was migrated from DB2 which was named as E630 system to the Oracle i.e., staging area.
- Extracts were created to build claims, members, and providers to load the Siebel system. Lot of these extracts generated fixed width files which were later tested by the UAT team.
- Bug fixing was done as and when we got the results from UAT.
- Performance tuning to Datastage jobs was performed.
- Before going into the UAT, unit testing of jobs were done. Each datastage job was carefully designed so that it is efficient and the performance issues were also taken into account.
- SQL scripts were written to create tables to copy DB2 data into the Oracle environment.
Environment: IBM Infosphere Datastage 8.1, Ascential DataStage 7.5.2, Oracle 10g, SQL Assistant 6.1/6.2, DB2 9.1, SQL SERVER 2008, TOAD 9.0, SQL/PLSQL, Putty, Windows XP
Client: Confidential, VA
Duration: Feb 2007 – Oct 2008
Role: Data Warehouse Developer
The FOCUS system is aimed at creating and tracking high-level project goals for the marketing department. This system identifies existing customers more accurately and analyzes their purchasing profiles in order to segment them with more sophistication. It supports campaigns by capturing information in distinct individual profiles. It also improves campaign management allowing people in sales and marketing from offices in different countries to access the results. DataStage was used to transform a variety of files from different product platforms into standardized data mart. The data mart has been designed using Erwin adopting Star Schema methodology.
Responsibilities:
- Collaborated with business users, business analysts and project managers to translate the business requirements into technical specifications.
- Involved in analysis of physical Data Model for ETL mapping and the process flow diagrams.
- Responsible for creating High Level Design (HLD) and Application Interface Design (LLD) documents
- Responsible in designing the schema with a special focus on User Interface Design
- Responsible for conceptualizing and generating the need for Data Warehousing solutions as applicable to billing systems
- Evaluated the Consistency and integrity of the model and repository
- Used DataStage Parallel Extender for parallel processing of data extraction and transformation.
- Used Integrity & Parallel Extender for cleansing the data and performance improvement
- Extensively used almost all of the transforms of DataStage for various types of Date Conversions
- Created partition primary indexes and secondary indexes for query performance in db2.
- Responsible for Tuning the DataStage Repository and Jobs for optimum performance
- Extensively used Integritys existing wizards to remove duplicates
- Parsed, Matched and removed duplicate records using Integritys built-in wizards
- Scheduled and monitored automated weekly jobs
- Performed the Unit testing of individual modules and their integration testing
- Debugged and sorted out the errors and problems encountered in the production environment
- Performed daily production support of the Production Data Warehouse.
Environment: IBM WebSphere DataStage 7.5 (PX) (Designer, Manager, Director, Parallel Extender), IBM QualityStage 7.5, Bussiness Objects XI, MetaStage (Directory, Explorer), SQL, PL/SQL, DB2 UDB, Oracle 9i/8i, MS Access, Windows NT 4.0, Sun Solaris 2.6
Client: Confidential,TX
Duration: Nov 2005 – Jan 2007
Role: Data Warehouse Developer
consolidates data from various operational systems to provide a single source of integrated and historical drug-related data for the purpose of end-user reporting, analysis and decision support and improve client service by preventing errors, providing real-time data and updating records as transactions are completed.
Responsibilities:
- Involved in studying the impact and issues of incorporating the new business into Data Warehouse.
- Participated in Business Requirement Analysis and assisted with defining requirements.
- Designed and developed DataStage jobs for converting incoming data into Common data specifications applying business rules which consists data loads, data cleansing and data manipulating
- Designed, developed and deployed DataStage Jobs and fine-tuned them
- Worked in data conversions and data loads using PL/SQL and SQL*Loader
- Created Jobs with DataStage using transformations and hash files
- Extensively worked on Ascential Quality Stage to clean up the data
- Used Parallel Extender for parallel processing of data extraction and transformation
- Utilized MetaStage directory to source, share, store and reconcile a comprehensive spectrum of Meta data
- Extensively worked on SyncSort for sorting and grouping the data
- Used different types of stages like Sequential File, Aggregator, ODBC, and ORABULK for developing different jobs
- Created batches and sequencers for running and controlling set of jobs developed.
- Implemented transformation component of DataStage to integrate the data and to implement the data to implement the business logic
- Developed user defined Routines and Transformations
- Used the DataStage Director for scheduling, Validating, running, and monitoring the jobs
- Used DataStage Manager for importing metadata and create/import table definitions from repository, new job categories and creating new data elements
- Replaced manual extraction with automatic process using DataStage tool
Environment: IBM WebSphere DataStage 7.5 (PX) (Designer, Manager, Director, Parallel Extender), IBM QualityStage 7.5, MetaStage (Directory, Explorer), SQL, PL/SQL, Teradata v2R5, Oracle 9i/8i, MS Access, Windows NT 4.0, Sun Solaris 2.6