Sr. Lead Data Stage Consultant Resume
Silver Spring, MD
SUMMARY:
- More than 9 years of IT experience with 8+ years in Data Warehouse Architect/System Analyst/Project Leader/Developer.
- 8+ Years of experience in using ETL and OLAP tools like utilizing DataStage 8.1.1/7.5.2(Parallel Extender), Ab Initio, Informatica 6.x/7.x, Business Objects and Cognos.
- IBM Certified Solution Developer -- Websphere IIS DataStage Enterprise Edition V7.5 Parallel Extender, and IBM Information Server.
- Installation, configuration, setup and Administration of DataStage Server.
- Experience in DataStage Administrator to create/modify/delete projects and cleanup projects and Implemented security among DataStage users and projects
- Experience in Profilestage and Qualitystage.
- Experience in Data Modeling, Star Schema/Snowflake Schema modeling, FACT & Dimensions tables, Physical & logical data modeling.
- Developed the Source-Target Mapping for the Dimensions and Fact Tables.
- Extensively used Parallel Extender to load data into data warehouse with different techniques like Pipeline and Partition in MPP environment.
- Experience in IBM IPS Parallel Framework Architecture (Grid Environment)
- Used Datastage Enterprise Edition/Parallel Extender stages namely Datasets, Sort, Lookup, Change Capture, Funnel, Websphere MQ series Plugin Stage Peek, Row Generator stages in accomplishing the ETL Coding.
- Expertise on building DataStage process for Real Time Integration WSDL (RTI) with web services
- Conducted detailed data analysis / reporting using IBM Websphere Information Analyzer for the multiple sources from various systems.
- Experience in Property Casualty (P & C) insurance.
- Used Both Pipeline Parallelism and Partition Parallelism for improving performance.
- Identified and tracked the slowly changing dimensions, heterogeneous Sources and determined the hierarchies in dimensions.
- Experience on HP PPM, a process management tool. Worked on Workflows, request types, portlets, Security rights etc.
- Migrated XML data files to Oracle data mart for Data Lineage Statistics.
- Experience in Agile methodology.
- Knowledge on ACCORD standards.
- Experience in implementing DB2, DB2/UDB, Oracle 10.2 / 9i / 8i / 8.0, SQL Server, PL/SQL, SQL*Plus, Teradata V2R5 V2R6 and Sybase database applications.
- Excellent experience in TERADATA Utilities: Queryman 6.2, BTEQ, Fastload, Multiload, Fastexport .
- Experience in Requirements Analysis, Design, Development, Testing and Implementation of Data warehouses and Database business systems.
- Used ETL Tool, to create jobs for extracting the data from different databases, flat files & Mainframe files.
- Extensively Implemented Error Handling Concepts, Testing, Debugging skills and Performance tuning of targets, sources, transformation logics
- Experience in ISCMS, Subversion for version control and promoting the code to higher regions and Autosys for job scheduling in grid environment.
- Extensively used clear case and version control to promote the jobs.
- Experience in all Testing Phases: Unit testing, Integration Testing, Regression testing, Performance, Acceptance testing.
- Strong skills in analysis database designing, Coding using SQL and PL/SQL, Developing, Writing, Unix Shell Scripts and code/script testing. Coded Stored Procedures, Packages and Triggers using PL/SQL.
- Management skills include Team Management, Project Planning, Monitoring, and self-starter with good communication skills and ability to work independently and as part of a team.
- Ability to adjust to people, circumstances & responsibility, with a Drive for results through self-motivation & self-candor.
SOFTWARE/ HARDWARE:
Data Warehousing ETL Tools
Data Stage 8.1.1/7.5.2 Parallel Extender, Informatica 8, Ab Initio (GDE) V1.14 Ab Initio Co-Operating System V2.13.1.
Reporting Tools (OLAP)
Cognos 8.4 , Business Objects 6.1, MicroStrategy 8
Data mining tools
SAS
Data Modeling & Design Tool
Erwin, Microsoft Visio
Messaging/Web Servers
Websphere MQ Series
Version Control Tools
Subversion, Clear case, version control
Scheduling Tools
Autosys
RDBMS
Oracle10g//9i/8.x/7.x, MS SQL Server 2005/2000, MS Access 2000, Teradata V2R5/R4, DB2 UDB v8.2/ v7.2, Sybase
Languages
C, C++, UNIX Shell Scripting, Perl, SQL, PL/SQL
Web Technologies
VB, XML.
Operating Systems
MS-DOS, Windows Vista/ XP / NT / 2000, UNIX (Sun Solaris, HP-UX, AIX), Linux
Others
Mercury ITG , HP Project & Portfolio Mgmt Center 7.5 SP2
PROFESSIONAL EXPERIENCE:
Confidential, Silver Spring, MD
Sr. Lead Data Stage Consultant
Confidential, the United States\' largest cable television network, is the premier provider of real-world entertainment, offering a signature mix of compelling, high-end production values and vivid cinematography that consistently represent quality for viewers. Discovery Channel is seen inover 94million homes in the United States; internationally, it is seen in 234 million homes in more than 170 countries. Discovery Communications is dedicated to creating the highest-quality television and media to inspire audiences by delivering knowledge about the world in an energizing way; evolving a timeless brand for a changing world.
Project Title: NMA-II (New Media Analytics)Oct’09 – Till Date
Description:
The primary purpose of the project is to provide the online sales team with more accurate and sufficiently detailed information about advertising actually delivered by Discovery through its various online channels. Greater accuracy in these numbers will allow Discovery to deliver closer to contract guarantees and package inventory more effectively. This will increase Discovery’s advertising inventory and allow the company to use that excess inventory to generate incremental revenue.
Roles & Responsibilities:
- Analyzing the existing informational sources and methods, understanding the customer expectations and identifying the problem areas
- Involved during the analysis, planning, design, development, and implementation stages of projects using IBM Websphere software.
- Prepared the High level and ETL Technical specifications for Datastage ETL jobs product and Identity.
- Designed and developed DataStage jobs using Parallel Processing techniques by implementing Pipeline and Partition Parallelism.
- Extensively used DataStage Designer, DataStage Director, DataStage Administrator.
- Conducting peer code reviews with team.
- Used import/export utilities to transfer data from production instance to the development environment.
- Used Datastage Enterprise Edition/Parallel Extender stages namely Datasets, Sort, Lookup, Change Capture, Funnel, Websphere MQ series Plugin Stage, Row Generator, Transformer, Aggregator stage, lookup stage and Merge stages in accomplishing the ETL Coding.
- Involved in Performance Tuning of Jobs.
- Developed schedule ETL jobs and explained production team about (Daily/Monthly/Yearly) scheduled jobs & logs.
- Extensively worked UNIX Shell Scripting (Korn /KSH) / Linux scripting and File Transfer Protocol (FTP) & SFTP, XML
- Extensively worked Oracle PL/SQL for Product class.
- Created shell scripts to feed data from different sources to ETL JOBS.
- Used Information analyze(i.e., Profile Stage) for POC and done the Column Analyst , Row Analyst, Primary Key Analyst, Cross Table Analyst, Relation Ship Analyst and Normalization reports.
- Improved performance of a poor performing Datastage jobs and database ETL queries.
- Responsible for Application back-ups (i.e., Daily/Weekly/Monthly).
- Performed GUI, Functional, Regression, Integration and System Testing.
- Support QA and UAT by preparing the environments, providing execution instructions, troubleshooting issues, and resolving defects.
Environment: DataStage 8.1.1 Parallel Extender, Micro Strategy, Oracle 10.2, SQL Plus, UNIX.
Confidential, Hartford
Sr. Data Stage Consultant
Confidential, is a leading provider of property casualty insurance and surety products and of risk management services to a wide variety of businesses and organizations and to individuals. The company reported 2006 revenues of $25.1 billion and total assets of $113.8 billion. Their products are distributed primarily through U.S. independent insurance agents and brokers. Travelers is the second largest writer of auto and homeowners insurance through independent agents. Travelers is headquartered in Saint Paul, Minn., with significant operations in Hartford, Conn. The company also has offices in the U.K., Ireland and Canada.
Project Title: MIS Database Reporting May’08 – Sep’09
Description:
The scope of this project is to build the data warehouse for the Managing information systems (MIS) in to all the divisions, to integrate all the information into the data warehouse for easy access to a subset of the Managing IS data to enable creation of Ad hoc and standard reports.
Roles & Responsibilities:
- Analyzing the existing informational sources and methods, understanding the customer expectations and identifying the problem areas
- Extensively used DataStage Designer, DataStage Manager, DataStage Director, DataStage Administrator.
- Involved during the analysis, planning, design, development, and implementation stages of projects using IBM Websphere software.
- Designed and developed DataStage jobs using Parallel Processing techniques by implementing Pipeline and Partition Parallelism on a MPP system.
- Used Datastage Enterprise Edition/Parallel Extender stages namely Datasets, Sort, Lookup, Change Capture, Funnel, Row Generator stages in accomplishing the ETL Coding.
- Designed, coded, and tested the Information Server components
- Tuned the jobs for higher performance by dumping the look-up data into hash-file.
- Coordinated with Database Admin to create appropriate indexes for faster execution of jobs.
- Used Administrator to administer the locks on the jobs and other Administration activities for DataStage Server.
- Developed UNIX shell scripts to automate the Data Load processes to the target
- Developed jobs to load data in slowly changing dimensions.
- Involved in Performance Tuning of Jobs.
- Designed the mappings between sources external files and databases such as SQL server, .CSV and Flat files to Operational staging targets
- Assisted operation support team for transactional data loads in developing SQL & Unix scripts
- Responsible to performance-tune ETL procedures and STAR schemas to optimize load and query Performance.
- Migrated XML data files to Oracle data mart for Data Lineage Statistics.
- Used import/export utilities to transfer data from production instance to the development environment.
Environment: DataStage 7.5.2 Parallel Extender, HP PPMC 6/7.1, Cognos 8.4, Oracle 10.2, SQL Server, DB2 UDB, UNIX, ISCMS, Subversion and Autosys.
Confidential, New Jersey Aug’07 to Apr’08
Project Lead/Data Stage Consultant
Confidential, world leaders in insurance and financial services, is the leading international insurance organization, with operations in more than 130 countries and jurisdictions. AIG companies serve commercial, institutional and individual customers through the most extensive worldwide property-casualty and life insurance networks of any insurer. In addition, AIG companies are leading providers of retirement services, financial services and asset management around the world.
Project Title: Booking A & H
Description:
American International Group (AIG) is in the process of generating Booking A & H lines of business reports for their business decisions.This project is to provide ETL based solution for the migration of the ODS (Operational Data Store) data existing in BOOKING lines of business of AIG. The source data existing in the ODS (Operational Data Store) has to be transformed and converted in-line with the mainframe Host file format.
Roles & Responsibilities:
- Analyzing the existing informational sources and methods, understanding the customer expectations and identifying the problem areas
- Documented design and solution that meets business requirement with technical vision and best practices
- Participated in discussions with Project Manager, Business Analysts and Team Members on any technical and/or Business Requirement issues
- Coordinating with the offshore team; Peer review of the deliverables
- Extensively used ETL to load data from Oracle 9i database & Flat files Source to Teradata Database Server
- Performance Tuning Teradata Data Base as well as Teradata Queries.
- Participated in Design of Teradata Data base.
- Obtained detailed understanding of data sources, flat files and complex data schemas
- Extensive knowledge on DataStage Designer, DataStage Director, DataStage Administrator, and Quality Stage
- Created various jobs using Teradata Tpump/Multiload stage, Teradata API stage , Aggregator, Sort, Inter Process, Link Collector Transformer, Sequential, Hashed File, ODBC stages, Teradata plug in stages.
- Have written wrapper scripts to run the Datastage and Teradata Scripts and Jobs.
- Used TPUMP, MULTILOAD, BTEQ utility, while loading the target tables
- Used Administrator to administer the locks on the jobs and other Administration activities for DataStage Server.
- Developed UNIX shell scripts to automate the Data Load processes to the target
- Performance Tuning of Jobs, Stages, Sources and Targets.
- Created PL/SQL Procedures/Functions to build business rules to load data.
- Extensively used DataStage Director for Job Scheduling, Emailing production support for Troubleshooting from LOG files
- Responsible for the design of jobs and delivering the Business data for the target from existing data sources.
- Extensive knowledge in Property Casualty insurance.
- Good understanding between OLTP and OLAP.
- Conversion from IMS to DB2
- Assisted operation support team for transactional data loads in developing SQL Loader & Unix scripts
- Monitored and maintained database development and integration environment.
- Developed user defined Routines and Transformations using Ascential DataStage Manager
- Used import/export utilities to transfer data from production instance to the development environment.
- Used DataStage Administrator to setup DataStage projects and defined DataStage user profiles and assigned privileges.
Environment: DataStage 7.5.2, Quality Stage, WISD, COBOL, IMS, Sybase, TeradataV2R6, TeradataAssistant7.X, UNIX
Project Title: CRM Migration Apr’07 to Jul’07
Description:
American International Group (AIG) is in the process of implementing the Customer Relationship Management system. This involves migrating the customer, policy, product, campaign data to CRM system, and take the data like incidents, call details, prospects, and applicants to Data Ware House. Involved currently in analyzing the source systems and finding out the feasibility of moving the data to CRM System
Roles & Responsibilities:
- Involved in all the phases of the SDLC requirement gathering, design, development, Unit testing, UAT, Production roll-out, enhancements and Production support.
- Interacting with the business representatives to understand the requirements and determine the best approach for timely delivery of information. Writing the Software Requirement Specification for the Business requirement.
- Ensuring timely deliveries of work items to the Client.
- Involved in Implementing ETL standards and Best practices.
- Used the DataStage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
- Created Web Services using RTI (real time integration).
- Reusing the logic from DataStage jobs in real time.
- Extensive Knowledge on Deploying the RTI jobs as Web service using the RTI console.
- Expertise in creating new services , adding support for service bindings with SOAP messages format to RTI server
- Developed DTS Packages and SQL Scripts to transfer data from Source files to Oracle database.
- Developed jobs using different types of stages -- Sequential File, Transformer, Aggregator, Merge, IPC, Link Partitioner and Link Collector and Hashed File.
- Extensively worked on Error handling, cleansing of data, Creating Hash files and performing lookups for faster access of data.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements. Created Re-usable repository and routine using DataStage Manager.
- Extensively used DataStage Director for Job Scheduling, emailing production support for troubleshooting from LOG files.
- Developed Routines using DataStage BASIC programming language.
- Worked with DataStage Administrator to create/modify/delete projects and cleanup projects and Implemented security among DataStage users and projects
- Migrated jobs from development to QA to Production environments.
- Defined production support methodologies and strategies.
- Logging in the different issues related to the development phase.
Environment: DataStage7.5.2, Linux, Control-M, Windows 2003 Oracle 8i, Sybase and SQL server
Confidential, Los Angels, CA Oct’05 to Mar’07
DataStage Consultant
Project Title: SAP - AC Migration
Description:
Confidential, is seeking to replace its existing Accounts Receivable and billing systems with SAP based solution and hence it is imperative that legacy data needs to be migrated. The source data exists in multiple environments such as IMS database, VSAM files, Sybase and DB2. This requires not only to transfer the data but also to convert the data in-line with SAP format.
Roles & Responsibilities:
- I have good experience in sitting with business users and collecting requirements and transforming the same and designing and mapping sheets.
- Involved in designing the job flow with the mapping given by the business users.
- Involved in developing jobs with the created design documents
- Used Audit Sequence Jobs to run Each and Every DataStage job which generates Audit key which will be used in Audit purpose.
- Wrote batch scripts to trigger the data stage jobs from the transformer stage.
- Also involved in assigning roles to the users created in SAP using the different user defined BAPI.
- Used ABAP and BAPI stages to extract and load the data into SAP system
- Performance tuning in UNIX environment to increase the performance of the jobs.
- Familiar with import/export of DataStage Components (Jobs, Routines, DSTransforms, Table Definitions etc.) between DataStage Projects, multiple jobs compile utility with use of Data Stage Manager.
- Used Shared container for simplifying design and easy maintenance purpose.
- Wrote User defined Routines implement complex business rules in DataStage application.
- Experienced in fine tuning, Trouble shooting, bug fixing, defect analysis and testing of DataStage Jobs.
- Used shell scripts to invoke DataStage jobs from command line. These scripts were scheduled using enterprise-scheduling tool, Autosys
- Used DataStage Director to Unlocked Jobs (Recourses Lean up), Monitoring jobs and Managing Logs.
- Worked on DataStage Version control for initializing and promoting jobs between different environments.
- Documented the development process and performed knowledge transfer to Business Intelligence team.
Environment: DataStage 7.5., IBM AIX 5.2, Sybase,DB2,SQL, PL/SQL, Java,UNIX Shell Scripting, AWK, SAP R/3, Data Stage Version Control
Project Title: FPPS Fire Policy Processing System, Aug’04 to Sep’05
Sr. Datastage Developer
Description:
This is an insurance project mainly to deal with Insuring Households & assets. Functionality involves Data capturing, Creating new business, changing the existing policies. Validation of policies using Rate & Rules, underwriter’s acceptance, premiums determination, Interfaces with other systems, Etc.
Roles & Responsibilities:
- Used the DataStage Designer to develop jobs, DataStage Director and the runtime engine to schedule and run of the jobs, testing and debugging its components.
- Used DataStage Manager for Exporting and importing the jobs between the production and the development servers.
- Performance tuning in UNIX environment to increase the performance of the jobs
- Designed and developed DataStage server routines for implementing complex business rule and logic
- Extensively worked with Parallel Extender/Enterprise Edition (EE) using Parallel Processing (Pipeline and partition parallelism) techniques to improve job performance while working with bulk data sources.
- Also done production support work once the code is into production
- Tune Hash file for better look ups and hosting slowly growing dimensions tables in a star schema warehouse design.
- Extensively used Join, Look Up, Change Capture, Pivot and Merge stages to meet business requirements.
- Worked on Enterprise level Scheduling tool-control M to kick off the shell script to run DataStage Job on nightly basis.
- Validating the data at the database side using SQL Worksheet, TOAD.
Environment: Datastage 7.5, Oracle 9i, Business Objects5.1, SQL, PL/SQL, SQL Loader, ERWIN, AWK, Autosys
Confidential, PA May’03 to Jul’04
Datastage Developer
Project Title: Sales and Marketing.
Description:
Confidential, designs, builds, and manages mission-critical environments for businesses and governments who have no room for error. This project involves in developing enterprise data warehouse in oracle as database for Unisys to view day to day sales and growth rate in the business. The operational data comes from Oracle, SQL Server and Flat Files. This data is transformed into business requirements and loaded into Oracle data warehouse for forecasting, designing business model, cost and expenses analysis for better utilization of resources, distribution of historical sales, financial and Sales information data to brokers, Dealers and financial centers.
The scope of the project is to integrate the Global Strategic source Data warehousing, dragons take external purchases and inter company transactions that are provided by the origins.
Responsibilities:
- Co-ordination of work between Onsite and Offshore
- Transition of the ongoing projects from current team
- Gathering detailed requirements from the Client for enhancing the jobs as required.
- Developed and implemented various server jobs to perform ETL based solution for data extraction from legacy systems.
- Also done production support work once the code is into production
- Used DataStage Manager for Exporting and importing the jobs between the production and the development servers.
- Performance tuning in UNIX environment to increase the performance of the jobs
- Developed jobs using different types of stages Sequential File, Transformer, Merge, IPC, Link Partitioner and Link Collector and Hashed File.
- Running, monitoring of the jobs using Data Stage Director and checking logs
- Optimizing/Tuning the jobs for better performance and efficiency.
Environment: Datastage7, Oracle 8i & Windows NT
Confidential, Atlanta May’02 to Apr’03
Informatica Developer
Project Title: Data Mart for Materials Management.
Description:
The Company\'s portfolio includes office furniture, furniture systems, interior architectural products, technology products and related products and services. Data mart development for Inventory Control System is on Oracle 8 running on Windows NT. The subject areas for the Data Mart are Vendor, Parts, Region and Sales. This Data Mart was developed to facilitate better decision-making and to optimize inventory levels. Informatica was used to design mappings and to load target.
Responsibilities:
- Created the mappings, reusable transformations.
- Designed and developed the complex aggregate, join, look up transformation rules (business rules) to generate consolidated (fact/summary) data identified by dimensions using Informatica ETL (Power Center)tool Monitoring the Workflows, Worklets, tasks using Workflow Monitor Tool.
- Created the mappings, mapplets and added transformations. Implemented performance tuning including optimization of target databases and sessions using Informatica – Power Center.
Environment: Informatica 6.x, Oracle8i, Windows NT
Confidential, India Sep’01 to Apr’02
Application Developer
Project Title: Pharmacy Management System.
Description:
The Confidential, aims at providing robust computerized system for maintaining the transactions of medical distributors. The aim of “Pharmacy Management System” is to provide user-friendly interface, which can be easily dealt by people who does not have much knowledge in computers. The interface is provided with relevant controls and names right from login screen till to the report generation screen.
Responsibilities:
- Involved in the requirement analysis
- Developed the forms and reports
- Created the test cases for identification of the bugs.
- Involved in Integration, testing and functional testing.
- Review of the test cases written for unit and integration level
Environment: Visual Basic6.0, Oracle 8i, Windows 2000
EDUCATIONAL QUALIFICATIONS:
- Masters in Business Administration
CERTIFICATIONS:
- IBM Certified Solution Developer -- Websphere IIS DataStage Enterprise Edition V7.5
