Etl Lead & Production Support Resume
SUMMARY
- Around 9 years of IT experience in working with DataStage 11.3,9.1,8.7,8.5, IBM InfoSphere DataStage 8.1, DataStage 7.5.2 PX, DataStage 7.5(Server), Netezza, SQL, Teradata, UNIX Shell script
- Extensive experience in developing strategies for Extraction, Transformation, Loading (ETL) data from/to various sources into data warehouse and data marts using data stage
- Extensive noledge of ETL tool - DataStage and Netezza data warehouse appliance
- Good noledge of ETL tool - Informatica 8.6.0
- Strong Knowledge in Data Warehousing concepts, Business Intelligence, OS and DBMS, UNIX
- Data Stage Proficiency in designing jobs that extract, integrate, aggregate, transform data, create, manage, reuse metadata, validate, schedule, run and monitor jobs
- Experience in Technical Areas like Analysis, Design, programming, code reviews, Configuration control, Estimation and Testing
- Creating and use of stage variables and Implementation of parameter mechanism including Environment variables, system variables & Job parameters
- Good experience creating new DataStage projects and creating user defined environment variables at project level as an admin from DataStage administrator.
- Hands on experience in creating new users and assigning required DataStage projects access to teh users.
- Good experience in creating UNIX folder structure and setting up teh project level parameters.
- Hands on experience in writing complex SQL queries and good noledge in PL\SQL
- Hands on experience in working with Netezza data base and provided support in Netezza upgrade
- Expert in production support activities and resolving production issues in time
- Expert in developing in UNIX Shell Scripts and trouble shoot.
- Proficient in using ERWIN 4.1,7.0 Tool for Logical and Physical Data Model
- Hands on experience in starting and stopping DataStage application for maintenance.
- Hands on experience in installing DataStage client 8.1,8.5
- Hands on experience in installing Erwin data model client versions on remote desktops.
- Hands on experience in changing teh service level account passwords at regular intervals.
- Exposed to various domains of data warehouses like Retail & Logistics, Telecom and Manufacturing
- Good Knowledge in Data Warehousing Architecture, Data Marts, Normalization Forms, Star Schema, Snow Flake Schema
- Actively involved in customer meetings to understand business needs and timely changes to teh initial requirements
- Experience in managing teams & client interactions
- Good analytical and troubleshooting skills
- Highly motivated, dependable problem-solver with teh ability to learn new technologies quickly even without formal trainings
- Played active role in various phases of Software Development Life Cycle including Analysis, database designing, coding and testing
- Proven problem solving and programming skills
TECHNICAL SKILLS
ETL Tools: IBM InfoSphere DataStage 11.3, 9.1, 8.7, 8.5, 8.1, 7.5 PX/ Server, Informatica 8.0.
Database: Netezza, Oracle 11g/10g, SQL Server 2008/2005
Languages: SQL, UNIX Shell, C, C++
OS: Windows 7, Windows XP/2003 Server, UNIX
AIX: Linux, bash, Korn, Unix Shell scripting
BI Concepts: OLTP, OLAP, Dimensional Modeling.
PROFESSIONAL EXPERIENCE
Confidential
ETL Lead & Production Support
Responsibilities:
- Working with Confidential GC which deals with teh store operations
- Actively participated in client meetings to gather and document teh business requirements and developed teh design specifications
- Performed requirement analysis and extensively worked with business customers to identify teh different sources of data in operational systems
- Coordinating &managing offshore team on daily basis and assigning task to them.
- Good experience in starting and stopping teh data stage applications to do any software upgrades like AIX, sudo, ssh updates
- Worked on creating teh new DataStage projects from DataStage administrator based on teh client requirement and allocating permissions to teh users and creating teh user defined environment variables at project level.
- Responsible for writing Shell scripts to import and export teh files from SFTP server and loading them into teh respective target tables.
- Developing teh design and source to target data mapping documents as per teh business requirements
- Used different types of Stages in server and parallel extender such as FTP, Sort, Transformer, Lookup, Join, Peek, Merge, Aggregator, Row Generator, Netezza Enterprise and DRS to develop and design different jobs as per specific user requirements
- Extensively used IBM Data Stage 9.1,8.5 - Designer, Manager and Director for creating and implementing various Data stage jobs
- Worked on developing of DataStage Jobs that includes extracting data from XML files and load into DWH and vice versa loading EDW data into XML files and exporting data to different third party systems
- Worked with business users to fix defects and implemented teh best practices for conducting Unit Testing and Integration Testing
- Responsible for documenting teh Unit test results and coordinating UAT
- Involved in daily meetings with teh client for requirements and provide services to meet teh required SLAs
- Responsible for production migration of Data Stage jobs from development to production environment by exporting and importing data stage jobs
- Used Data Stage Director and teh runtime engine to schedule running teh server jobs, monitoring scheduling and validating its components
- Provided technical support to team members for designing and developing Data stage jobs
- Worked on scheduling jobs in CRONTAB, based on teh requirements
- Creating teh ERWIN data model and updating teh data model at regular interval..
Environment: IBM DataStage 9.1,8.5,8.0, Informatica 8.6.0, Netezza, Oracle 10g/11g, SQL Server, UNIX Shell scripting, Windows XP Professional. Windows 7.
Confidential
Sr. ETL Developer
Responsibilities:
- Worked for Musicians friend (MF) which deals with teh online transactions
- Developing teh design and source to target data mapping documents as per teh business requirements
- Used different types of Stages in server and parallel extender such as FTP, Sort, Transformer, Lookup, Join, Peek, Merge, Aggregator, Row Generator, Netezza Enterprise and DRS to develop and design different jobs as per specific user requirements
- Extensively used IBM Data Stage 8.5 - Designer, Manager and Director for creating and implementing various Data stage jobs
- Worked on developing data mapping, workflows & Session's in Informatica 8.6.0 to extract data from different sources and load into DWH
- Responsible for designing Parallel and Server Data Stage jobs to extract, cleanse, transform and load data from various source systems into teh DWH
- Worked on developing of DataStage Jobs that includes extracting data from XML files and load into DWH and vice versa loading EDW data into XML files and exporting data to different third party systems
- Worked with multiple database structures and performed extraction of legacy data and load into Netezza target database
- Responsible for writing complex queries within databases as well as in Data Stage to perform teh ETL procedures
- Responsible for writing Shell scripts to import and export teh files from SFTP server and loading them into teh respective target tables.
- Developed shell scripts to backup and clean teh files from server on regular basis (weekly/Daily) based on business requirement.
- Extensively worked with teh performance tuning of Data Stage jobs, ETL Procedures teh SQL queries used in transformations
- Responsible for documenting teh Unit test results
- Used teh Data Stage Director for monitoring teh jobs and debugging teh issues
- Used Data Stage Director and teh runtime engine to schedule running teh server jobs, monitoring scheduling and validating its components
- Provided technical support to team members for designing and developing Data stage jobs
Environment: IBM DataStage 8.5, 8.0, Informatica 8.6.0, Netezza, Oracle 10g/11g, SQL Server, UNIX Shell scripting, Windows XP Professional. Windows 7.
Confidential
ETL/Production Support
Responsibilities:
- Identification of failed/incomplete load/extraction Data Stage jobs within one hour of time
- Analyze failed data loads/extracts and take necessary actions to fix/restart/rerun failed/incomplete load jobs based on run-book. For cases where teh resolution includes actions previously identified, those actions should be taken before contacting teh appropriate Data Stage Support team member(s) to restart teh process
- Scheduling and sequencing teh jobs according to teh requirement
- Understanding teh business model and customer requirements
- Develop/follow PM USA approved processes for solving, reporting, escalation load/extraction issues
- Provide PM USA by teh end of teh first week of each month with monthly reporting outlining problems/fixes/escalations which occurred during teh previous month
- Maintain teh run-book document that contains teh schedule of all production job sequences, teh frequency and time they are set to run, and details on each step; update teh noledge-based area with resolutions to problems encountered by teh monitoring staff. Documentation must be updated within 24 hours of a change or addition. Immediate notification must be made to teh Data Stage monitoring resources.
- Make adjustments to production job sequences as needed to correct failures in data loads. Adjustments must be made, documented, and communicated to teh Data Stage Monitoring resources before next scheduled load
- Extract data from source transform and load into Oracle target database
- Extensively used Data stage Designer for creating and implementing jobs
- Involved in Extracting data from Flat files
- Create and monitor sequences using Data stage sequencer
- Involve in Unit testing and System integration testing
- Identifying and killing processes which are idle for a period of 48 hours
Environment: Ascential DataStage PX 7.5.2/7.5, Windows XP, Teradata, SAP, Solaris.
Confidential
ETL / Data Migration
Responsibilities:
- Involved in importing metadata from repository
- Extracting teh data using DataStage parallel jobs from sequential files, oracle tables
- Developed containers for replacing of server Orabulk jobs
- Developed jobs for hash files replacement by using change capture, change apply stages
- Used Data Stage Director to validate, run, and monitor teh Jobs
- Worked on Unit Testing, UAT
- Maintaining standards (naming convention) and Quality
- Jobs created like DB Link Jobs, SAP Jobs and Transaction jobs for data loading
- Performed debugging using Peek stage
Environment: Ascential DataStage PX 7.5.2, TOAD 8.6, Windows XP, Oracle 9i, UNIX.
Confidential
ETL / Developer
Responsibilities:
- Understanding teh business model and customer requirements
- Giving solutions to teh customer based on teh requirements
- Involved in extracting teh data from source tables
- Developed jobs using various stages-Transformer Stage, Hashfile Stage, Aggregator Stage, Oracle, Sequential File
- Constructing containers, transformations and functions for repeated task to simplify teh developer task.
- Developed Sequences and Used different Stages like Execute Command, Job Activity, Notification Activity, Routine Activity, Sequencer, and Wait For File Activity stages
- Scheduling and sequencing teh jobs according to teh requirement
- Analyzing teh existing system and its documentation
Environment: Ascential DataStage 7.5., Windows XP, Oracle 8i, UNIX.