Datastage Developer Resume
Malvern, PA
SUMMARY
- Over 7 years of IT experience in the Design, Development and testing of ETL methodologies using IBM InfoSphere DataStage 8.x/7.x.
- Strong working experience on Data Warehouse applications using ETL Tool, PL/SQL, and UNIX Shell Scripts.
- Expertise in working with IBM Datastage Administrator, Manager, Designer, Director and Parallel Extender.
- Experience in Design, Development, and Testing ETL process using IBM Web sphere DataStage.
- Extensive experience in using ETL methodology for supporting data extraction, transformation and loading processes by using IBM InfoSphere Datastage 8.5/8.1/7.5.2/5.
- Experience in developing various parallel jobs using various stages such as Transformer, Aggregator, Sort, Join, Funnel, Lookup, Pivot, Dataset, Filter, Change Capture stage and Change Apply stage.
- Experience in creating ETL processes to ensure data integrity (error handling) and document appropriate procedures.
- Strong understanding of the principles of DW, and Fact tables, Dimension tables in Star and snowflake schema modeling.
- Good working experience with Enterprise Edition/Parallel Edition stages like Complex Flat File, Sequential file, Datasets, Transformation stage, Filter stage Modify, Copy, Change Capture, Row Generator and many other stages in designing and developing ETL process.
- Experience in developing jobs based on the joining of data operations using various stages like Join stage, Merge stage, Lookup stage.
- Extensive experience working on CDC and Slowly Changing Dimensions techniques to maintain the historical details of the data.
- Experience in extracting data from various database sources Oracle 11/10g/9i, DB2, SQL Server, Teradata, EBCDIC files, Sequential files, data sets, etc.
- Experience in new enhancements in the IBM Websphere DataStage - Multiple Job Compile, Surrogate key generator Stage, Job Report, Message handler options.
- Experienced in scheduling server and parallel jobs using DataStage Director, UNIX scripts.
- Technical and analytical skills with clear understanding of design goals of ER modeling for OLTP and dimension modeling for OLAP.
- Strong Knowledge in using SQL, PL/SQL to write stored procedures, functions, and triggers.
- Experience in providing support in Dev, QA and prod environments.
- Excellent communication, interpersonal, analytical skills and strong ability to manage and motivate the team.
TECHNICAL SKILLS
ETL Tools: IBM InfoSphere DataStage 8.5/8.1, Ascential DataStage 7.x, (Designer, Director, Administrator, Manager).
Data Modeling: Data Modeling, Star Schema Modeling, Snow-Flake Modeling, Fact and Dimensions, Physical and Logical Data Modeling.
Databases: Oracle 10g/9i/8i, IBM DB2/UDB, Teradata, SQL Server 2003/2005/2008.
Tools: SQL Plus, SQL*Loader, TOAD.
Operating system: IBM AIX 5.2/4.x, Linux, Windows 2000/2003/XP.
Languages: SQL, PL/SQL, Unix, Shell Scripting, Java, HTML, XML
PROFESSIONAL EXPERIENCE
Confidential, Malvern, PA
DataStage Developer
Responsibilities:
- Preparation of technical specification for the development of Extraction, Transformation and Loading (ETL) jobs to load data into various tables in Data Marts and define ETL standards.
- Involved in understanding the scope of application, present schema, data model and defining relationship within and between groups of data.
- Interacted with business analysts and data modelers for better understanding of business requirements.
- Worked with data architects and subject-matter experts to design comprehensive solutions.
- Used the DataStage Designer to design jobs for extracting, transforming, integrating, and loading data into data warehouse database.
- Used ETL process to transform a variety of financial transaction files from different product platforms into standardized data mart.
- Analyzed, designed, developed, implemented and maintained Parallel jobs using Enterprise Edition of DataStage.
- Developed parallel jobs using various Development/debug stages (Peek stage, Head & Tail Stage, Row generator stage, Column generator stage, Sample Stage) and processing stages (Aggregator, Change Capture, Change Apply, Filter, Sort & Merge, Funnel, Remove Duplicate Stage).
- Used Storage Procedure stages to run the stored procedure from the datastage jobs.
- Created sequencers and schedules to sequentially execute the designed jobs. Used Execute Command Activity Stage, Notification Activity Stage, job activity, routine activity, wait for file activity stage and sequencer stages to implement these sequencers.
- Worked on troubleshooting, performance tuning and performance monitoring for enhancement of DataStage jobs.
- Preparing the source to target mapping documents, Technical design document, Unit Test cases and UAT Test cases.
- Used the Version Control to migrate the jobs from DEV server to QA and PROD
- Done performance tuning and improved the job completion timings.
Environment: IBM Info Sphere 8.5/8.0, IBM DB2, Oracle 10g/11g, SQL Server, SQL Programmer, SunOS, PVCS, Hummingbird Connectivity, Unix Shell scripting
Confidential, Dear Born, MI
DataStage Developer
Responsibilities:
- Designed the ETL Process flow for the Data warehouse projects.
- Worked with Business people, business analysts, data architects in analyzing the source systems data and designing the database entities and there attributes.
- Worked with architects and subject-matter experts to design comprehensive solutions.
- Debugging and providing solutions for complex datastage jobs and complex processes.
- Reviewed ETL Process, Job design and Datastage ETL / PLSQL Job code.
- Designed and developed jobs using Datastage tool Extraction, Transformation and Loading Data from various source systems to ODS & Data warehouse.
- Analyzing and Defining X-Paths (XML File Definition) for XML files and processing XML Files in Datastage. Reading XML Files from MQ stage.
- Tuning ETL Process and Datastage Jobs for better performance.
- Used FAST Export and Multi Load utilities to load both transactional data and historical data into Teradata
- Worked on jobs using different stages like Join, Sort, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup File Set, Change Data Capture, Modify, Complex Flat File, and Aggregator.
- Developed Common UTL - ETL Module Jobs, and PLSQL Procedures for Error Info Logging.
- Involved in creating Autosys for Scheduling the Job dependencies and Timings.
Environment: IBM InfoSphere DataStage 8.5/7.5/7.2/7.1, Oracle 10g, DB2 UDB, TeraData V2r5, PeopleSoft, Mainframe, PL/SQL, Autosys, Erwin 4.2, TOAD, SQL Developer, Ms Visio, Shell Scripts, Hummingbird 11.0, HP Unix, Windows XP.
Confidential, Chicago, IL
DataStage Developer
Responsibilities:
- Used the Datastage Designer to develop processes for Extracting, Cleansing, Transforming and Loading data into Oracle Database.
- Used different stages of Datastage Designer like Lookup, Join, Merge, Funnel, Filter, Copy, Aggregator, Sequential files and Sort.
- Developed several jobs to improve performance by reducing runtime using different partitioning techniques.
- Used Information Analyzer to gather and analyze the technical metadata characteristics of the data.
- Used Datastage Director for validating, execution, monitoring jobs and check the log files for errors.
- Used stage variables for source validations, to capture rejects and used Job Parameters for Automation of jobs.
- Created Project Level Parameter Sets.
- Migrated Jobs among different environments.
- Performed unit testing of all monitoring jobs manually and monitored the data to see whether the data is matched.
- Developed UNIX scripts to automate the Data Load processes to the target Database file.
- Used DataStage Director and the runtime engine to schedule running the solution, testing and debugging its components and monitoring the resulting executable versions.
- Used ODBC stage to do Extraction/loading/Lookup/manipulating of data.
- Used several stages in Sequencer like Abort Job, Wait for Job and Mail Notification stages to build an overall main Sequencer and to accomplish Re-start ability.
Environment: IBM Information Server DataStage 8.1 Enterprise Edition(Parallel extender) Oracle, SQL, Microsoft Visio, Erwin 4.0, Windows NT 4.0 sp 6a, IBM AIX, Cognos, Autosys scheduler.
Confidential, Cincinnati, OH
DataStage Developer
Responsibilities:
- Worked with various sources such as Oracle DB, Access mdb, Flat files to extract data and used IBM WebSphere DataStage to load the data into Data Warehouse built on Oracle.
- Used the DataStage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
- Designed various procedures for getting the data from operational systems in to Data Warehousing system.
- Designed the Data Mart model with Erwin using Star Schema methodology.
- Extensively used various stages and transforms of the DataStage Server jobs for various types of date conversions.
- Documented the metadata to capture from the sources.
- Created sessions and batches to extract the data.
- Closely worked with Autosys mid support team for setting up production job cycles for daily, monthly, weekly loads with proper dependencies.
- Created jobs using Data Stage Designer and used Datastage Director to validate schedule run and monitor the Data Stage jobs.
- Metadata was stored in the repository and is imported using the Data Stage Manager.
Environment: IBM Web Sphere Data Stage Version 7.5 (Director, Designer, Manager), MetaStage, Oracle 10g, Autosys, PL/SQL, SQL Developer, SQL*Plus, Red Hat Enterprise Linux AS, Windows Server 2003.
Confidential
Database Application Developer
Responsibilities:
- Developed the database using ER Model.
- Stored procedures and triggers were developed to maintain integrity of the database.
- Designed forms for data entry, sales information and validation.
- Created Oracle PL/SQL procedures to compare various schemas and return differences in table and index definitions.
- Created various Oracle PL/SQL procedures to assist the testers in the validation of various test cases and system tests.
- Generated custom reports to track sales progress, to print bills and generated vouchers
- Created indexes for fast retrieval of information.
- Backup and recovery was performed on weekly, monthly basis.
- Involved in extracting the data from different data sources like Oracle 8i and flat files.
- Involved in extracting the data from staging to Relational.
- Involved in creating and maintaining Sequencer and Batch jobs.
- Used designer and director to schedules and monitor resulting executable versions.
- Creating local and shared containers to facilitate ease and reuse of jobs.
- Managing Repository Metadata from Manager.
- Performed Unit Testing and Integration.
Environment: Oracle 9i, Oracle Forms 6i, PL/SQL, TOAD, SQL Developer, Shell scripting (Bourne and Korn), SQL*loader, Stored Procedures/Triggers, XML, Windows XP.