Sr. Datastage Developer Resume
Tampa, FL
SUMMARY:
- 8 years of experience in IT industry especially in client/server business systems and Decision support Systems (DSS) /Enterprise Data Warehouse (EDW) Analysis, Design, Development, Testing and Implementation
- 7 years of experience in populating and maintaining Data Warehouses and Data marts using IBM Information Server v8.0.1/v8.1.1, Ascential DataStage v7.5.x/7.x (Administrator, Director, Manager, Designer) - Server Edition, Enterprise Edition (Parallel Extender), and Quality stage.
- Involved in all the phases of SDLC: Requirement gathering, Design, Development, Unit testing, UAT, Production roll-out, Enhancements and Production support
- Worked as offshore co-coordinator with responsibilities such as providing solutions for the issues/troubles/technical difficulties that offshore team has on top of design documents, source to target mappings
- Expertise in Relational Database Modeling and Dimensional Modeling - Star schema, Snow-Flake schema, and hands on experience in data modeling tools ERwin / Microsoft Visio
- Experienced in troubleshooting DataStage jobs, enhancement of jobs and addressing production issues like Performance tuning and Enhancement
- Optimized DataStage jobs utilizing parallelism: Partitioning and Pipelining features of Parallel Extender
- Extensively worked on using ABAP Extracting Stage, IDoc Stage, and BAPI Stage.
- Experience in designing Job Batches and Job Sequences for scheduling Server and Parallel jobs using DataStage Director, UNIX scripts
- Experience in migrating ETL code to upgraded version
- Familiarity with Data Warehouse Data Reconciliation Methodology
- Experience in programming using SQL, PL/SQL, and UNIX Shell Scripting
- Extensive experience in Microsoft SQL Server 2005/2000, IBM DB2 UDB 8.0/7.0, TeraData, Oracle 10g/9i/8i., Informix, XML files
- Worked with Teradata Load utilities like Multi Load, Fast Load, BTEQ and Fast Export.
- Experience in Scheduling DataStage jobs using Control-M, Autosys
- Knowledge on designing and developing reports using BI/OLAP tools like Business Objects and Cognos
- Involved in Documentation of ETL process following the standard naming conventions used in DataStage
- Excellent communication and interpersonal skills, teamwork, problem solving skills, flexible, self-direct and energetic person
- Installation, configuration, setup and Administration of DataStage Server
- Experience in DataStage Administrator to create/modify/delete projects, add DSN entries and cleanup projects and Implemented security among DataStage users and projects
TECHNICAL SKILL SET:
ETL Tools: IBM Information Server 8.0.1/8.1.1/8.5 , Ascential DataStage 7.5.x/7.x/6.x, Quality stage
Data Modeling Tools: ERwin 4.2, Microsoft Visio Professional
BI/ OLAP Tools: Business Objects, Cognos
Databases and Tools: Oracle 11g/10g/9i, SQL Server 2005/2000, DB2, MDM, Informix, Teradata v2r12/v2r13, DB Visualizer, TOAD
Application Software: MS Project 2003, MS Office Suite 2003/2007, OpenOffice Suite
Operating Systems: Microsoft Windows 2003 Server/XP/2000/98/95, UNIX(AIX/HP/ Solaris)
Languages: SQL, PL/SQL, Unix Shell Scripting/C++, XML
Networking: FTP, SFTP, Telent
PROFESSIONAL EXPERIENCE:
Confidential, Tampa, FL
Sr. DataStage Developer
Responsibilities:
- Involved in development phase meetings for and requirements document reviews.
- Prepared Technical Specification Documents for the Jobs and their reviews.
- Extensively involved in Reconciliation process and Recovery process for capturing the incremental changes in the source systems for updating in the staging area and data warehouse respectively.
- Building the SQL queries for Oracle to fetch the data from the Database as per the business requirement and use the SQL queries in the DataStage for further processing.
- Designed and developed Jobs that extract data from the Oracle database, cleanse it, transform it as per business requirement and populate it back into Oracle Database.
- Used DataStage Director to Run and Monitor the Jobs performed, automation of Job Control using Batch logic to execute and schedule various DataStage jobs.
- Developed and produced many outbound reports for Daily basis for every participant based on daily submission of trades.
- Worked Extensively on DataStage Director for scheduling the Job to run, emailing production support for troubleshooting from LOG Files.
- Developed SQL Queries for implementing Complex business rules and transformations.
- Generated completion messages, status reports using capabilities of Job Control Sequence and UNIX.
- Involved in Quality Stage to perform Data Investigation, Data Standardization etc.
- Extensively made use of different rule sets and also customized rule sets for globalised data.
- Responsible for migrating the complex jobs and redesigned them in IBM Information Server.
- Wrote the shell scripts (CRON Tab) to automate the jobs in production server.
- Extensively involved in Fine tuning the jobs. Mentor development team on Data Stage, Oracle and DB2 UDB, Shell Scripts and Finance data.
- Developed user defined Routines and Transformations for implementing Complex business logic.
- Writing UNIX scripts and scheduling those using JILs as per the business SLA.
Environment: Ascential Datastage 8.5 (Quality Stage, Parallel Extender), Oracle 10g/9i, SQL Server, DB2 UDB, SQL, Flat Files, UNIX scripting, ETL.
Confidential, TN
Sr. DataStage Developer
Responsibilities:
- Designed and customized data models for Data warehouse supporting data from multiple sources on real time.
- Developed and designed Data marts extensively using Star Schema.
- Project Life Cycle - from analysis to production implementation, with emphasis on identifying the source and source data validation, developing particular logic and transformation as per the requirement and creating jobs and loading the data into different targets.
- Designed, developed DataStage jobs, enabling the extract, transport and loading of the data into target tables.
- Understood functional documents for new business source systems and applications and their integration into the existing DWH.
- Wrote the Design documents and specifications in accordance with Apria Healthcare’s design frameworks and best practices.
- Defined the Mapping and Test Case documents.
- Identified source systems connectivity, related tables and fields and ensure data suitability for that job.
- Extensively analyzed the Data Sources in identifying data anomalies, patterns, value ranges.
- Used Data Stage Enterprise Edition/Parallel Extender stages namely Datasets, Sort, Lookup, Peek, Standardization, Row Generator stages, Remove Duplicates, Filter, External Filter, Aggregator, Funnel, Modify, and Column Export in accomplishing the ETL Coding.
- Developed DataStage job sequences used the User Activity Variables, Job Activity; Wait for File stages, Execute Command, Loop Activity, and Terminate.
- Wrote Extensive Unix scripts for running the DataStage jobs, used awk utility for validating data.
- Undertook Change and Enhancements request.
- Tuned DataStage jobs to enhance their performance.
- Involved in writing, testing and implementation of the triggers at Database level using PL/SQL.
- Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions.
- Wrote Release notes, Deployment documents and scheduled the jobs.
- Wrote DDL scripts for creating, altering tables.
Environment: IBM DataStage 8.5/8.1.1 DataStage and QualityStage, Oracle 11g, DB2 9.1, WAS 6.0.2.27, Java, J2EE, SQL, PL/SQL, XML, TOAD, Autosys, Shell Scripts, Windows XP, Unix (AIX 6.1/Solaris 9) and SUSE Linux 10.
Confidential, Hartford, CT
Sr. DataStage Developer
Responsibilities:
- Involved in detailed project implementation discussion and all other phases of SDLC of implementing data warehouse.
- Involved in getting the detailed business requirements for the process.
- Worked on creating the technical design and source to target mapping document for different subject areas.
- Created the ETL detailed design document for all the process and coordinated with the off-shore team on day-to-day development activities.
- Worked with DS Admin on setting DB2 Enterprise stage, which can be used to load high volumes of data.
- Extensively worked on active and passive stages like DB2 Enterprise stage, Oracle EE, ODBC stage, Pivot, Transformer, Change Capture, Remove duplicates, Lookup, Join, Merge, Modify, Complex Flat files (CFF), Filter etc.
- Involved in DataStage upgrade from 7.5.1 to DataStage 8.1.
- Used Quality Stage for standardizing, pattern match, debug and to clean the source.
- Created stored procedures in Sybase and Oracle for extraction and insertion of data.
- Worked on Source to Target Mapping (STT) document to map legacy fields to the target SAP R/3 system.
- Built DataStage jobs to take advantage of DataStage parallelism techniques.
- Used Version Control for DataStage to track the changes made to the DataStage project components and for protecting jobs by making read only.
- Worked on building DataStage Jobs to source data from heterogeneous systems and load into DB2.
- Developed Autosys jobs for scheduling and running the Data stage jobs in Production Environment.
- Migrated DataStage jobs, UNIX scripts from DEV to QA to PROD. Involved in Production support.
Environment: IBM WebSphere DataStage and QualityStage 8.0.1, Ascential DataStage 7.5.1, DB2 8.9/9.7, AIX 5.3, COBOL/MVS (mainframe jobs and for data extraction), Autosys4.5, Subversion, ERwin 6.0
Confidential, Hamilton, NJ
DataStage Developer
Responsibilities:
- As a Data Warehousing team member, Involved in designing, developing and testing of the ETL (Extract, Transformation and Load) strategy to populate the Insurance Data from various source systems feeds into Client Hub Database using Datastage Transformers, Routines and Unix Shell scripts.
- Involved in Data Profiling, Data Extraction, Staging, Transformation, Pre-Landing, and Landing into Client Hub Database and worked with DB2 Application Integration.
- Obtained detailed understanding of data sources, Flat files and Complex Data Schemas.
- Used DataStage as an ETL tool to extract data from sources systems and aggregate the data and load into the Oracle database.
- Moved data from Mainframe legacy VSAM data sets to Data Mart Application.
- Used Data Stage Manager for importing metadata from repository, new job categories and creating new data elements.
- Extensively involved in migration of projects from version 7.1 to 7.5.2.
- Extensively used Data stage Director for Job Scheduling, emailing production support for troubleshooting from LOG files.
- Used lookup stage with reference to Oracle table for insert/update strategy and for updating slowly changing dimensions
- Involved in performance tuning of the ETL process and performed the data warehouse testing.
- Developed jobs in Parallel Extender using different stages like Transformer,Remove Duplicates, Sort, Join, Merge, Lookup, Data Set, Funnel, Copy, Modify, Filter, Change Data Capture, Change Apply, Sample and Surrogate Key.
- Created Master Job control Job to run jobs based on dependencies.
- Designed server jobs for migrating data from staging area to warehouse to data marts
- Extensively worked in writing SQL Queries (Sub queries and Join conditions, correlated sub queries)
- Using DataStage Designer developed jobs using Sequential File, XML Input, XML Stage, DRS Stage, ORAOCI, Hashed File, IPC, Link Collector, Link Partitioner, Transformer, and Aggregator during ETL development.
- Extensively worked with DataStage Job Sequences to Control and Execute DataStage Jobs and Job Sequences using various Activities and Triggers.
- Used the Data stage Designer to develop various jobs processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database. Used Version Control for datastage to track the changes made to the datastage project components and for protecting jobs by making read only.
- Used the Data stage Administrator to assign Privileges to users or user groups (to control which Data Stage client applications or jobs they see or run), move, rename, or delete projects, and manage or publish jobs from development to production status.
- Appling patches to the ETL servers and Setting up the ODBC connections.
- DataStage server is backing up appropriately, and that recovery of DataStage server.
- Performing Unit Testing and integration testing
- Extensively used SQL Loader to load Oracle database
- Defined test scripts, test specs & testing methodologies.
- Modified existing Autosys jobs for scheduling the DataStage jobs with new parameters.
Environment: Ascential DataStage 7.5.x, Mainframe DB2, XML Plug-Ins, Version control, Oracle 10g, Autosys, PL/SQL, SQL Server, HP-UNIX and Windows NT.
Confidential
Programming Intern & DataStage Developer
Responsibilities:
- To study the business functions and flow control with various levels of users
- Responsible for designing the database based on the entities, attributes and the relationship between them and for creating database tables, views, and indexes
- Involved in Coding and Testing the Software. Was also involved in Creating Database and Users
- Completed performance tuning of database and application, optimization of queries and wrote database triggers, package procedures and functions
- Creating the table and writing the Database Triggers and stored procedures in Oracle and design the module using power Builder
- Developed complex reports using Reports 3.0 and PL/SQL
- Created DataStage server jobs to load data from sequential files, flat files and MS Access
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements
- Used the DataStage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data into different Data Marts
- Prepared Data Volume estimates
- Defined the data definitions, and created the target tables in the database
- Mapped the source and target databases by studying the specifications and analyzing the required transforms
- Used DataStage to transform the data to multiple stages, and prepared documentation
- The mappings were Unit tested to check for the expected results
Environment: Oracle 8i, Developer/2000 (Forms 4.5, Reports 2.5), PL/SQL, and SQL*plus, Ascential DataStage 7.x (DataStage Designer, DataStage Administrator, DataStage Manager, and DataStage Director), Windows NT, UNIX, Autosys 4
