Datastage Developer Resume Profile
Professional Summary:
- 8 years of experience in IT industry especially in Client/Server business systems and Decision Support Systems analysis, Development, Testing and Implementation.
- Over 8years of experience in working with ETL methodologies Data Extraction, Transformation and Loading to develop business intelligence for corporations using IBM Data Stage 8.5.x/8.x/7.5.x/7.0.x Designer, Manager, Administrator, Director .
- Experience in Evolving Strategies and developing Architecture for building a Data warehouse by using data modeling tool Erwin.
- Designed and Developed Data Models like Star and Snowflake.
- Excellent database migration experience in Oracle 7.x/8i /9i, DB2UDB, and SQL.
- Hands on experience in writing, testing and implementation of the triggers, Procedures, functions at Database level using PL/SQL.
- Expertise in working with various operational sources like DB2, DB2UDB, SQLServer, Oracle, Teradata, Sybase, Flat Files into a staging area.
- Proficiency in data warehousing techniques for data cleansing, Slowly Changing Dimension phenomenon, Surrogate key assignment, change data capture.
- Extensive experience in loading high volume data, and performance tuning.
- Played significant role in various phases of project life cycle, such as requirements definition, functional technical design, testing, Production Support and implementation.
- Extensively worked on Parallel Extender on Orchestrate Environment for splitting bulk data into subsets and to dynamically distribute to all available processors to achieve job performance.
- Experience in analyzing the data generated by the business process, defining the granularity, source to target mapping of the data elements, creating Indexes and Aggregate tables for the data warehouse design and development.
- Worked on Different databases DB2, Oracle, Sql Server, Sybase and database utilities Autoloader, Export, Imports, SQL Loader, Sync sort , SQL, PL/SQL Packages, Procedures and Functions for Back End Processes on UNIX machines.
- Knowledge of Data Warehouse Architecture and Designing Star Schema, Snow flake Schema, FACT and Dimensional Tables, Physical and Logical Data Modeling using Erwin and Designer 2000.
- Preparing job sequences for the existing jobs to facilitate scheduling of multiple jobs.
- Experience with UNIX shell scripting for Data validation and scheduling the DataStage jobs.
- Multilingual, highly organized, detail-oriented professional with strong technical skills.
- Good team player, extremely adaptable and fast learner.
TECHNICAL SKILLS | |
Methodologies | Software Development Life Cycle Management. |
ETL Tools | IBMInformationAnalyzer/IBMWebsphereDataStage8.x//7.5x2/7.x,Quality Stage, Informatica Power center 6.2. |
Reporting Tools | Business Objects 6.1, Cognos 7, OBIEE. |
Data model | Erwin 4.2 |
Operating Systems: | Windows XP, NT, Windows 95, MS-DOS, UNIX |
Languages: | PL-SQL, C, C , COBOL, HTML, JavaScript, VBScript, Unix Shell Scripts, Control -M. |
Databases: | MS-Sql 2005, ORACLE 8, 9i, 10g, 11g , DB2 DB2 V7, DB2V8, SQL, Teradata V2R6.1.0,V2R6.1.1,TD 8.0,TD 12.0 and MS- Access. |
Professional Experience:
Data Stage Developer
Description:
Confidential is one of the largest golf equipment and Apparel Company all over the world which designs and markets a complete line of golf products and has success on innovation of metal drivers. This Project is a software implementation project that will replace various instances of Comfil, MFG Pro, Oracle Financials, and PeopleSoft with a single global instance of Oracle EBS in Confidential Golf. To maintain the iSFA app for both Confidential and Confidential which allows the external TM sales reps to submit orders remotely with their own schemas using their ipadMigrating all the customer, products and orders data from 11g to 12g live held with interfaces and conversions.
Responsibilities:
- MigrateDataStage jobs from 7.5 platforms to 8.5. Design new DataStage jobs for implementing a data mart.
- Creating mapping documents as per project requirement and recompiling all jobs, test run of all jobs, and schedule jobs
- Data extraction from Oracle, SQL Server using PL/SQL scripts to transfer the data to clients depending on the requirements.
- Executed jobs through sequencer for better performance and easy maintenance.
- Tuned of SQL queries for better performance for processing business logic in the database
- Worked with DataStage stages like OraOci, ODBC to transfer the data in Oracle, SQL server.Responsible for monitoring all the jobs that are running, scheduled, completed and failed
- Performed ETL coding using Hash file, Sequential file, Transformer, Sort, Merge, Aggregator stages compiled, debugged and tested. Extensively used stages available to redesign Data Stage jobs for performing the required integration.
- Created Jobs to load the data into DW from various subject areas as Target jobs.
- Defined Stage variables for data validations and data filtering process
- Used various Parallel data partitioning and collecting methods.
- Extensively used the Sequential File Stage, Dataset Stage, Join, Funnel, Sort, Remove Duplicate, Filter, CDC, Lookup stage, Transformer and other stages and the stage provided by the Data Stage to perform transformation and load the data.
- Created various Data Stage jobs to meet business requirements.
- Designed Mappings between sources to operational staging targets, using Star Schema, Implemented logic to Slowly Changing Dimensions.
- Involved in understanding the scope of application, present schema, data model and defining relationship within and between the groups of data.
- Interaction with the business users to better understand the requirements and document their expectations, handling the current process, modifying and created the jobs to the updated requirements, handle the load process to data mart and eventually Archer data warehouse
Environment:
IBM Info Sphere/Accentual Data Stage V 8.0/8.5 , Oracle SQL developer,
ORACLE11g, Windows XP/Windows 2000 Operating system, PL/SQL
DataStage Developer
Responsibilities:
- Used several parallel debugging techniques extensively and performance improvement techniques in Data Stage to achieve maximum performance
- Analyzed the existing ETL for loading the Oracle 9i ODS. Prepared mapping documents of the existing ETL.
- Extensive usage of TOAD for analyzing data, writing SQL/PL/SQL scripts performing DDL operations.
- Wrote Unix scripts and used AWK for file checking and reconciliations.Experience in Oracle database design and development.
- Used XML packs for the conversion of the data between XML documents and tabular data.
- Used XML metadata importer to import the XML source definition and used XML input to read the XML document.
- Used Data Stage Enterprise Edition/Parallel Extender stages namely Datasets, Sort, Lookup, Peek, Row Generator stages in accomplishing the ETL Coding.
- Developed DataStage job sequences used the User Activity Variables, Job Activity, Wait for File stages.
- Understood the Business Requirements/Functional Specifications for the Informatics Data Mart and ODS migration from 9i to 10g
- Developed Error Logging and Auditing strategies for the ETL Scripts.
- Tuned DataStage transformations, and jobs to enhance their performance.
- Troubleshot the designed jobs using the DataStage Debugger
- Worked with SAP plugin to extract data form SAP system.
- Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on an ad hoc or scheduled basis
- Identified source systems connectivity, related tables and fields and ensure data suitably for mapping.
- Worked on programs for scheduling Data loading and transformations using Data Stage from legacy system and Data Warehouse to Oracle 9i.
- Extensively analyzed the Data Sources in identifying data anomalies, patterns, value ranges. Wrote SQL scripts for accomplishing the same.
- Undertook DBA tasks of creating DDL scripts for creating, altering tables. Assigning privileges.
- Used DB Links to migrate test data from one instance to another.
Environment:
DataStage 8.0/8.5 Enterprise Edition/Parallel Extender, Oracle 9i/10g, TOAD, HP-UX, SQL/PL/SQL, UNIX Shell Scripting.
Data stage developer
Responsibilities:
- Involved in performance tuning of the ETL process and performed the data warehouse testing
- Involved in logical and physical data modeling using Erwin 4.1.
- Created Data Warehouse with major Data Marts like Product Profitability, Client Profitability, Transaction Detail, Credit Reports, House holding.
- Used lookup stage with reference to Oracle table for insert/update strategy and for updating slowly changing dimensions.
- Written PL/SQL packages stored procedures functions for data calculations.Written database triggers for surrogate key generations and data validations.
- Extracted Data from different Data Source System like Consumer Loans, Investments, Credit Desk, House holdings, Student Loans, Credit cards from Oracle, DB2 and loaded to target database.
- Dealt with various database stages Oracle, DB2 stages as a source and target systems.
- Extensively worked with Parallel Extender for parallel processing to improve job performance while working with bulk data sources.
- Utilized various Oracle blocks like packages, triggers, indexes, cursors, joins to extract the data that is needed for the creation of a DataStage job.
- Worked extensively on different types of stages like Sequential file, ODBC, Aggregator, ORA Bulk, Transformer, Merge, Join, Lookup, Sort for developing jobs.
- Developed the data warehouse repository using DataStage Manager by importing the source and target database schemas.
- Worked with MQ stage for using a DataStage job to watch a queue and convert messages into relational data.
- Created XMLOutput stage and set the properties for column definition and path where output file had a need to be stored as an XML file
- Validated all the applications and successfully executed the jobs using Data Stage Director
- Used Both Pipeline Parallelism and Partition Parallelism for improving performance.
- Used the DataStage Director extensively to run, schedule, monitor, debug and test the application on development, and to obtain the performance statistics.
- Extracted the data from Oracle, SQL Server using PL/SQL scripts to transfer the data to clients depending on the requirements.
- Extensively involved in determining the data needed to address business user's analytical requirements and design data models to support these analyses.
Environment:
Ascential Data Stage 8.0, Oracle 9i, DB2 UDB, Erwin 4.1, Autosys, UNIX AIX 4.2
Data stage Consultant
Responsibilities:
- Involved in creating Conceptual design which gives the Source to target mappings with the business transformation rules.
- Involved in development of UNIX shell scripts for Batch jobs etc run.
- Data extraction from XML files with FOLDER stage followed by XML input stage in server jobs.
- Developed the Source to Stage/Stage to work/work to EDW jobs to pull the data from Production Servers using the Oracle Stage and ODBC stage etc.
- Extensively handled slowly changing dimension SCD and created the parameter sets in the IBM WebspehereDataStage Designer and made use of these in the DataStage jobs.
- Developed Parallel jobs for cleaning using the stages ODBC Enterprise, Oracle, join, modify, Aggregator, Transformer and lookup, copy etc
- Defined the data definitions and created the target tables in the database.Created the Sequencers to these two projects.
- Designed DataStage ETL jobs for extracting data from heterogeneous source system called NEO, transform and finally load into the EDWNI Data Ware house.
- Extensively used lookup, history processing and transformations.
- Prepared the Source to stage and Stage to EDWNI mapping documents and provided to the offshore team for the Development.
- Done the data validation once the data was loaded in EDWNI. Written the control queries for the BIA are based on the requirements.
- Conducted a Review session with the Offshore Team for Consistency, readability and appropriateness on ETL jobs.
Environment:
IBM Web Sphere/Ascential Data Stage V 7.5 , UNIX, SQL, ORACLE10g, PL/SQL, Windows XP/Windows 2000 Operating system.
ETL Developer
Responsibilities:
- Developed several ETL specifications documents Programmer level specifications and also developed jobs using DataStage and other tools.
- Used Version Control extensively to jobs from one project to another.
- Extracted the data from Oracle, SQL Server using PL/SQL scripts to transfer the data to clients depending on the requirements.
- Utilized various Oracle blocks like packages, triggers, indexes, cursors, joins to extract the data that is needed for the creation of a DataStage job.
- Programmed and created several routines and shell scripts to change the data according to the business specifications.
- Part of the team in Dimensional modeling of the Data warehouse. Used Erwin to design the business process, dimensions and measured facts. Identified and documented the slowly changing dimensions
- Worked with the Business Analysis in understanding the business and development process of the client and facilitated appropriate data and development solutions.
- Worked with several DataStage stages like OraOci, ODBC, Teradata Multiload/ Fastload etc. to transfer the data in Oracle, SQL Server to Teradata.
- Responsible for monitoring all the jobs that are running, scheduled, completed and failed.
- Troubleshooting the failed job is a primer in these situations.
- Worked on database connections, SQL joins, cardinalities, loops, aliases, views, aggregate conditions, parsing of objects and hierarchies.
- Created multiple repositories, users and privileges in DataStage Manager and Administrator
- Tuned of SQL queries for better performance for processing business logic in the database.
- Configured DataStage Server and Client components.
Environment:
AscentialDataStage 7.5, Teradata v2 R4.0/v2R5.0, Teradata SQL Assistant 6.1, Oracle 9i., PL/SQL SQL Server 2000, Autosys, UNIX Shell Scripting, Erwin 4.1
ETL Developer
Responsibilities:
- Involved in Design, Source to Target Mappings between sources to operational staging targets, using Star Schema, Implemented logic for Slowly Changing Dimensions.
- Improved the performance of the jobs by using Performance Tunings.
- Loaded the data into the Teradata database using Load utilities like Fast Export, FastLoad, MultiLoad, TPump .Wrote MACROS in Teradata to generate less channel traffic and easy execution of frequently used SQL operations and improve the performance.
- Created Batch processes using FastLoad, BTEQ, Unix Shell and Teradata SQL to transfer, cleanup and summarize data.
- Created job designs, Job sequencers for handling job dependencies and shared containers for the job reusability
- Extensively used DataStage Designer to develop various Parallel jobs to extract, cleanse, transform, integrate and load data into Enterprise Data Warehouse tables.
- Extensively used DataStage Manager to import/export metadata, DataStage Components between projects.
- Created Datastage routines for date transformation and System Key generation.
- Effectively used Datastage stages to load large volumes into Data warehouse, Datamart and staging environments.
- Extracted data from mainframes, applyed transformation rules and loaded into the target database.
- Exposure on data extraction in ERP background.
- Reports were generated through Cobal programming extracting data from Mainframe Flat files, VSAM files, DB2 tables and Excel Spreadsheet.
- Experience in developing data models as well as logical and physical database design, with a major focus on dimensional modeling develop process using ETL tools Data Integrator, PL/SQL, SQL to support business reporting requirements.
- Experiencing in coordinating ETL related work with offshore development and test teams.
- Participated in knowledge transfer with the team and business units.
Environment:
IBM Data Stage 7.0 Enterprise Edition, Designer, Director, Manager and Administrator , VB Script,Cobol, Oracle 9i, Oracle 10g, DB2, Sybase, SQL Plus, PL/SQL, Teradata, Shell Script TOAD 7.3, ERWIN 4.2, AIX 5.1.2, UNIX and Win 2000/NT.
Data stage developer
Responsibilities:
- Involved in understanding of business processes to learn business requirements.
- Extracted data from different systems into Source. Mainly involved in ETL developing.
- Defined and implemented approaches to load and extract data from database using DataStage.
- Worked closely with data warehouse architect and business intelligence analyst in developing solutions.
- Used Erwin for data modeling i.e. modifying the staging and SQL scripts on SQL server and MS Access Environments .
- Involved in design, source to target mappings between sources to operational staging targets, using DataStage Designer.
- Performed ETL coding using Hash file, Sequential file, Transformer, Sort, Merge, Aggregator stages compiled, debugged and tested. Extensively used stages available to redesign Data Stage jobs for performing the required integration.
- Executed jobs through sequencer for better performance and easy maintenance.
- Involved in unit, performance and integration testing of Data Stage jobs.
- Used Data Stage Director to run and monitor the jobs for performance statistics.
- Involved in performance tuning of the jobs.
- Used T-SQL for validating the data generated at OLAP server.
Environment:
Ascential Data Stage 6.0 Designer, Manager, Director , Oracle 9i, MS Access, SQL-Server 2000/2005,SQL, PL/SQL, Toad, UNIX.