We provide IT Staff Augmentation Services!

Ibm Data Stage Developer Resume

Tampa, FL

PROFESSIONAL SUMMARY:

  • Highly competent IBM DataStage Developer/ Consultant with over 8 years of experience in Information technology in Design, Development, Administrator and Implementation of various database and data warehouse technologies (IBM DataStage v8. X/7.X) using components like Designer, Director, and administrator.
  • Over 5 years’ experience in writing complex SQL queries and PL/SQL, including the use of stored procedures, functions, and triggers to implement business rules and validations in the situation of Microsoft SQL, Oracle 11g/10g/9i.
  • Extensive ETL tool experience using IBM Infosphere Websphere Datastage, Ascential Datastage. Worked on Datastage client tools like Datastage Designer, Datastage Director, Information Server and Datastage Administrator.
  • Good Knowledge of the principles of DW like Data marts, OLTP, OLAP, Dimensional Modeling, fact tables, using Slowly Changing Dimension, Surrogate Key, and Normalization etc. dimension tables and star/snowflake schema, modeling
  • Excellent in using highly scalable parallel processing infrastructure using parallel jobs with multi - node configuration files.
  • Expertise in performing Data Migration from various legacy systems to target database
  • Experienced in scheduling sequence, parallel and server jobs using DataStage Director, UNIX scripts and scheduling tools.
  • Worked on Web Services associated with BEA Weblogic servers.
  • Extensively used DataStage tools (Data Stage Designer, Data Stage Manager, and Data Stage Director) .
  • Used Enterprise Edition/Parallel stages like Datasets, Change Data Capture, Row Generator and many other stages in accomplishing the ETL Coding.
  • Designed and developed parallel jobs, server and sequence jobs using Datastage Designer.
  • Experience in using different types of stages like Transformer, Aggregator, Merge, Join, Lookup, and Sort, Remove duplicate, Funnel, XML, Filter, Pivot, Shared containers for developing jobs.
  • Actively involved in each phase of Software Development Life cycle (SDLC): Requirements, Specification, Design, Implementation, and Testing.
  • Expertise on building DataStage process for Real Time Integration WSDL (RTI) with web services.
  • Hands on experience in Relational database (RDBMS), Oracle, SQL Server, Sybase, DB2 and MS Access.
  • Experience in Data Warehouse development worked with Data Migration, Data Conversion, and (ETL) Extraction/Transformation/Loading using Ascential DataStage with Teradata , DB2 UDB, Oracle, SQL Server.
  • Experience in Teradata utilities in like Fast Load, MultiLoad, and Fast Export, query tools BTEQ and SQL Assistant, Teradata SQL, Explain Plan, bulk loaders and un-loaders.
  • Proficient in the Integration of various data sources like Oracle, SQL Server, DB2, Teradata, Ms-Access, COBOL, Mainframe, Excel, XML,XSD, VSAM files and Flat Files.
  • Knowledge in using PL/SQL to write stored procedures, functions, and triggers.
  • Extensive experience in Unit Testing, Functional Testing, System Testing, Integration Testing, Regression Testing, User Acceptance Testing and Performance Testing.
  • Created local and shared containers to facilitate ease and reuse of jobs.
  • Worked as a part of Agile and Waterfall Software development team to develop ETL jobs.
  • Experience or working knowledge of MS servers and batch file scripting
  • Experience or working knowledge of Unix/Linux servers and shell scripting
  • Knowledge in using Erwin as leading Data modeling tool for logical (LDM) and physical data model (PDM).
  • Involved in functional and technical meetings and responsible for creating ETL Source - to - Target maps.
  • Designed XML stages for reading XML log files for capturing data stage jobs audit data.
  • Quick learner and adaptive to new and challenging technological environments.
  • Excellent communication skills and good team leading knowledge skills.

TECHNICAL SKILLS:

ETL Tools: IBM Infosphere DataStage 11.3,9.1,8.7, IBM Infosphere DataStage 8.5, IBM WebSphere DataStage 8.0.1, (Designer, Director, Information Server Administrator), Ascential DataStage 7.5.2 Enterprise Edition (Designer, Director, Administrator, Manager).

OS: IBM AIX 5.2/4.x, Linux, Windows 7, Windows 2000/2003/XP.

Languages: SQL, PL/SQL, Unix Shell Scripting, COBOL, DMExpress, Mainframe, FilePort, PERL Java, HTML, DHTML

Database: Oracle 11g/10g/9i, IBM DB2/UDB,DB2,Teradata V2R6/V2R5, SQL Server 2003/2005/2008 , VSAM, Netezza.

Data Modeling, Star Schema Modeling, Snow: Flake Modeling, Fact and Dimensions, Physical and Logical Data Modeling using Erwin .

Database Tools: OEM, Oracle Enterprise Manager Grid Control (OEM), RMAN (Recovery Manager). Toad 8.6.1., OCI

Other tools: Microstrategy8.x, Erwin8.2, QA, MicrosoftVisio2007, Winscp, Putty, Microsoft office 2010, FileZille, Business Objects, Cognos and Crystal Reports.

PROFESSIONAL EXPERIENCE:

Confidential, Tampa, FL

IBM Data Stage Developer

Responsibilities:

  • Involved in development phase meetings for Business Analysis and Requirements Gathering.
  • Involved in creating High and Low Level Architectural Design Documents.
  • Involved in Requirements gathering, Logical Design, and Physical Design model meetings to understand the data flow, frequency of data loads and assist in creating mapping documents.
  • Performed Unit Testing on the Jobs developed by creating test files based on test cases.
  • Used Datastage Designer to design and develop jobs to cleanse, extract, transform, integrate and load data into facets from various Sources.
  • Used the DataStage Director and its run-time engine to schedule the jobs, testing and debugging its components, and monitoring the resulting executable versions (on an ad hoc or scheduled basis).
  • Designed Proof of Concept (POC) for certain jobs which required heavy manipulations to be performed as part of fine tuning.
  • Created Parameter sets and parameters for migrated jobs.
  • Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture (CDC), Modify, Row Generator and Aggregator.
  • Responsible for data analysis, requirements gathering, report analysis, source-to-target mapping, frequency analysis, process flow diagrams, and documentation.
  • Handled Performance Tuning of Jobs to ensure faster Data Loads.
  • Designed sequence jobs using the activities such as Job Activity, Nested Condition, Notification Activity, Sequencer Activity, Terminator Activity and Execute Command.
  • Performed the Integration and System testing on the ETL jobs.
  • Involved in developing Designer- Server and PX jobs for Extracting, Cleansing, Transforming, and Integrating/Loading Data into Corporate Data Warehouse (CDW).
  • Developed Job Sequences with restart capability for the designed jobs using Job Activity, Exec Command, E-Mail Notification Activities and Triggers.
  • Extensively designed, developed and implemented Parallel jobs using Parallel Processing techniques to improve job performance while working with bulk data sources.

Environment: Infosphere DataStage11.3,9.1 and 8.7 (Designer, Manager, Director, and Administrator, Information Server ), InfoMaker 11.5, Putty, Autosys Scheduling tool, DB2, Shell Scripts, AIX 5.1.

Confidential, Charlotte, NC

IBM Data Stage Developer

Responsibilities:

  • Involved in the Analysis of the functional side of the project by interacting with functional experts to design and write technical specifications.
  • Database design & data model - Logical & Physical design.
  • Worked on the Architecture of ETL process.
  • Created Data stage jobs (ETL Process) for populating the data into the Data warehouse constantly from different source systems like ODS, flat files, scheduled the same using Data Stage Sequencer for SI testing.
  • Extracted data from sources like Oracle and Flat Files.
  • Experience in using different types of stages like Transformer, Aggregator, Merge, Join, Lookup, and Sort, Remove duplicate, Funnel, Filter, Pivot, FTP Shared containers for developing jobs.
  • Debug, test, and fix the transformation logic applied in the parallel jobs
  • Extensively worked on Information Analyzer to perform data profiling and identify and analyze the data patterns and inconsistencies. Developed a detailed data profiling report.
  • Developed technical infrastructure designs, data mappings, flows and report dissemination mechanisms by architecting Data Warehouses and Marts.
  • Developed Slowly Changing Dimension Mappings for Type 1 SCD and Type 2 SCD
  • Worked on Data Stage 9.x parallel Version.
  • Used Netezza Enterprise stage for doing loads into Netezza Database.
  • Designed and developed parallel jobs, server and sequence jobs using Datastage Designer.
  • Troubleshooting performance issues with SQL tuning.
  • Working in a team with other associate product & component developers.
  • Involved in Unit testing and Integration testing to test jobs and also the flow.
  • Awareness about the functional/business aspects of the components.
  • The automated process of job monitoring, which helped in minimizing the manual intervention & documenting them perfectly.
  • Worked on GIT repository as a source control
  • Managed project tracking through JIRA as planning tool
  • Involved in the Documentation of the ETL phase of the project.
  • Developed the reusable components, best practices that were later on used in other Data warehouse.

Environment: Infosphere DataStage11.3,9.1 and 8.7 (Designer, Manager, Director, and Administrator, Information Server ), Teradata v2r6, Autosys Scheduling tool, GIT, JIRA, Netezza, FTP IBM Rational Requisite pro, Oracle 11g/10g/9i, Shell Scripts, AIX 5.1.

Confidential, Providence, RI

Data Stage Developer

Responsibilities:

  • Designed the ETL jobs using Infosphere DataStage Server 8.7 to Extract, Transform and load the data into Staging and then into Oracle Database.
  • Performed Installation and migration of IBM Datastage Enterprise Edition/PX on UNIX platforms.
  • Creating web services for real time integration of jobs using Information Server Console and web console.
  • Extracted data transformed and loaded into Oracle database according to the required provision using Data Stage.
  • Worked with Erwin tool in Data Modeling (both Physical and Logical Design).
  • Extensively used the designer to develop various parallel jobs to extract, transform, integrate and load the data into Corporate Data warehouse (CDW).
  • Developed PL/SQL procedures & functions to support the reports by retrieving the data from the data warehousing application.
  • Developed Slowly Changing Dimension Mappings for Type 1 SCD and Type 2 SCD
  • Extensively worked with Parallel Extender. Using Parallel Processing (Pipeline and partition parallelism) techniques to improve job performance while working with bulk data sources.
  • Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, FTP and Sort, Surrogate key Generator, Change Data Capture (CDC), Modify, Row Generator and Aggregator.
  • Created Job Parameters and Environment variables to run the same job for different schemas.
  • Used Datastage as an ETL to extract data from sources like DB2, VSAM files and flat files and loaded to target Oracle.
  • Involved in all the stages of Software Development Life Cycle (SDLC).
  • Experienced in using advance DataStage plugin stages like XML input and XML output.
  • Extracted data transformed and loaded into Oracle databases according to the required provision using DataStage.
  • Expertise in creating new services, adding support for service bindings with SOAP messages format to RTI server.
  • Used PL/SQL programming to develop Stored Procedures/Functions and Database triggers.
  • Designed jobs to read VSAM files using CFF stage, while dealing with mainframe data sources.
  • Designed and developed ETL processes using DataStage designer to load data from Oracle, MS SQL, Flat Files (Fixed Width) and XML files to staging database and from staging to the target Data Warehouse database.
  • Developed UNIX scripts for dynamic generation of Param Files & for FTP/SFTP transmission
  • Worked on SVN to make project hold the version control
  • Extracted data from a various file or DB based source systems into EDI staging Teradata database using Runtime column Propagation (RCP) method.
  • Taking the regular backups of the jobs using Data Stage Manager Export/Import utility.
  • Participated in Unit testing and Integration testing of DataStage jobs.

Environment: Infosphere DataStage 9.1,8.7 (Designer, Manager, Director, and Administrator, Information Server ), v2r12, Autosys Scheduling tool, XML files , Netezza, FTP SVN, Oracle 10g/9i, Aqua Data Studio, Erwin Toad, Shell Scripts, AIX 5.1.

Confidential, Quincy, MA

DataStage Developer

Responsibilities:

  • Developed ETL specifications for ETL designing and development
  • Source to Target mapping document creation
  • Loading tables from Operational Data Source (ODS) to CIRS data warehouse environment.
  • Designed and Developed jobs using Server jobs. Used Parallel Extender for splitting bulk Data into subsets and to dynamically distribute to all available Nodes to achieve best job performance
  • Performed testing of these Parallel jobs using Row Generator and Column Generator stages Created Data stage jobs using different stages like Transformer, Aggregator, Sort, Join, Merge, Lookup, Data Set, Funnel, FTP Remove Duplicates, Copy, Modify, Filter, Change Data Capture, Change Apply, Sample, Surrogate Key, Column Generator, Row Generator, Etc.
  • Developed jobs for transforming the data and stages like Join, Merge, Lookup, Funnel, Transformer, Pivot and Aggregator
  • Used Row Generator and Column Generator stages of creating the test data for performing Testing operations .
  • Deployed web services.
  • Generated Surrogate ID’s for the dimensions in the fact table for indexed and faster access of data.
  • Developed job sequences to execute a set of jobs with restart ability, checkpoints and implemented proper failure actions
  • Created database procedures, functions and triggers using PL/SQL
  • Experience with working with XML schema.
  • Created and used Oracle Stored Procedures in the DataStage jobs to increase the performance of the jobs
  • Assigned the tasks and provided technical support to the development team.
  • Monitored the development activities of the team and updated to the Management.
  • Worked with TOAD to interact with Oracle and Used SQL Trace and Explain Plan to improve the performance of the PL/SQL programs
  • Loading protected category tables from ODS to CIRS
  • Validating the Inbound file from care management providers according to Business rules.

Environment: IBM InfoSphere Information Server V8.5 Suite DataStage, QualityStage ,, HP-UX11.11, Oracle9.2, Teradatav2r6, CCCHarvest 4.2, XML files RemedyASR8.2, Autosys, Erwin PL/SQL Developer 6.0.3, Flat files, Windows 2000

Confidential, Atlanta, GA

ETL Data Stage Developer

Responsibilities:

  • Involved with Business users and ETL Leads from different teams to implement ETL FrameWork using Server and Parallel jobs.
  • Proficient in writing, implementation and testing of triggers, procedures, and functions in PL/SQL and Oracle
  • Excellent Experience in Designing, Developing, Documenting, Testing of ETL jobs and mappings in Server and Parallel jobs using Data Stage to populate tables in Data Warehouse and Datamarts .
  • Extensively worked with Join, Lookup (Normal and Sparse) and Merge stages.
  • Involved in the dimensional modeling of the Data warehouse to design the business process, data representation, dimensions and fact tables using Erwin.
  • Extensively worked with sequential file, dataset, file set and look up file set stages
  • Used Data Stage as an ETL tool to extract data from sources systems, loaded the data into the ORACLE database.
  • Design the sequence jobs for SFTP process to generate LSMW file.
  • Created shell script to run data stage jobs from UNIX and then schedule this script to run data stage jobs through scheduling tool.
  • Implemented parallel extender jobs for better performance using stages like Join, Merge, Sort and Lookup, a transformer with different source files complex flat files, XML files.
  • Developed SQL queries to performed DDL, DML, and DCL against Teradata.
  • Created Data stage jobs (ETL Process) for populating the data into the Data warehouse constantly from different source systems like ODS, flat files, scheduled the same using Data Stage Sequencer for SI testing
  • Involved in creating UNIX shell scripts for database connectivity and executing queries in parallel job execution.
  • Used the ETL Data Stage Director to schedule and running the jobs, testing and debugging its components & monitoring performance statistics.

Environment: IBM WebSphere Data Stage 8.0 (Designer, Director, Administrator), TeradataV2R5, DB2, SQL Server, Oracle 9i, IBM AIX UNIX, SFTP, VSS.

Confidential, Freeport, ME

ETL Data Stage Developer

Responsibilities:

  • Designed the ETL jobs using IBM Infosphere Data Stage 7.5 to Extract, Transform and load the data into EDW.
  • Responsible for data analysis, requirements gathering, report analysis, source-to-target mapping, frequency analysis, process flow diagrams, and documentation.
  • Design the jobs using different stages to load the data into Operational Data Stores.
  • Design the jobs using different stages like JOIN, LOOK-UP, SORT, AGGREGATE, REMOVE-DUPLICATES and FUNNEL to load the data into EDW.
  • Creating the data flows in the design studio by considering various stages and connectors.
  • Responsible for creating the standard parameter sets with unique standard naming formats.
  • Involved in creating specifications for ETL processes, finalized requirements, and prepared specification document.
  • Responsible for creating the Unit Test plan and conduct the meeting sessions with the testers and compare the Unit Test results with the different test cases of testers.
  • Responsible for creating the Deployment plans by including all the pre-production and post-production steps and getting the approval from change management team to deploy the. DSX files into QA and Production environment

Environment: IBM InfoSphere Data Stage 7.5(Designer, Director), Control M scheduler, Oracle 8i.

Confidential

Software developer

Responsibilities:

  • Developed several transformations in the process of building Data warehouse database.
  • Used server jobs to Extraction, Transformation, and Load.
  • Analyzed and designed source code documentation for investment Data Warehouse.
  • Used Data Stage Designer for developing various jobs to extract, cleansing, transforming, integrating and loading data into Data Warehouse.
  • Used COBOL programs to extract data from the mainframes and create a load ready file.
  • Used Data Stage Manager for managing Data Stage repository (view and edit), define custom routines & transforms, Import and export items between different Data Stage systems or exchange metadata with other data warehousing tools.
  • Extensively used Parallel Stages like Join, Merge, Lookup, Filter, Remove Duplicates, Funnel, Row Generator, Modify, Peek etc. for development and debugging purposes.
  • Extensively worked with Data Stage Job Sequences to Control and Execute Data Stage Jobs and Job Sequences using various Activities and Triggers.
  • Used Data Stage Director to run and monitor the jobs for performance statistics.
  • Used Data Stage Director and the runtime engine to schedule running the server jobs, monitoring scheduling and validating its components.

Environment: Data Stage 7.0, Oracle 8i, SQL Server 2000.

Hire Now