We provide IT Staff Augmentation Services!

Senior Data Stage Developer Resume

0/5 (Submit Your Rating)

CA

SUMMARY

  • Over 8 years of experience in IT as an application developer with experience in the total life cycle of Software Development Applications involving Requirements, Design Analysis, Development, Maintenance, Implementation and Testing.
  • 7 years of in - depth experience in Extraction Transformation and Loading (ETL) processes using Data stage 8.5/8.1/8.0.1/7.5/7.1/7.0 (Parallel Extender & Server).
  • Experience in Data Mining with exposure to OLAP, OLTP, database administration, data warehouse development and Data modeling.
  • Good Understanding in design and implementation of Star schema, Snowflake schema and multi-dimensional model.
  • Extensive experience in Designing, Compiling, Testing, and Scheduling and Running Data Stage jobs. Expertise in data warehousing techniques for data cleansing, Slowly Changing Dimension phenomenon.
  • Experience working with Parallel Extender for Parallel Processing to improve job performance while working with bulk data sources. Worked with most of the parallel stages applying different partitioning techniques. Worked in IIW (Insurance Information ware house) data model to perform data loading.
  • Experience working on Quality Stage in 8.0.1 for data cleansing and data standardization Process. Knowledge on data stage web services packs.
  • Experience in using IBM Info sphere Change Data Capture (CDC) which is driven from database logs. Experience in using Web Sphere Data Stage Pack for SAP BW and for SAP R/3 systems.
  • Strong working experience with Oracle, SQL Server, DB2, Teradata including database development, PL/SQL programming, Procedures/Functions and Triggers.
  • Experience in integrating complex data file formats such as EDI, XML and Mainframes.
  • Experience in writing UNIX shell scripts, Perl scripts and C++ languages.
  • Experience in third party scheduler Auto sys, Control-M for defining, scheduling and monitoring jobs.
  • Experience in Teradata utilities in like Fast Load, Multi Load and Fast Export and query tools BTEQ and Query man, Teradata SQL, Explain Plan, bulk loaders and unloads in Teradata.
  • Interacted extensively with clients to gather requirements and perform analysis and design to meet end user requirements.
  • Performed debugging, troubleshooting, monitoring and performance tuning using Data Stage.
  • Involved in writing Test Plans, Test Scenarios, Test Cases and Test Scripts and performed the Unit, Integration, system testing and User Acceptance Testing Coordinating with the client and the offshore team
  • Self-driven to accomplish goals and meet deadlines. Provided 24/7 production support.
  • Highly motivated team player with ability to lead, manage and work in all environments to meet deadlines.

TECHNICAL SKILLS

ETL Tools: Data Stage 8.5/8.1.0/7.0/6. X/5.x (Designer, Manager, Director), Data Stage Parallel Extender, DS Version Control, Information Analyzer 8.1

Databases & Tools: JDE,IBM DB2/UDB, Oracle (11g/10g/9i/8i/7.x),PeopleSoft EPM 8.9 / 9.0 SQLServer 2000/2005/2008 , Informix5.1,Teradata v12

Languages: SQL, C, PL/SQL, COBOL, Korn /C Shell Scripting, HTML, XML, MS-Visual Basic, IIS, ASP, Java Script, VB Script

Operating Systems: Sun Solaris, Linux, IBM AIX (4.0/5.x), Windows XP/NT/2000/9x.

Web/App Servers: WebSphereApplicationServer 3.5/4.0/5.0/5.1/6.0 , IBM HTTP Server, Apache Web Server.

Scheduling: Mainframe work load scheduler (C7),Tivoli Workload Scheduler, Job sequencer, kron tab, AutoSys

Scripting: Korn Shell Script, Perl, JavaScript, VBScript.

Reporting Tools: Cognos 8.3 Suite, Report studio, Query studio Crystal Reports, SQR, D2K. Business Objects XI R2/R3

PROFESSIONAL EXPERIENCE

Confidential, CA

Senior Data stage Developer

Responsibilities:

  • Analyzed the database schema structure of the OLTP database and designed ETL processes.
  • Extensively used Lookup and Join stages for combining data from different sources like DB2 and SQL databases.
  • Created re-usable components using shared containers for local use or shared use.
  • Used Parallel Extender for splitting the data into subsets and flowing of data concurrently across all available processors to achieve job performance by invoking partition parallelism.
  • Created Parameters and Environment variables to run the same job for different schemas.
  • Involved in Debugging the Data Stage jobs using Peek, Head and Sample stages
  • Developed user defined Routines and Transformations to generate Surrogate key value based on Database Sequence for integration tables.
  • Involving in identifying and resolve performance Issues of various Jobs processes.
  • Performed ETL coding using Hash file, Sequential file, Transformer, Sort, Merge, Aggregator stages then compiled, debugged and tested the data.
  • Extensively used stages available to redesign Data Stage jobs for performing the required integration.
  • Used Environment Variables, Stage Variables and Routines for developing Parameter Driven Jobs and debugging them.
  • Extensively used Shared Containers and Job Sequencer to make complex jobs simple and to run the jobs in sequence.
  • Involved in the preparation of ETL documentation by following the business rule, procedures and naming conventions.
  • Worked on SQL stored procedures, in Data stage server environment for extracting and loading the data
  • Worked with the Data Quality Tester to formulate Unit testing and integration testing.
  • Writing, testing and implementation of procedures, functions, triggers at Database level using SQL DB.

Environment: Data stage 8.7 (server and Parallel), Oracle11g, PL/SQL, SQL server 2008, Information Analyzer 8.1.

Confidential, TX

Senior Data stage Developer

Responsibilities:

  • Interacted with business users in gathering the business requirements, identifying the relationship within and between the groups of data.
  • Created the Functional/Technical specification documents by maintaining standards of the enterprise
  • Designed the technical document for various jobs, unit test documents with various scenarios and acceptance level of test case results. Migration of Server jobs from Datastage 7.5 to 8.7
  • Worked with Data Stage Manager for Export & Import Jobs and Importing the Metadata from repository.
  • Analyzing the showcase query for the sources system JDE and specifying the Metadata to the DB admin to create the tables in the SQL target Database.
  • Used several stages like Sequential file, Hashed File, Aggregator, Funnel, Change capture, Transformer, Merge, Join, Lookup during the development process of the Data Stage jobs.
  • Implementing Type-2 Slowly Changing Dimension for capturing the delta and Using Shared Containers for reusability and thereby reducing the job complexity.
  • Redesigned and modified existing program logic to improve overall system performance.
  • Analyzed data with discrepancies through Error files and Log files for further data processing and cleansing.
  • Involving in Performance Tuning of various Jobs that are used to load Full extract and the Incremental
  • Used Data Stage Director for running and monitoring & scheduling the jobs.
  • Performed Unit Testing, System Testing, and UAT Validation and System integration testing using job sequence.
  • Provided program documentation, including restart/recovery procedures. Created a flow chart diagram to demonstrate the process to the team.

Environment: Datastage 8.7 (server and Parallel), Showcase V11, Oracle11g, PL/SQL, Access 2010, SQL server 2008, Information Analyzer 8.1.

Confidential, CA

Data stage Developer

Responsibilities:

  • Participate in Project scoping activities and Understanding requirements as per the Client Business Logic’s.
  • Preparing Information Analysis docs and Low Level Design Docs for ETL Process.
  • Assign tasks to individual members of the team and look after the quality of delivery of tasks assigned.
  • Configure Database connectivity and performing elementary Data Stage administration activities.
  • Involved in development phase meetings for Business Analysis and Requirements Gathering.
  • Collaborated with analysts to decide the ETL methods and overall data flow architecture.
  • Monitored/reviewed other ETL programmer’s deliverables on a team share basis to ensure that adherence to uniform application development practices are being followed.
  • Experienced in writing Basic Language Functions and Scripts for Data Stage.
  • Tested the ETL process for accuracy with advanced SQL queries. Tuned Data Stage transformations and jobs to enhance their performance.
  • Performed complex date conversions using Data Stage Software Development Kit (SDK) transforms. Having knowledge / Experience on Performance tuning techniques.
  • Developed customized routines for date conversion and other data problems. Wrote many stored procedures, functions, packages and used them in Forms and Reports.
  • Developed SQL, SQL Loader code, PL/SQL Programs and UNIX scripts. Attended design walkthrough sessions and provided recommendations. Developed/executed/documented detailed test plans.
  • Ensured acceptable performance of the data warehouse processes by monitoring, researching and identifying the root causes of bottlenecks.

Environment: Datastage 8.5 (Parallel Extender), Oracle11g, PL/SQL, Unix/Window, MS Access 2010, SQL server 2008 R2, UNIX Shell scripting, Korn Shell Script, Information Analyzer 8.1.

Confidential, LANSING

Data stage Developer

Responsibilities:

  • Interacted with Business Analysts to finalize the requirements and documented the technical design document for Coding.
  • Developed Data Stage Parallel Jobs using required stages, and then obtained data from source like flat files, Cleansed, summarized, aggregated, transformed and loaded into data warehouse.
  • Involved in design and development of parallel jobs, sequences using the Designer. Designed jobs using Row Generator, Sequential File, Data set, Join, Remove duplicates, Funnel, Filter, Transformer and Pivot stages.
  • Worked with SCD stage for implementing slowly changing dimensions. Involved in the installation of IBM Information Server.
  • Encompasses Database designing, ETL phases of Data Warehousing. This is achieved with an emphasis on relational data modeling and dimensional data modeling for OLTP and OLAP systems.
  • Tuned Data Stage jobs for better performance by creating Data Stage Lookup files for staging the data and lookups.
  • Created Shared Containers to increase Object Code Reusability and to increase throughput of the system.
  • Experience developing complex transformations, surrogate keys, routines, dimension tables and fact tables.
  • Data staging of the ETL solutions from different source systems to target database.
  • Involved in the identification of Facts and dimensions table for developing logical design of the data marts.
  • Performed extraction, transformation and loading of data using different types of stages and by performing derivations over the links connecting these stages.
  • Enhanced the Job Performance by using proper Partitioning methods and analyzing the resources utilized using Job Monitor.
  • Created Master Job Sequencers to control sequence of Jobs using job controls.
  • Used Data Stage Director for running and monitoring performance statistics.

Environment: IBM-Info Sphere Data Stage 8.5 (Server & parallel), Teradata v12, PeopleSoft EPM 8.9 UNIX- AIX, Windows XP, MS Word, Excel, Korn Shell Script.

Confidential, IL

Data stage Developer

Responsibilities:

  • Understood functional documents for business source systems and applications and their integration into the DWH.s
  • Wrote the Design documents and specifications in accordance with SAMS (Statewide Accounting Management Systems) manual design and best practices.
  • Involved in understanding the Requirements of the end Users/Business Analysts and Developed Strategies for ETL processes.
  • Data Analysis using IBM Info Sphere Information Analyzer, Configuring resources, Importing metadata, Specifying analysis settings, Analyzing columns, Publishing analysis results, Analyzing tables, Analyzing across tables, Managing metadata.
  • Extracted data from various transactional data sources residing on Sql, Oracle, Complex Flat Files and loaded into ODS.
  • Develop processes for cleansing, transforming, extracting, integrating and loading data with use of Data stage.
  • Normalized and De-normalized entities for the Data Warehouse. Troubleshooting the designed jobs using the Data Stage Debugger.
  • Designed Parallel jobs using various stages like join, merge, Lookup, CDC, remove duplicates, filter, modify, aggregator and funnel stages.
  • As a part of ETL process, involved in cleansing agencies details so that comptroller’s office can communicate more effectively with its agencies with less wasted investment and create CAFR.
  • Extensively used Auto sys for automation of scheduling for UNIX shell script jobs on daily, weekly monthly basis with proper dependencies.
  • Involved in creating technical documentation for source to target mapping procedures to facilitate better understanding of the process and in corporate changes as and when necessary.
  • Worked on troubleshooting, performance tuning and performance monitoring for enhancement of Data Stage jobs.

Environment: Data stage 8.1 (Parallel Extender), Oracle11g, PL/SQL, Unix/Window, MS Access 2010, PeopleSoft EPM 8.9, SQL server 2008 R2, Korn Shell Script.

Confidential, AZ

Data stage Developer

Responsibilities:

  • Worked on troubleshooting, performance tuning and performance monitoring for enhancement of Data Stage jobs.
  • Interacted with business users in gathering the business requirements, identifying the relationship within and between the groups of data.
  • Created the Functional/Technical specification documents by maintaining standards of the enterprise.
  • Designed the technical document for various jobs, unit test documents with various scenarios and acceptance level of test case results.
  • Actively participated in discussions and implementation of error Handling and reject management, Audit management process.
  • Designed and developed parallel jobs for extracting, cleansing, transforming and loading the data from the database and load into the ODS and GL.
  • Used stored procedure stage in parallel jobs.
  • Worked extensively on different stages like Aggregator, Merge, Join, Copy, Modify, Lookup, Filter, Oracle Enterprise, Column Generator, Row generator stages for Data cleansing and Data Transformation.
  • Worked with different data sources such as Oracle, DB2 UDB and Flat files from Mainframe System.
  • Used Auto sys to schedule the jobs. Wrote shell scripts to schedule the job.
  • Used Data Stage Manager for importing & creating metadata definitions from repository, view and edit the contents of the repository.
  • Extensively worked in the performance tuning of the program, ETL Procedures and processes, tuning the SQL used in Transformations and fine-tuning the database.

Environment: Data Stage 8.1 Enterprise Edition/Parallel Extender, Teradata v12,Oracle (10g), DB2 UDB 7.2, TOAD 7.4, PL/SQL, C++, Korn Shell Script, Windows NT server, AIX UNIX 5.2.

Confidential, CA

Data stage Developer

Responsibilities:

  • Assisted in updating the logical model with all related entities, attributes and relationships between entities based on the rules provided by the business manager using Erwin.
  • Involved in requirement gathering, analysis and study of existing systems.
  • Extensively used Data Stage Designer for developing Server jobs, Parallel jobs and performed complex mappings based on user specifications.
  • Used Data Stage Designer for extracting data, performing data transformations and aggregate data.
  • Performed lookups using Hashed files. Used Data Stage Manager to store and manage reusable Metadata, and created custom routines and transforms for the jobs.
  • Experience in using Data Stage Director to Validate, Run, and Schedule and Monitor Data Stage jobs.
  • Worked extensively on all the stages such as OCI, Sequential, Aggregator, Hashed Files, Sort, Link Practitioner, Link Collector and ODBC.
  • Developed jobs in Parallel Extender using different stages like Transformer, Aggregator, Lookup, Source dataset, External Filter, Row generator, Column Generator and Peek stages.
  • Used Meta Stage for data integration and standardization for loading in Oracle data warehouse.
  • Used Partition methods and collecting methods for implementing parallel processing.
  • Extracted data from Oracle and DB2 databases, transformed data and loaded into Oracle data warehouse.
  • Also extracted data from Flat files, Sequential files and access files, applied transformations and loaded the data into Oracle data warehouse.
  • Created Data Stage jobs and Job sequences and tuned them for better performance.
  • Developed UNIX shell scripts to automate the Data Load processes to the target Data warehouse.

Environment: Data Stage 7.5 Enterprise Edition/Parallel Extender, Quality Stage, DB2 Version 8.0, AQT, AIX, SQL/PL/SQL, PeopleSoft EPM 8.9, UNIX Shell Scripting, Ultra Edit, Tivoli.

Confidential, San Antonio, Texas

Data stage Developer

Responsibilities:

  • Analyzed Business Requirements by working closely with Business Analysts.
  • Created Data Stage jobs to extract data from various sources, transformed data according to the requirement and load into data warehouse.
  • Involved in extracting the data from SAP R3, flat files, SQL Server, Oracle and Loading into Oracle warehouse using Data stage
  • Used ABAP EXT for R3 and IDOC EXT for R3 to extract the data from R3.
  • Used Before and After Stage subroutines to further enhance performance of the system.
  • Developed some Shell, Awk and Sed scripts to perform data audits, to manipulate the data in flat file and to schedule batch job.
  • Successfully involved in migration of stored procedures from Sybase IQ to SQL Server 2005.Involved in standardize, Remove duplicate and filter data with Quality stage.
  • Extensively involved in Fine tuning the jobs. Mentor development team on Data Stage, Oracle and DB2 UDB, Shell Scripts and Finance data.
  • Monitoring the Data stage jobs on daily basis by running the AUTOSYS scripts and made a force start whenever job fails.
  • Used Data Stage Director to validate and troubleshoot the jobs. Participated in weekly status meetings.

Environment: IBM Web Sphere/Information Server Data stage 8.0.1 (Data stage, Quality Stage), SAP R3, PVCS Version Controller, Oracle 10g, DB2 UDB, DB, SQL Server 2005/2008,Autosys, PL/SQL, UNIX,, Business Objects V6.5.

Confidential

Data stage Developer

Responsibilities:

  • Involved in reviewing Business/System requirements and other deliverables.
  • Designed the ETL jobs using Data stage, supporting all ETL process such as implementing Source to target mapping. Expertise in UAT, IT test cases, UT Results.
  • Worked extensively on different types of stages like Aggregator, Merge, Join, Lookup, Remove Duplicates, Transformer, Copy, Filter, Modify, Sort stages.
  • Investigate, Standardize, match frequency, Created stages to look up the data from the source and target tables.
  • Developed various shared containers, stages and validated and fine-tuned the ETL logic coded into jobs.
  • Responsible for validating the Data stage jobs, sequences against the pre-defined ETL design standards Tuned Source, Targets, jobs, stages and Sequences for better performance
  • Developed SQL Procedures for synchronizing data
  • Used Datastage Parallel Extender for splitting the data into subsets and to load data, utilized the available processors to achieve job performance, configuration management of system resources.
  • Extensively used IBM Web sphere Data stage Designer to develop processes for extracting, transforming, integrating and loading data from various sources into the data warehouse database
  • Created user defined transforms and routines for handling special cases
  • Extracted data from various sources, Transformed according to the requirement and Loaded into data warehouse schema using various stages like sequential file, Aggregator, Transformer stage
  • Extensively used SQL and PL/SQL coding in Data stage jobs for processing data
  • Develop UNIX shell scripts and schedule the jobs.
  • Developed batches and sequencers in designer to run and control set of jobs.
  • Used the Data stage Director and its run-time engine to schedule the job.

Environment: Data stage 7.5, Oracle (10g), UNIX, Shell Scripting and Auto sys tool.

Confidential

Data Mart Developer

Responsibilities:

  • Worked on the logical and physical design of the Data warehouse. Identified sources/targets and analyzed source data for dimensional modeling.
  • Good knowledge on credit increase plans to employers to offer new credit card packages. Worked in design of good credit, bad credit and credit increase data marts.
  • Created jobs to extract credit rating data from enterprise Data warehouse. Good knowledge on credit and debit processing. Worked on integration of Credit Claims ODS from legacy systems.
  • Designed and developed jobs for extracting, transforming, integrating, and loading data into data mart using Data Stage Designer, used Data Stage manager for importing metadata from repository, new job categories and creating new data elements
  • Worked with EBCIDIC files to extract data in required format.
  • Data Stage jobs were scheduled, monitored, performance of individual stages was analyzed and multiple instances of a job were run using Data Stage Director.
  • Used Parallel Extender for splitting the data into subsets, utilized Lookup, Sort, Merge and other stages to achieve job performance.
  • Used DS Erwin Meta Broker to import Erwin 4.x Metadata into Data Stage Repository.
  • Developed user defined Routines and Transformations for implementing Complex business logic.
  • As a part of report development, created the reports using universes as a main data provider and using the Powerful business objects functionalities, and formulae. Involved in trouble shooting of various reporting errors.
  • Created Business Objects reports, Queries with constant interaction with the end users. Trained end users in understanding the reports.
  • Functionalities such as Slice and Dice, Drill mode and Ranking were used for Multidimensional Formatting.
  • Web Intelligence was used to generate reports on the internet/intranet.
  • Provided 24/7 production support

Environment: IBM Web Sphere Data Stage 7.5, Meta stage 7.0, Business Objects 6.5, Informix, Oracle 9i, PL/SQL, SQL Plus, UNIX Shell Scripts, Windows 2000/NT 4.0, ERWIN 4.1.

Confidential

Data stage Developer

Responsibilities:

  • Involved in understanding Business Process and coordinated with Business Analysts to get specific user requirements to build the Data Marts.
  • Modeled the Star Schema Data Marts by identifying the Facts and Dimensions Created policy, premium and claim data marts.
  • Designed and developed the Data Stage server as well as parallel jobs for extracting, cleansing, transforming, integrating, and loading data using Data Stage Designer.
  • Used the Data Stage Director to schedule and monitor the running jobs.
  • Extensively developed ETL code using Data Stage server edition utilizing Sequential files, Join, Merge, Lookup Stage, Aggregator, Row generator, Dataset, Funnel Stage, Remove Duplicate Stage, Copy Stage, Change Data Capture and Column generator.
  • Set various environment variables and other parameters in Data Stage Administrator and also used it for managing the projects.

Environment: Data Stage 6, Oracle 9i, IBM AIX, SQL Server, Flat files, DB2, Erwin 4.0, UNIX Shell Scripting.

Confidential

Programmer Analyst

Responsibilities:

  • Interacted with business users in gathering the business requirements, identifying the relationship within and between the groups of data.
  • Created the Functional/Technical specification documents by maintaining standards of the enterprise
  • Designed the technical document for various jobs, unit test documents with various scenarios and acceptance level of test case results.
  • Actively participated in discussions and implementation of Error Handling and Reject management, Audit management process.
  • Designed and developed parallel jobs for extracting, cleansing, transforming and loading the data from the database and load into the ODS and GL
  • Used stored procedure stage in parallel jobs.
  • Worked extensively on different stages like Aggregator, Merge, Join, Copy, Modify, Lookup, Lookup File set, Filter, Oracle Enterprise, Column Generator, Row generator stages for Data cleansing and Data Transformation.
  • Used Autosys to schedule the jobs. Wrote shell scripts to schedule the job.
  • Used Data Stage Manager for importing & creating metadata definitions from repository, view and edit the contents of the repository.
  • Extensively worked in the performance tuning of the program, ETL Procedures and processes, tuning the SQL used in Transformations and fine-tuning the database.

Environment: Ascential Data Stage 5.1 (Designer, Director, Manager) Windows NT 4.0, Oracle 8i, PL/SQL, Sequential Files, MS Access, DB2, Erwin 4.0.

We'd love your feedback!