We provide IT Staff Augmentation Services!

Datastage Technical Lead /architect Resume

4.00/5 (Submit Your Rating)

Lincoln, RI

SUMMARY:

  • 10 plus years of IT experience in the software development life cycle (SDLC) starting from collecting business specifications, user requirements, confirming the design decisions regarding data, process, interfaces, reviewing/audit the code and documenting, Implementation and Testing of ETL applications for Retail, financial, Healthcare, Telecommunications, Chemical and Education industries using Data Extraction, Data Transformation, Data Loading and Data Analysis.
  • Experience in populating and maintaining Data warehouses and Datamarts using IBM Information Server 11.3,9.1, v8.7,8,5, Ascential DataStage v7.5.x/7.x/6.x (Administrator, Director, Manager, Designer) - Server Edition, Enterprise Edition (Parallel Extender),IBM Infosphere information Analyzer, IBM infosphere Metadata Workbench, Infosphere Business Glossary and IBM infosphere Quality Stage.
  • Experience with Hadoop, HDFS, HBASE, Hive, pig concepts
  • Experience in designing Batch jobs and Job Sequences for scheduling server and parallel jobs using DataStage Director, UNIX scripts
  • Experience in scheduling Data Stage jobs using AutoSys, Crontab, Control M, Tidal and DataStage Director
  • Extensively worked on Quality Stage for data investigation, standardization, enrichment, and probabilistic matching
  • Expertise in Data Modeling, Designing of Logical and Physical Data Mart using Star Schema methodology using Erwin 4.0.
  • SME on building Enterprise DataWarehouse or Datawarehouse appliances from Scratch using both Kimball and Inmon Approach.
  • Experience in Business Intelligence tools like Business Objects XI 6.5/6.0/5.1 (Web Intelligence, Designer, Developer Suite, Universe Developer, Set Analyzer 2.0, Reporting)
  • Working Expertise SAS Data warehouseProgramming,Mainframe
  • Experience with the design of large-scale ETL solutions integrating multiple source systems DB2, SQL Server, Oracle and Teradata and SSIS
  • Created and implemented ER models and dimensional models (star schemas).
  • Proven track record in troubleshooting of DataStage jobs and addressing production issues like performance tuning and enhancement.
  • Experience on Production job scheduling on UNIX through AUTOSYS scheduling tool, Control M and also using DataStage Job Sequence.
  • Extensive knowledge in Pipeline/Partition concepts and techniques - Round Robin, Entire, Hash by Field, Modulus and Range.
  • Experience in Parallel Extender (DS-PX) developing Parallel jobs using various stages including Data set, Aggregator, Join, Transformer, Sort, Merge, Filter, Funnel, Lookup, Hash, FTP, Difference, Change Capture, Change Apply, Pivot etc.
  • Strong Skills in Coding (Stage Variables, Constraints Routines & Derivations) based on Business logics in Transformation Stage.
  • Strong understanding of the principles of Data Warehouse using Fact Tables, Dimension Tables, Star and Snowflake schema modeling.
  • Strong experience in UNIX Shell and Perl scripting as part of file manipulation, Scheduling and text processing

TECHNICAL SKILLS:

ETL Tools: IBM Infosphere DataStage 11.3,9.1,8.7,8.5 Ascential Datastage 7.x&6.0 XE/5.2 (Parallel Extender), IBM Infosphere Information Analyzer 8.1, IBM infosphere Quality stage, IBM infosphere Metadata Workbench, Infosphere Business Glossary, FastTrack, Informatica (Power Center 7.x/8.x/9.x)

Reporting Tools: Cognos 8 BI(Certified)

Data Modeling Tools: ERwin r7.1/7.2/7.3/8.0,ER Studio 8.5.3

Databases: DB2 UDB 9.1,Oracle 10g/9i/8i/7.x,Teradata V2R3/V2R4.1, MS SQL Server 7.0/6.5, Sybase12/11.9/10, DB2 UDB, MS Access 2000/97

Tools: SQL*Plus, SQL*Loader, Toad 9.5, AQT( Advanced Query Tool kit),Aqua Data studio

Operating Systems: IBM AIX 4.3/4.2, HP-UX, Linux, Windows NT/95/98/2000

Programming Languages: SQL, PL/SQL, Unix Shell Scripting, C++ Java 2.0, HTML, DHTML

PROFESSIONAL EXPERIENCE:

Confidential, Lincoln, RI

Datastage Technical Lead /Architect

Responsibilities

  • Migrated data from Mainframe billing center application to enterprise datawarehouse using IBM infosphere Datastage 11.3 as middle ware tool
  • Designed and Architected ETL jobs for Billing center module
  • extensively worked with data coming from XML files and parsed them using XML assembly editor stage and loaded data to enterprise DW systems
  • Billingcenter module data was migrated from Mainframes to Guidewire data successfully.
  • Migrated all datastage repository jobs from Datastage 8.7 to 11.3 successfully
  • Worked with Business users to fix defects and implemented the best practices for conducting unit testing and integration testing and documenting the test results for user acceptance.
  • created Batch scripts and scheduled jobs using Control-M scheduling tool
  • worked on business requirements in OLTP and OLAP models on logical and physical aspects in the model development life cycle
  • worked on creating a data model for Conceptual and Logical models using ERWIN 9.5.2
  • Derived DDL's as per business requirements
  • Billing center jobs execute every weekends, Provided 24/7 production support for billing center module

Environment: IBM Infosphere DataStage 11.3, DB2 UDB,SQL Server 2008, Control-M, Windows Batch scripting, HP Quality center 10.0, ERWIN 9.5.2

Confidential, Cincinnati, OH

Datastage Technical Lead Developer

Responsibilities

  • Analyzed business requirements of KYC and SDR reporting and LCR for Basel IIIcompliance, created functional and Technical mapping documents for technical development.
  • Designed and developed KYC and SDR reporting modules for customers and Counter parties and loaded data in to Data marts.
  • Designed LCR Numerator and Denominator extracts from SDR and KYC modules and loaded data in to BASEL IIIcalculator DB.
  • Migrated Datastage jobs from 8.7 to 11.3 successfully.
  • Parsed EDCIDIC data to ASCII format, COBOL and XML files using datastage logics.
  • Architected ETL design for creating ETL jobs and Database tables for LCR Project.
  • Built Operational Data Store (ODS), Data Marts, using Multidimensional Model (Kimball),Star and Snowflake schema design.
  • Created Data stage jobs using complex stages like Transformer, Pivot, Aggregator, Sort, Join, Merge, Lookup, Data Set, Funnel, Remove Duplicates, Copy, Modify, Filter, Change Data Capture, Change Apply, Sample, Surrogate Key, Column Generator, Row Generator, Etc.
  • Used SCD Type 2 in loading in to data warehouse for nearly 400 change key columns, created UNIX scripts for FTP'ing data from different servers.
  • Worked with Business users to fix defects and implemented the best practices for conducting unit testing and integration testing and documenting the test results for user acceptance.
  • Used TWS for scheduling datastage jobs.

Environment: IBM Info sphere DataStage 8.7,11.3,DB2 UDB, AQT,TWS scheduler, Unix Shell scripting, HP Quality center 10.0, ER Studio 8.0.3

Confidential, Philadelphia, PA

Datastage Technical Lead Developer

Responsibilities

  • Analyzed user requirements from business standpoint and defined functional specifications and source to target mapping documents SQR RateLoad and HCR billing projects
  • Transformed Xml source data with Assembly editor and loaded data in to Marketing database
  • Applied complex datastage logics for obtaining health insurance rates from Subsidized(Healthcare.gov) systems
  • Designed and developed SQR (Sales Quote Renewal) system which migrates data from Blue core exchanges (MHS, LEGACY, INFOCUS, GUS) systems to Highmark systems and loaded data in to Marketing database.
  • Designed and developed HCR billing (Health care Reform) systems used to get subsidy rates from Healthcar.gov systems.
  • Parsed COBOL mainframe files and loaded data in to Data Repository
  • Migrated data from Teradata data warehouses to Marketing Database Oracle systems
  • Used Teradata Utilities (BTEQ, FASTLOAD, FASTEXPORT, MULTILOAD)
  • Created Data stage jobs using complex stages like Transformer, Pivot, Aggregator, Sort, Join, Merge, Lookup, Data Set, Funnel, Remove Duplicates, Copy, Modify, Filter, Change Data Capture, Change Apply, Sample, Surrogate Key, Column Generator, Row Generator, Etc.
  • Responsible for unit testing using HP Quality center 10.0
  • Worked with Business users to fix defects and implemented the best practices for conducting best unit testing and integration testing and documenting the test results for user acceptance.
  • Provided 24/7 production support for SQR and HCR Billing systems.

Environment: IBM Info sphere DataStage 8.7, Teradata,SQL Server,Teradata SQL Assistant,Oracle 11g,TWS scheduler,Unix Shellscripting, HP Quality center 10.0

Confidential, Akron, OH

Senior Datastage Developer

Responsibilities

  • Analyzed user requirements from business standpoint and defined functional specifications and source to target mapping documents for Legacy Remediation project
  • Parsed and transformed XML input data from claims center and loaded data in to Policy ODS
  • Used new XML parser stage with assembly editor for converting XML data coming from Claims Centre
  • Extensively worked with Join, Look up (Normal and Sparse) and Merge stages.
  • Extensively worked with sequential file, dataset, file set and look up file set stages.
  • Extensively used Parallel Stages like Row Generator, Column Generator, Head, and Peek for development and de-bugging purposes.
  • Used the Data Stage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on ad hoc or scheduled basis.
  • Worked with NZLoad to load flat file data into Netezza tables
  • Tuned the DataStage repository and jobs for optimum performance and Parameterized DataStage jobs to allow portability and flexibility during runtime
  • Responsible for unit testing and SIT testing of Legacy Remediation project using HP Quality center 10.0

Environment: IBM Info sphere DataStage 8.5, DB2 UDB 9.1, UNIX, Crontab, Netezza4.6.8

Confidential, Fort Washington,PA

Datastage Technical Lead/Developer

Responsibilities

  • Designed, developed and monitored DataStage Server & Parallel jobs using DataStage 8.1.
  • Complicated jobs were developed to include changing business rules and perform quality checks on data received from external vendors like TSYS, Axiom etc
  • Extensively used Lookup, Join, Merge stages for joining various information and also used Parallel Transformer, Column Generator, Funnel, Filter, Switch, Modify, Pivot, Row Generator etc for the development of the DataStage jobs.
  • Analyze user requirements and defining functional specifications for BASEL requirement
  • Design and Build a Mortgage Data Warehouse (Mortgage and Auto ) to establish a central data repository by storing historical data in Data Valut
  • Used IBM LSF for load balancing
  • Successfully completed BASEL II compliance in Ally financial Mortgage Data warehouse
  • Designed a Data Mart for BASEL II reporting needs for the bank holding company (BHC)
  • Designed and developed CMS and CCSII modules where the source systems have exclusive information regarding Gurantor’s and Assets
  • Designed batch jobs and job sequences for scheduling servers and parallel jobs using Data Stage Director and Unix Scripts
  • Develop and implement ETL applications
  • Transform and enroll data into the data warehouse and data marts
  • Develop and implement test validations of the data warehouses and data marts
  • Analyze test results and recommending modifications to the data warehouses and data marts as required by the project
  • Document modifications and enhancements made to the data warehouses and data marts
  • Involved in Developing and handling the PL/SQL Packages, Procedures, functions and Database Triggers.
  • Created SQL*Loader scripts to load flat files/data into temporary staging/database tables.
  • Involved in troubleshooting the locks/corrupted DS Jobs through DataStage Administrator or UNIX environment.
  • Created Task plans/change controls and provided support during Production Release’s.
  • Supporting the migration of Datastage 7.5.2 to version 8.1.

Environment: IBM InfosphereDataStage 8.7, ETL, Pl/SQL Oracle 10g, UNIX, Tidal, Agile methodology

Confidential, Sacramento CA

Datastage Tech Lead

Responsibilities

  • Worked closely with installation of Infosphere DataStage 8.5, in FTB environment
  • Designed Conversion Architecture and Methodology for various mainframe source systems and loaded them in to EDW
  • Designed and developed the Levy Module for Industrial taxation
  • Identified the Facts and Dimensions using Erwin Data modeling tool to represent the Star Schema Data Marts.
  • Frameworks were developed using advanced PL/SQL concepts like collections - (Index by tables, Nested tables, variable arrays), transaction processing - (Bulk binds, Managing transactions, Autonomous transactions) etc.
  • Responsible for understanding Business Process and managing with Business users to meet specific user requirements.
  • Extensively used Autosys for automation of scheduling jobs on daily, bi-weekly, weekly monthly basis with proper dependencies
  • Developed strong partnerships and lead efforts across teams to promote re-use and develop consistent technical build, implementation and support process
  • Involved in design, source to target mappings between sources to operational staging targets
  • Extensively used stages available to redesign Data Stage jobs for performing the required integration.
  • Executed jobs through sequencer for better performance and easy maintenance.
  • Used Data Stage Director to run and monitor the jobs for performance statistics.
  • Designed Unit Test Cases and SIT test scripts.
  • Performed the Unit testing for jobs developed to ensure that it meets the requirements.

Environment: IBM Infosphere DataStage 8.5, IBM Infosphere Information Analyzer 8.1, DB2 9.5, UNIX IBM AIX, MDM, FastTrack, Meta Data Work Bench, Autosys.

Confidential, Sunnyvale, CA

IBM Datastage Lead Developer

Responsibilities

  • As a Lead on-site/off-shore coordinator I was leading a team of 8 persons in the off-shore and 2 persons in the on-site, handling Siebel track enhancements tasks and Master sequence team tasks.
  • Involved in understanding the scope of application, present schema, data model and defining relationship within and between groups of data.
  • Used DataStage Parallel Extender to load data, utilizing the available processors to achieve job performance, configuration management of system resources in Orchestrate environment.
  • Designed and developed siebel forecast module for forecasting sales
  • Worked on Agile methodology in developing the project.
  • Involved in loading Deal decisioning and Deal Processing data in Data warehouse. This required various complex data transformations, with the involvement of number of tables.
  • Optimized development resources by understanding the data before starting development because it identified bad, missing, incorrect, and redundant data.
  • Reduced data analysis time by as much as 50% using automated data profiling and analysis capabilities
  • Used the DataStage Director for running the job, testing and debugging its components, and monitoring the resulting executable versions
  • Participated in source to target mapping design document, prepared system requirement documents based on data model and source target mapping documents.
  • Performed the Unit testing for jobs developed to ensure that it meets the requirements
  • Responsible for Planning UAT Testing
  • Populated data to meet the obiee reporting requirements and used to get delta for comparison of reports

Environment: IBM Websphere DataStage 8.0.1, IBM Infosphere Information Analyzer 8.1, Oracle 10g, UNIX IBM AIX, obiee 10.1.3.4.1

Confidential, Pleasanton, CA

Senior Datastage Developer

Responsibilities

  • Created low-level design and developed various jobs and performed data loads and transformations using different stages of DataStage and pre-built routines, functions
  • Involved in understanding the scope of application, present schema, data model and defining relationship within and between groups of data.
  • Migrated existing Java programmed jobs in to Datastage jobs by analyzing the business logic
  • Created data stage jobs at various levels in LARC Reseller system
  • Created shell scripts for e-mailing the reports that were generated by different teams in Confidential like TRACS,LARC Reseller, PAYGO
  • Populated Blackhawk Date Dimension table for 20 years where there is no data in the table for the future years after 2010
  • Worked on programs for scheduling data loading and transformations using DataStage from legacy system to DB2.
  • Tuning the DataStage repository and jobs for optimum performance and Parameterized DataStage jobs to allow portability and flexibility during runtime
  • Performed the unit testing and integration testing of the module.
  • Supported EDW application 24/7
  • Performed the Unit testing for jobs developed to ensure that it meets the requirements
  • Worked closely with IBM team to install IBM Infosphere Datastage 8.1 in AIX platform.
Environment: IBM infosphere DataStage 8.1,, IBM Infosphere Information Analyzer 8.1, DB2 UDB 9.1, UNIX IBM AIX, Linux, Shell Scripting, IBM Tivoli Manager, J2EE, Microstrategy 8.

Confidential, Tampa, FL

Senior Datastage Developer

Responsibilities

  • Understand business needs and implement the same into a functional database design.
  • Extensively used almost all of the stages and transforms of DataStage for various types of data conversions.
  • Implemented dimensional model (logical and physical) in the existing architecture using ERWIN
  • Worked on programs for scheduling data loading and transformations using DataStage from legacy system to DB2.
  • Identify business rules for data migration and perform data administration through data models and metadata.
  • Data quality analysis to determine cleansing requirements.
  • Optimized query performance, session performance, and reliability.
  • Tuning the DataStage repository and jobs for optimum performance.
  • Developed multiple jobs using OCI, hashed file, aggregator, sequential file stages.
  • Performed the unit testing and integration testing of the module.
  • Tested reports for SABIT and co-coordinated with testing group.
  • Create multiple shell scripts for cleaning and loading data and scheduling DS job process.
  • Support SABIT administrators with DataStage application for production.

Environment: DataStage 7.5.2, DB2 UDB 8.1(Migrated from 7.1, UNIX IBM AIX, Shell Scripting (Korn /KSH, AWK), IBM WebSphere, IBM Tivoli Manager, J2EE.

Confidential, MN

Datastage Developer

Responsibilities

  • Involved in understanding the scope of application, present schema, data model and defining relationship within and between groups of data.
  • Good hands on exp with Datastage 8.0.
  • Extensively used Lookup, Join, Merge stages for joining various information and also used Parallel Transformer, Column Generator, Funnel, Filter, Switch, Modify, Pivot, Row Generator from various database DB2 Enterprise, Oracle Enterprise.
  • Experience in IBM info server and SAP integrations.
  • Involved in loading Deal decisioning and Deal Processing data in Data warehouse. This required various complex data transformations, with the involvement of number of tables.
  • Participated in source to target mapping design document, prepared system requirement documents based on data model and source target mapping documents.

Environment: Ascential DataStage XE/7.5.1 8.1, SQL, Db2 v9/8.2,Metastage, Quality Stage 7.5,Java J2EE, Teradata V2R4, IBM AIX4.3, Erwin 4.1, IBM AIX 4.3, AUTOSYS, Clear Case.

Confidential, OH

Datastage Developer and Prod support

Responsibilities:

  • Involved in understanding the scope of application, present schema, data model and defining relationship within and between groups of data
  • Analyzed the transactional data model, data elements. Interacted with Business analyst, SME (subject matter experts) on day-to-day basis to create technical spec for data conversion programs. Involved in the Development, Implementation of the backend systems for the Database.
  • Worked with a team of DBAs to perform roles as SQL data access and table, maintenance codes
  • Physical Design, Data Analysis, Development, Testing, Production Support and mentoring,
  • Worked on Performance Tuning of DataStage Jobs to ensure faster Data Loads.
  • Worked with off shore team and coordinated with Data leads for data coming from Europe.
  • Extensively used DataStage Designer to develop jobs for extracting, transforming, integrating and loading data from various sources into the Data Warehouse database

Environment: Ascential DataStage XE/7.5.1,8.0. A (XE/390, infosphere, Parallel Extender, Designer, Manager, Administrator, Director), DB2 UDB V6.1/7.1

Confidential

Datastage Analyst

Responsibilities:

  • Developed the database using ER Model.
  • Stored procedures and triggers were developed to maintain integrity of the database
  • Designed forms for data entry, patient information and validation
  • Generated custom reports to track patient progress, to print bills and generated vouchers
  • Created indexes for fast retrieval of information
  • Backup and recovery was performed on weekly, monthly basis
  • Used DataStage Manager to export and import jobs in different environments of development and production

Environment: Ascential DataStage XE/7.1 Oracle 7, Toad, Oracle Forms 4.5 and Reports 2.5, Windows NT, CVS.

We'd love your feedback!