We provide IT Staff Augmentation Services!

Sr. Etl Datastage Developer Resume

4.00/5 (Submit Your Rating)

Cincinnati, OH

SUMMARY

  • Around 9 years of experience in software development with relevant exposure to Extraction Transformation Loading (ETL)andloadingDataMarts and implementingBI conceptsusing DataStage
  • Extensive experience in full life cycle development projects with System Life Cycle experience with Lean Agile and iterative development model. Expertise in Requirement gathering, Estimation, Analysis, Design, Coding, Testing, Configuration Management, Performance tuning, User Acceptance, Data Conversion, End User Training, Production support and Documentation.
  • Strong design and development experience in DataStage (9.1/8.7/8.0.1/8.1/7.5.1/7.5 ), Oracle 11g/10g/9i, PL/SQL, DB2, SQL Server 2005/2008, Shell scripts, AutoSys, Crontab Utility, TWS(Tivoli Workload Scheduler), Control - M, FTP.
  • Extensive experience in trouble shooting performance bottle-neck, performance tuning, Data migration with large scale application, involved in migrating DataStageprojectsand jobs
  • Sound knowledge in Banking, Insurance, Manufacturing, Retail and Mortgage.
  • Good experience in buildingFact, Dimension Tables and star/snowflake schema modeling, implementing Slowly ChangingDimension (SCD), Change Data Capture (CDC), ER modelingforOLTPand dimension modeling forOLAP, Reverse Engineering using Erwin.
  • Comprehensive knowledge in metadata for data dependencies, extracting source data from XML files, Sequential files, Flat files, zip files, transforming data and loading in DWH.
  • Involved in building customized routine, UNIX shell scripts for implementing business logic and scheduled the jobs using AutoSys, TWS scheduler and Cron tabs, SQL Server DTS Packages to integrate the data coming from heterogeneous sources to Staging Area.
  • Mentored complete onsite/offshore team for technical front and had ownership for the project delivery in terms of quality, meeting the industry standards, optimal solutions and technology and on time implementation. Active contributor in various project proposals, estimation and technical screening.
  • Strong decision-making skills, extremely well organized, good interpersonal, communication and presentation skills.

TECHNICAL SKILLS

ETL Tools: DataStage9.1/8.x, 7.x(Designer, Director, Manager, Administrator), Parallel Extender, Quality Stage, and Server Jobs, Informatica Power Center, Business Objects XI, Cognos

Data Modeling: Erwin, Star-Schema Modeling, Snowflakes Modeling, FACT & Dimensions

RDBMS: Oracle11g/10g/9i, MS Access, SQL Server 2005/2008, DB2, Teradata.

Languages: C, SQL, PL /SQL

OS: Windows NT/2000/2003/XP, UNIX, LINUX

Scheduling tools: AutoSys, Crontab Utility, TWS(Tivoli Workload Scheduler), Control-M, DataStage Director

CRM: Siebel Tools 8.1.1/7.8.2 , Enterprise Integration Manager (EIM)

OTHERS: HTML, SQL*PLUS, MS Visio, UNIX Shell Scripting, TOAD, SQL Developer, SQuirrel

PROFESSIONAL EXPERIENCE

Confidential, Cincinnati, OH

Sr. ETL DataStage Developer

Environment: IBM InfoSphere 8.1/9.1 (Designer, Director, Quality Stage), Sequential files, AQT, UNIX, Windows, MS Visio, Oracle 11g, SQL Server 2005, DB2UDB, XML, Sitescope, Remedy, TWS Scheduler, SAP Business Objects XI

Responsibilities:

  • Lead and mentor other team members on ETL design, development, best practices and performing complex tasks
  • Working with the client to gather, analyze and document business requirements. Developing source to target data mappings capturing business rules and logic. Ensuring data standards are being applied correctly and consistently to incoming data, database fields and value translations
  • Involved in Datamart architect, design and development as part of SwapDealerReporting and LCR Reporting
  • Translating business requirements into ETL processes using DataStage & SQL development.
  • Conducting data analysis of a large number of source systems to asses data quality
  • Developed DataStage custom routines to handle data validation & data scrubbing.
  • Extensively used Transformer, Sort, Merge, Aggregator, Funnel, Filter, Copy, Peek, Modify, Compare, Oracle/DB2/ODBC Enterprise, Aggregator, Change Capture, Difference and Remove Duplicates stages.
  • Analyzed data and developed jobs to include changing business rules and perform quality checks on data received from external vendors like Blackrock, Sunguard(Kiodex), Findur, Bloomberg
  • Develop ETL standards & best practices. Resolving ETL and Database performance issue
  • Efficient in all phases of the development lifecycle, coherent with Data Cleansing, Data Conversion, Performance Tuning and System Testing.
  • Created Task plans/change controls and provided support during Production Release’s.
  • Involved in Production Scheduling to setup jobs in order and provided 24x7 production support.
  • Efficient in incorporation of various data sources such as Oracle, MS SQL Server, and DB2, XML and Flat files into the staging area.
  • Involved in migrating projects from 8.1 to 9.1 and setting up 9.1 environments. Involved in compiling and testing jobs in 9.1.Tuned the DataStage repository and jobs for optimum performance.
  • Built new universe as per user requirements by identifying the required tables from Capital Markets ODS environment and by defining the universe connections. Also created and supported WebI reports and scheduled them to generate PDF files for end users.
  • Define process to create source package and deployment to different server (QA, UAT, and production)
  • Setting up Sitescope alerts and TWS scheduling
  • Creating remedy tickets and incident tickets

Confidential

DataStage Consultant

Environment: IBM InfoSphere 8.7 (Designer, Director, Quality Stage), Sequential files, SQuirrel, UNIX, Windows, MS Visio, Oracle 11g, DB2, XML, Control-M Scheduling, sFTP

Responsibilities:

  • Translating business requirements into ETL processes using DataStage & SQL development.
  • Conducting data analysis of a large number of source systems to asses data quality
  • Developed DataStage custom routines to handle data validation & data scrubbing.
  • Extensively used Transformer, Sort, Merge, Aggregator, Funnel, Filter, Copy, Peek, Modify, Compare, Oracle/DB2/ODBC Enterprise, Aggregator, Change Capture, Difference and Remove Duplicates stages.
  • Analyzed data and developed jobs to include changing business rules and perform quality checks on data received from external sources i.e.,Huon, PC and IC Staging.
  • Develop ETL standards & best practices. Resolving ETL and Database performance issue
  • Efficient in all phases of the development lifecycle, coherent with Data Cleansing, Data Conversion, Performance Tuning and System Testing.
  • Created Task plans/change controls and provided support during Production Release’s.
  • Involved in Production Scheduling to setup jobs in order and provided 24x7 production support.
  • Efficient in incorporation of various data sources such as Oracle, MS SQL Server, and DB2, XML and Flat files into the staging area.
  • Involved in process setup for migrating jobs from development to Test/PROD using manifest files as per Munich Re standards. Tuned the DataStage repository and jobs for optimum performance.
  • Created Control-M Scheduling jobs, scheduled and e-mailed status of ETL jobs to operations team daily.

Confidential, Cincinnati, OH

Sr. ETL DataStage Developer

Environment: Oracle 11g, DataStage 7.5/8.7, Sequential files, TOAD 8, UNIX, Windows, MS Visio, Sybase Powerbuilder 15, Tortoise SVN1.7.1.

Responsibilities:

  • Worked with business and end users to understand and gather requirements.
  • Converted business requirements into functional specification.
  • Coordinated and facilitated discussions between BSA’s and Technical Team for gap analysis and remove road-blocks where necessary.
  • Actively involved in design sessions and meetings with Team leader, Group Members and Technical Manager regarding Technical solution.
  • Coordinated and performed release testing in SIT and UAT environments by testing various scenarios and report its outcomes.
  • Debugged, analyzed and fixed the issues found while testing.
  • Primarily responsible to monitor and running of scheduler chains and also debug and resolve any failures for successful completion.
  • Reverse engineered DataStage jobs/Portals by extracting the logic and code to develop functional documentation.
  • Implemented the Add check points, automatically handle activities concepts in sequences
  • Responsible for integrating data from OLTP to enterprise-wide data warehouse to store reliable data for downstream support system using DataStage.
  • Created new mappings and updating old mappings according to changes in Business Logic Performed major role in understanding the business requirements and designing and loading the data into data warehouse.
  • Responsible for Gap analysis and translating business requirements into systems design.
  • Responsible to track and update the JIRA’s and check in the code into Tortosie SVN.
  • Identified issues and bottleneck within the code and fixed them for better performing application.
  • Extensively worked on performance tuning and optimization of SQL statements using explain plan, SQL trace and tkprof.
  • Analyze, design and develop stored procedures, functions, packages, materialized views and triggers using PL/SQL.
  • Actively involved in performance tuning brainstorming and resolution
  • Worked with Data Architects to come up with the database design.

Confidential, Cleveland, OH

Sr. ETL/DataStage Developer

Environment: IBM InfoSphere 8.1/8.7 (Designer, Director, Quality Stage), DB2 UDB, SQL Server 2008, Sequential files, TOAD 8, UNIX, Siebel 7.8, Windows, XML, Sharepoint

Responsibilities:

  • Requirement analysis/documentation, developing functional and technical specifications, DW and ETL designing, developing detailed mapping specifications, DFD's and scheduling charts.
  • Building the SQL queries for BD2 UDB to fetch the data from the Database as per the business requirement and use the SQLqueries in the DataStage for father processing.
  • Designed and developed all subject modules using DataStage engine. Applied validation rules, constraints using DataStage variables and transformations.
  • Designed Parallel jobs using various stages like Transformer, join, merge, Lookup, CDC, remove duplicates, filter, modify, aggregator and funnel stages.
  • Converted complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance
  • Developed and modified IFB files to load data from staging area into Interface tables and into Siebel base tables using EIM
  • Responsible for importing LOV, Position, Employee, Contacts, Accounts and Opportunity Data from legacy systems using EIM
  • Created parameter sets to group DataStage job parameters and store default values in files to make sequence jobs and shared containers faster and easier to build.
  • Created source to target mapping and job design documents from staging area to Data Warehouse.
  • Developed job sequence with restart ability, check points and implemented proper failure actions.
  • Generated completion messages, Status reports using capabilities of job control sequence and UNIX. Responsible for UNIT, System and Integration testing. Participated in UAT (User Acceptance Testing).
  • Created a WaitforFile Activity jobs, Interface Notification and DataStagesequences to load the data into Target and send the success/failure reports to the end users via email within 3 week window after technical proof of concept initiatives.
  • Used DataStage Director to run and Monitor the jobs performed, automation of job control using Batch logic to execute and schedule various DataStage jobs.
  • Worked with DataStage Director for setting up production job cycles for daily, weekly monthly loads with proper dependencies.
  • Maintaining the support matrix and updating the remedy ticket for analysis purpose.

Confidential

ETL Developer

Environment: IBM InfoSphere 8.0.1/8.1 (DataStage, Director, Quality Stage, ProfileStage/Information Analyzer), Oracle 10g, DB2 UDB, Flat files, Sequential files, TOAD 8, SQL *Plus, UNIX, Windows

Responsibilities:

  • Developed/Designed various new processes and fixed the existing process with new business requirements, various meetings with user inputs
  • Fixed DataStage job defects logged due to upgrade to DataStage 8.0.1 version from DataStage 8.1
  • Done setup of project level environment variables for all existing projects and cleanup of unwanted existing jobs from DataStage 8.1.
  • Designed and developed jobs for extracting, transforming, integrating and loading data into data mart using DataStage Designer. Developed, executed, monitored and validated the ETLDataStage jobs in the DataStage Designer and Director Components
  • Responsible for integrating data from staging area to enterprise-wide data warehouse to store reliable data for decision support systems using DataStage.
  • Reviewed and documented the required data validation rules on the source feed files that were used in ETL.
  • Used several stages like Sequential file, Aggregator, Funnel, Change Capture, Change Apply, Row Generator(debugging Stage), Peek, Remove Duplicates, Copy, Lookup and RDBMS during the development process of the DataStage jobs.
  • Customized UNIX scripts as required for preprocessing steps and to validate input and output data elements, along with DataStage routines
  • Used Information Analyzer for Profiling tasks and QualityStage for Cleansing Tasks.
  • Generated Surrogate Keys for composite attributes while loading the data into Data Warehouse using Key Management function. Developed Complex ETL programs to implement Slowly changing Dimensions (Type 1 and Type 2)
  • Created shared containers and multi instance jobs to enhance the performance by using more modular components.
  • Worked closely with manager in the process of standardizing job parameters, job flows and disaster recovery strategies.
  • Created shared containers and multi instance jobs to enhance the performance by using more modular components.
  • Worked with DataStage Director for setting up production job cycles for daily, weekly monthly loads with proper dependencies.
  • Completely integrated CDM process in to ETL for reconciliation through DataStage.
  • Used DataStage RTI WebServices, XML-input, XML-output, Oracle Plug, DataStage user defined routines, job sequences, before and after job subroutines.

Confidential

ETL Consultant

Environment: DataStage 7.5.1 Enterprise Edition/Parallel Extender, Quality Stage, UNIX Shell Scripting, SQL Server 2005, Oracle 10g, Erwin 7.0, MS Access, TOAD, AutoSys.

Responsibilities:

  • Involved in meetings with Team leader, Group Members and Technical Manager regarding any Technical and Business Requirement issues.
  • Used DataStage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data fromOracle, MS Access and mapped the data into a target business warehouse.
  • Extensive experience in creating and loading Data Warehouse tables like dimensional, fact and aggregate tables using DataStage
  • Developed logical and physical data models, design data access strategies and wrote SQL code to access and manipulate data stored in OLAP databases.
  • Constructed data volumes mostly adhering to Star Schema using strong knowledge of Data Warehousing, Star Schema, Fact and Dimension Tables.
  • Extensively used Pivot stage to pivot the source data to achieve required table structures like converting data from rows into a column.
  • Involved in Designing, Source to Target mappings between sources to operational staging targets. Implemented logic for Slowly Changing Dimensions.
  • Followed the concepts of Naming conventions, parameterizing the variables from Global Environment to stage level.
  • Developed jobs in Parallel Extender using different stages like Transformer, Aggregator, Lookup, Source Dataset, external filter, Row generator and Column Generator.
  • Imported Metadata from Oracle database. Imported metadata definitions into the repository. Exported and imported DataStage components using DataStage Manager.
  • Used Parallel Extender for parallel processing of data extraction and transformation.
  • Extensively worked with various stages of Parallel Extender like Sequential file, Dataset, lookup, peek, transformer, Merge, Aggregator, row generator, surrogate key generator and many more to design jobs and load the data in to Fact and Dimension tables.
  • Worked on DataStageOracle stages like Oracle Bulk Loader and Oracle OCI with DataStage jobs in loading the data.
  • Monitoring the DataStage jobs on Daily/Weekly/Monthly basis by running the AutoSys Script and made a force start whenever job fails
  • Developed job sequence by identifying independent and dependent flows with proper rollback strategies incorporated in the sequences

We'd love your feedback!