We provide IT Staff Augmentation Services!

Sr.datastage Developer Resume

3.00/5 (Submit Your Rating)

Mclean, VA

SUMMARY

  • Over 7 years of experience in the IT industry with extensive skill set dedicated to Business and System Analysis, Data Modeling, Data warehousing on Client, Server and Web - Enabled Systems, which mainly includes expertise in Development and Implementation of Data Warehouse applications using ETL tool IBM Information Server (IBM Websphere DataStage 8.5/8.1/8.0.1/7 x/7.5 DataStage Enterprise Edition (Parallel Extender).
  • Expertise in Development and Implementation of Data Warehouse applications using ETL tool IBM Websphere DataStage 8.5/8.1/8.0.1/7 .5.2.
  • Strong combination of business analysis, database and data warehouse (OLAP) technical experience and over six years of experience in IBM Websphere DataStage.
  • Involved in conducting design and review sessions with Consulting staff and Management.
  • Experience in design and implementation of Server and Parallel jobs including Batches and Job Sequencers.
  • Extensive experience in Database/Datawarehousing/Client/Server/Legacy applications for Banking, Reinsurance, Financial, Pharmaceutical and other industries using Data Analysis, Data Modeling, Data Extraction, Data Transformation and Data Loading.
  • Participated in all phases including requirements analysis, client interaction, coding, testing and documentation.
  • Expertise in OLTP/OLAP System Study, Analysis and E-R modeling, developing Database Schemas like Star schema and Snowflake schema used in Relational, Dimensional and Multidimensional modeling.
  • Comfortable in using ERwin 4.0/3.5 Tool for Logical and Physical data modeling.
  • Experience in writing Unix Shell programming/scripting for various purposes like file validation and job scheduling.
  • Extensive experience in Teradata 12.0, Oracle 11g/10g/9i/8i, Database development experience using PL/SQL, Stored Procedures, Triggers, Functions, Packages, Views and Oracle Objects.
  • Experience in Designing, Developing, Reengineering, Deploying and fine-tuning Oracle Stored Procedures.
  • Experience in HP Quality Center to manage manual and automated test cases and to track defects.

TECHNICAL SKILLS

ETL Tools: IBM Information Server (IBM Websphere DataStage 8.5/8.1/8.0.1/7 .x, Parallel Extender (PX), IBM Websphere QualityStage, Information Analyzer, Business Glossary)

RDBMS: Teradata 12.0, Oracle 11g, 10g, 9i, 8i (SQL Plus, PL/SQL, Report Writer), DB2 8.x, Sybase, SQL Server 2005, MS Access

Development Languages: C, C++, SQL, PL/SQL, BASIC and PASCAL

Web Technologies: ASP, HTML, Macromedia Flash and Dream Weaver

Operating Systems: UNIX, Red Hat LINUX, Windows NT 4.0., VISTA

Other: TOAD 9.5.0, SQL Developer, ERwin, Rapid SQL 8.1.1

PROFESSIONAL EXPERIENCE

Confidential, Mclean, VA

Sr.DataStage Developer

Responsibilities:

  • Interact with Business Analysts and technical teams to gather and baseline business and technical requirements for the project.
  • Design and Develop ETL jobs to extract data from various sources and load to Corporate Data warehouse (CDW).
  • Develop ETL jobs to read and load high volume Type 2 Slowly Changing Dimensions data in Multi-Dimensional star schema.
  • Extensive use of Parallel Job Stages like Sybase Enterprise, Oracle Connector, DB2/UDB Enterprise, Dataset/Fileset, Aggregator, Join, Transformer, Sort, Merge, Filter, Modify, Lookup, Funnel, Pivot and custom stage (Date Close Operator).
  • Work on Head, Tail and Peek stages for debugging DataStage jobs.
  • Work on shared containers to re-use the code across the project.
  • Create multiple shell scripts to pass required parameters to ETL jobs and run.
  • Write SAS code to produce Data Quality (TDQ) reports for Data loaded from ETL to Target Database (DB2).
  • Responsible for creating technical design and unit test documents for promoting the code to SIT (Integration testing).
  • Responsible for all the documentation and approvals for moving the code to PROD.
  • Write and Optimize complex SQL queries for better performance of ETL jobs.
  • Work with Technology Change Management team to migrate code to higher environments (SIT, UAT and PROD) from DEV.
  • Involve in Integration and Performance testing.
  • Maintain versions of code by using ClearCase and TeamForge.
  • Design Autosys scheduling scripts to schedule DataStage jobs and run then through Autosys scheduler.

Environment: IBM Datastage 8.5, UNIX, Autosys, DB2, Oracle 11g, Sybase, Rapid SQL 8.1.1, ClearCase, TeamForge

Confidential, Charlotte, NC

DataStage Lead/Sr. Developer

Responsibilities:

  • Coordinate requirement-gathering sessions with business analysts, end users and people from the involved departments.
  • Convert Functional Requirements into Technical Specifications, developed project management methodology, estimated storage requirements and identified information delivery strategy.
  • Work with Offshore team as on-site coordinator.
  • Extensively using DataStage Designer stages such as Aggregator, Transformer, Join, Merge, Dataset, Lookup and Modify.
  • Extensively using Stage variables in jobs to take care of where clause before aggregations.
  • Develop multiple jobs using DB2 connector and Oracle connector stages to extract and load data from/to database and run in multiple instances through job sequences.
  • Develop batch jobs to maintain day to day updates and a process to check if source and target are in sync or not.
  • Create hash tables used for referential integrity and/or otherwise while transforming the data representing valid information.
  • Use hash file look-upfor better performance of jobs.
  • Tune DataStage transformations and jobs to enhance their performance.
  • Involve in creating Materialized views over target tables for end-user queries and use cases.
  • Use DataStage Manager Utilities in designer for importing metadata from shared metadata in Metadata workbench.
  • Use DataStage Director to validate, run and monitor the DataStage jobs.
  • Maintain versions of code by using Clear case.
  • Create multiple shell scripts for archiving, cleaning and scheduling DS job process.
  • Design Autosys scheduling scripts to schedule DataStage jobs and run then through Autosys scheduler.

Environment: IBM Websphere Datastage 8.5, Quality Stage, Information Analyzer, Fast Track, Metadata Workbench, Business Glossary, UNIX, Autosys, Oracle 11g, DB2, ClearCase.

Confidential, Jacksonville, FL

Sr DataStage Developer / Production Support

Responsibilities:

  • Understand business needs and implement the same into a functional database design.
  • Prepare the Mapping document for new development in DataStage jobs.
  • Work with Offshore team as on-site coordinator.
  • Design the DataStage Jobs & providing technical support to off shore team.
  • Use DataStage Manager utilities in designer for importing metadata from repository, creating new sequential file definitions and importing/exporting jobs.
  • Use DataStage Director to validate, run and monitor the DataStage jobs.
  • Use Parallel Extender Development/Debugging stages like Row generator, Column Generator, Head, Tail and Peek.
  • Use Lookup, Join and Merge stages for joining various information and also use Parallel Transformer, Column Generator, Funnel, Filter, Switch, Modify, Pivot, Row Generator.
  • Responsible for performance tuning of the ETL process and upgrading the ETL best practices document.
  • Use both Pipeline and Partition Parallelism for improving performance.
  • Investigate data to identify errors and validate the contents of fields in a data file.
  • Tune the DataStage repository and jobs for optimum performance.
  • Develop multiple jobs using Teradata stages that include Teradata Connector, Teradata Enterprise, Teradata Multiload to connect to database, hashed file, aggregator and sequential file stages.
  • Create multiple shell scripts for cleaning and loading data and scheduling DS job process.
  • Design Autosys scheduling scripts to schedule DataStage jobs and run then through Autosys scheduler.

Environment: IBM Websphere Datastage 8.1,UNIX, Shell Scripting, Autosys 4.5, Teradata 12.0.

Confidential, Philadelphia, PA

Sr DataStage Developer

Responsibilities:

  • Design DataStage ETL jobs for extracting data from heterogeneous source systems, transform and finally load into the Data Marts.
  • Use stages like Transformer, Complex flat file stage and DB2 load ready stage to write the data from the various sources into the target Data marts.
  • Identify other source systems like Oracle, SQL Server their connectivity, related tables and fields and ensure data suitably for mapping.
  • Develop Parallel jobs using stages Change Capture, Change Apply, Head and Surrogate Key Generator etc.
  • Develop Server jobs using stages ODBC, Link Partitioner, Aggregator, Transformer, Link Collector and Hash File etc.
  • Generate Surrogate IDs for the dimensions in the fact table for indexed and faster access of data in server jobs.
  • Create surrogate key tables to map the required dimensions.
  • Create hash tables used for referential integrity and/or otherwise while transforming the data representing valid information.
  • Use hash file look-up for better performance of jobs.
  • Create re-usable components using shared containers for local use or shared use.
  • Import and export of repositories across projects.
  • Create Error Files and Log Tables containing data with discrepancies to analyze and re-process the data.
  • Write routines for transforming Nulls to default values.
  • Troubleshoot the designed jobs using the DataStage Debugger.
  • Tuning DataStage transformations and jobs to enhance their performance.
  • Write PL/SQL stored procedures for writing data into date dimension.
  • Use the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on an ad hoc or scheduled basis.
  • Create job schedules to automate the ETL process.
  • Involved in creating technical specifications, migration specification and unit tests.

Environment: Ascential DataStage 8.1 (Designer, Director, Manager, Debugger, DataStage BASIC language Expressions), Windows NT 4.0, IBM AIX 5, Oracle and MS Access.

Confidential, Princeton, NJ

ETL DataStage Developer

Responsibilities:

  • Analyzed, designed and developed ETL jobs for Vendor Feeds.
  • Encrypted files before sending to vendors.
  • Created shell scripts to integrate the process of Hashing, Encrypting and FTP.
  • Created Datastage jobs to load data to Internal data feeds.
  • Scheduled and monitored the HR HUB Vendor feed jobs in Production.
  • Reviewed the errors in Organizational Manager production jobs and apply fixes.
  • Documented the HR HUB InBound and OutBound process.
  • Created the logical and physical data model for HR Data Mart.
  • Implemented Slowly Changing Dimension Type2 process for HR Data Mart.
  • Developed jobs to load dimension and fact tables.
  • Maintained the DataMart database objects.
  • Documented the entire ETL Process in the ETL Design document.
  • Improved the run time for the process that loads the fact table.\

Environment: IBM WebSphere DataStage 8.0.1, SQL Server 2005, Oracle 10g, Red Hat LINUX, TOAD 9.5.0, SQL Developer, ERwin.

Confidential, Wilmington, DE

ETL DataStage Developer/Analyst, Card Data Warehouse

Responsibilities:

  • Coordinated requirement gathering sessions with business analysts, end users and people from the involved departments.
  • Converted Functional Requirements into Technical Specifications, developed project management methodology, estimated storage requirements and identified information delivery strategy.
  • Designed and Developed ETL process to populate data mart using PL/SQL and Datastage.
  • Designed and developed Stored Procedures, Functions, Triggers and Sequence for business logic as required.
  • Convert server jobs into parallel jobs to increase the performance of server jobs when the data load increases.
  • Extensively worked on Parallel Extender PX using lookup, merge, join and change capture stages.
  • Created a job to fix historical bad data.
  • Used Control-M to schedule the jobs, Win CVS for version controlling and Microsoft Visio for creating technical drawings.
  • Worked with Business Analysts to prepare ETL Mapping Documents and design documents.
  • Extensively used Stage variables, Shared containers and Hash files.
  • Coordinated Post Implementation Analysis meetings for the manager to analyze what were the positive points learnt from the project, which can be used in the project management methodologies for future. And also to analyze what the reasons were causing delays in development and implementation phases.

Environment: IBM Datastage 7.5.2, Parallel Extender, Control-M, CVS, Erwin4.x, Oracle10g, Oracle 9i, KSH Scripts, pl/sql, SQL Plus, Toad, UNIX, SQL Navigator and Sun Solaris.

We'd love your feedback!