We provide IT Staff Augmentation Services!

Datastage Developer Resume

2.00/5 (Submit Your Rating)

Bloomington, IL

SUMMARY:

  • Over 5 years of experience in System Analysis, Design, Development and implementation of Relational Database and Data Warehousing systems using IBM DataStage 8.5,8.1,8.01,7.5 (Information Server, WebSphere, Ascential DataStage).
  • Experienced in designing, developing, documenting, and testing of ETL jobs and mappings in Server and Parallel jobs using DataStage to populate tables in Data Warehouse and Data marts.
  • Proficient in developing strategies for Extraction, Transformation and Loading (ETL) mechanism.
  • Expert in designing parallel jobs using various stages like Join, Merge, Lookup, Remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML.
  • Used Data Stage Manager for importing Metadata from repository and for creating new job categories and data elements.
  • Experienced with Microsoft DTS packages, TOAD and experienced in UNIX environment, shell scripting and expert in working with DataStage Manager, Designer, Administrator, and Director.
  • Expert in designing Server jobs using various types of stages like Sequential file, ODBC, Hashed file, Aggregator, Transformer, Sort, Link Partitioner and Link Collector.
  • Excellent knowledge of studying the data dependencies using metadata stored in the repository and prepared batches for the existing sessions to facilitate scheduling of multiple sessions.
  • Efficient in in corporation of various data sources such as Oracle, MS SQL Server, DB2, Teradata, XML and Flat files into the staging area.
  • Expert in unit testing, system integration testing, implementation and maintenance of databases jobs.
  • Proven track record in troubleshooting of DataStage jobs and addressing production issues like performance tuning and enhancement.
  • Expertise in creating reusable components such as Shared containers, Local Containers and in creating custom transformations, functions and routines.
  • Proficient in writing, implementation and testing of triggers, procedures and functions in PL/SQL.
  • Experienced in Database programming for Data Warehouses (Schemas), proficient in dimensional modeling (Star Schema modeling, and Snowflake modeling). Implemented SCD’s (Slowly Changing Dimensions), CDC (Change Data Capture).
  • Expertise in cross - functional and global environments to manage multiple tasks and assignments concurrently with effective communication skills.

TECHNICAL SKILLS:

  • IBM Infosphere DataStage Version 7.5, 8.0, 8.1, 8.5
  • Profile Stage
  • Quality Stage
  • IBM DB2/UDB 7x/8.1/8.2
  • IBM INFORMIX
  • Unix Shell Scripting
  • Oracle 10g/11g
  • Access
  • WEB Services
  • Servlets
  • Microsoft SQL SERVER 2000/2005
  • Autosys
  • Database Application Design
  • MS-DOS
  • VISIO
  • Microsoft Project. Star-Schema Modeling
  • Snowflakes Modeling.

PROFESSIONAL EXPERIENCE:

Confidential, Bloomington, IL

Datastage Developer

Responsibilities:

  • Extensively used Data Stage designer to develop various jobs to extract, cleanse, transform, integrate and load data into target tables using various kinds of built-in stages.
  • Actively participated in the team meetings to gather business requirements and developing the specifications and prepared design and specifications for Data Extraction, Data Transformation, Data Cleansing and Data Loading.
  • Participated in the design, development and implementation of Data Quality rules and Data Profiling, often Information Analyzer etc and extensively used Quality Stage for standardization of data.
  • Extracted data from various sources, performed Data transformations and loaded the transformed data into the target Oracle database.
  • Designed Data Stage Parallel jobs with Change Capture, Change Apply stages also used compare stage and on a large scale and extensively used different file stages like sequential file stage and hash file stage and also lookup file stage.
  • Developed user-defined transforms, Routines, Stage Variables and Stored Procedures and also Wrote UNIX scripts as required for preprocessing steps and to validate input and output data elements, along with data stage routines.
  • Created job schedules to automate the ETL process and enhanced the job properties for performance tuning.
  • Automated and fine-tuned Data Stage jobs and sequences for loading source systems data into Data warehouse and also improved the performance of the existing jobs.
  • Used debug mode in Data stage to test the data flow and fix jobs and implemented logic for Slowly Changing Dimensions (SCD) according to the requirements.
  • Extensively wrote user-defined SQL coding for overriding auto generated SQL query in Data Stage for example using the Where clause at source stage to filter data for increased job performance.
  • Used local and shared containers to increase object code reusability and to increase throughout of the system and what helped the other team members to get the functionality of the job easily.
  • Participated in the review of Technical, Business Transformation Requirements Documentation.

Environment: IBM InfoSphere Information Server 8.5 (Data Stage, Quality Stage, Information Analyzer),Teradata 12.0, DB2 UDB 8.0, Oracle 11i, Oracle BI Publisher, UNIX, SQL, PL/SQL, Toad, SQL*Loader, UNIX Shell Scripting, Autosys, MS Excel, Access.

Confidential, Minneapolis, MN

Data Stage Developer

Responsibilities:

  • Identified source systems, their connectivity, related tables and fields and ensured data suitably for mapping and loaded them into target system succesfully.
  • Created hash tables used for referential integrity while transforming the data representing valid information and also created DataStage jobs to extract data from sequential files, flat files, MS Access and Oracle.
  • Used DataStage Manager for importing Metadata from repository and for creating new job categories and data elements.
  • Used the DataStage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data into different Data Marts.
  • Created re-usable components using local and shared containers for local or shared use and reviewed PL/SQL programs for tuning of performance.
  • Created error files and log tables containing data with discrepancies to analyze and re-process the data and used DataStage debugger to troubleshoot the designed jobs.
  • Extensively used processing stages (Join, Merge, Funnel, Filter, Aggregator, Sort, FTP, and Transformer), file stages (Lookup, File Set, Data Set and Sequential File) and native database stages.
  • Wrote PL/SQL statements and stored procedures in Oracle for extracting as well as writing data and also used features of Exception Handling on a large scale.
  • Used Database triggers for maintaining the history of all the inserts, updates and deletes made on to the database.
  • Used the DataStage run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on an ad-hoc or scheduled basis.
  • Created job schedules to automate the ETL process and enhanced the job properties for performance tuning and documented the purpose of mapping so as to facilitate understanding the process and in corporate the changes when necessary.
  • Designed and developed efficient Error handling methods and implemented throughout the mappings and experienced in preparation of reports, tables and listings.

Environment: Infosphere Data Stage 8.0 (Designer, Director, Manager, Parallel Extender), Windows NT, UNIX, Oracle 10g, Sybase, UNIX Shell Scripting, PL/SQL, MS Access, Autosys.

Confidential, Richmond, VA

Data Stage Developer

Responsibilities:

  • Involved in understanding the scope of application, present schema, data model and defining relationship within and between groups of data.
  • Used Datastage Parallel Extender to load data, utilizing the available processors to achieve job performance, configuration management of system resources in orchestrate environment.
  • Used various stages of Quality stage like standardize stage, survive stage, format convert, transfer and unijoin stages
  • Used DB2 EE stage for doing loads into DB2 UDB Database and to load large volumes of data into Teradata V2R4 using Teradata Fast Export, Multi Load, and T-Pump.
  • Extensively used Lookup, Join, Merge stages for joining various information and Used MQ stage to extract data from the message queue.
  • Written SQL and PL/SQL procedures to facilitate coding and Worked extensively on UNIX.
  • Worked extensively on Ascential Datastage Enterprise Edition 7.5 and Experience in IBM info server and SAP integrations.
  • Involved in loading Deal decisioning and Deal Processing data in Data warehouse. This required various complex data transformations, with the involvement of number of tables.
  • Participated in source to target mapping design document, prepared system requirement documents based on data model and source target mapping documents.
  • Experience working with Connect Direct processes, FTP, SCP scripts for Transferring files between Servers and Legacy systems.
  • Used Data Stage Manager for importing Metadata from repository and for creating new job categories, data elements and Scheduled ETL processes to avoid Conflicts both at Resource utilization level, Database lock issues and to avoid Datastage contention issues and responsible for Planning UAT Testing.

Environment: Ascential DataStage XE/7.5.1 8.1, SQL, PL/SQL,Db2 v9/8.2,Metastage, Quality Stage 7.5, Teradata V2R4, IBM AIX4.3, Erwin 4.1, IBM AIX 4.3, Clear Case, oracle 10g.

Confidential, Princeton, NJ

Data Stage Developer

Responsibilities:

  • Involved in the requirement definition and analysis in support of data warehousing and interpreted logical and physical data models for business users to determine data definitions and establish referential integrity of the system.
  • Developed ETL procedures to ensure conformity, compliance with standards and lack of redundancy, translates business rules and functionality requirements into ETL procedures.
  • Involved in the implementation of this application, which involved the Extraction, Transformation, and Loading of data into an Oracle database.
  • Extensively used DataStage Designer to develop various jobs to extract, cleanse, transform, integrate and load data into DDD Data mart and scheduled the parallel jobs using DataStage Director, which is controlled by DataStage engine and also for monitoring and performance statistics of each stage.
  • Created Error Tables containing data with discrepancies to analyze and re-process the data and also worked with mainframes to extract some of the source files.
  • Extensively used DataStage XE Parallel Extender to perform processing of massive data volumes.
  • Worked with DataStage Manager to import/export metadata from database, jobs and routines between DataStage projects.
  • Used Data Stage Director to schedule, monitor, cleanup resources and run the job with several invocation ids and developed user defined routines and transforms by using DataStage Basic language.
  • Responsible for daily verification that all scripts, downloads, and file copies were executed as planned, troubleshooting any steps that failed, and providing both immediate and long-term problem resolution.
  • Wrote SQL, PL/SQL, queries, stored procedures, triggers for implementing business rules and transformations and also developed UNIX scripts to automate the data load processes to the target Data warehouse.

Environment: Ascential DataStage 7.0, Datastage Basic, Erwin, Oracle 9i, SQL, PL/SQL, Toad, Command Center, Shell Scripts, Solaris and Windows 2000.

Confidential

Software Engineer

Responsibilities:

  • Involved in system analysis, designing data dictionary, development, testing and implementation and created Tables and Stored Procedures using Oracle 7.x.
  • Involved in design, development and Testing phase of the project, acquired data specifications and client requirements.
  • Designed and developed the VB interfaces and Arranged ODBC drivers to connect to the Oracle database.
  • Designed to meet the requirements of computerized stores and studied business process and understood core business issues.
  • Generated invoice reports for customers using Crystal Reports 4.5 and performed unit code and business function testing.

Environment: Oracle 7.x, Visual Basic 6.0, Windows.

We'd love your feedback!