We provide IT Staff Augmentation Services!

Sr. Datastage Developer Resume

5.00/5 (Submit Your Rating)

Elmhurst, IL

PROFESSIONAL SUMMARY:

  • Over 9 years of experience in System Analysis, Design, Development, Implementation and testing of Databases, Data Warehouse Applications on Client server technologies.
  • Extensive experience on Analysis, Design, Development, Testing, Implementation and Support life cycle for Data Warehouse and Data Integration projects using Extraction Transformation and Load (ETL) methodologies using IBM InfoSphere Information Server 9.1/8.7/ 8.5, IBM Info Sphere DataStage 8.1.0.
  • Extensive experience in Ascetical DataStage 7.5/6.0XE/5.0 using components like DataStage Designer, DataStage Manager, DataStage Director, DataStage Administrator and Parallel Extender and IBM WebSphere 8.0 (DataStage, Information Server, Quality Stage, Information Analyzer, Metadata Server).
  • Experience as a Senior ETL engineer leading team of Developers, Authoring technical specifications and diagrams, updating and discussing the status of the project with managers.
  • Experienced with relational and dimensional data modeling, star schema, and snowflake schema and fact constellations. Designing logical and physical databases using Erwin.
  • Used Data Stage Administrator to control purging of Repository and Data Stage client applications for jobs they run and reset.
  • Used the Ascential Data Stage Director to schedule jobs at pre - defined time as well as on ad hoc basis, validate the jobs and monitor the job logs.
  • Experience with Parallel Extender for Parallel Processing to improve job performance while working with bulk data sources, creating Aggregate Tables within Data Marts for performance improvement.
  • Efficient in incorporation of various data sources such as Oracle, MS SQL Server, DB2, Teradata
  • Experience in writing UNIX shell scripting.
  • Experienced in writing, testing and implementation of the triggers, stored procedures, functions, packages using PL/SQL.
  • Experience in writing complex SQL queries, writing hints.
  • Extensive Experience with Quality Stage for investigating, Standardization.
  • Designed and Developed Extract, Transform and Load (ETL) functions from a variety of operational systems including legacy systems utilizing SQL, DataStage (ETL tool), Unix shell Scripts, bulk loads (Oracle SQL Loader), etc.
  • Excellent team player with good organizational, communicational, interpersonal, analytical and logical skills. Possess strong ability to quickly adapt to new applications, platforms and languages.

TECHNICAL SKILLS:

ETL Tools: IBM - Information server DataStage (9.1/8.7/8.5/8.1/8.0/7.5 x2) Enterprise Edition, Data Stage Administrator, Data Stage Designer, Data Stage Director, Quality Stage, Information Analyzer SQL*Loader.

Modeling: Erwin 4.0/3.5.

Database: Oracle 9i /10g, SQL Server 2000/2005, UDB/DB2 V 7.x/8.x, Teradata.

OS: Windows XP/2003/2000/NT 4.0 Server, UNIX, HP-UX, AIX6.0.

Tools: TOAD, SQL Navigator, SQL*Loader, Test Director, Quality Center.

Scheduling: Autosys, Control-M.

Protocols: TCP/IP, SMTP, POP, FTP and HTTP.\

Languages: SQL, SQL PLUS, PL/SQL, XML, Shell Scripting, C/C++

PROFESSIONAL EXPERIENCE:

Confidential, Elmhurst, IL

Sr. DataStage Developer

Responsibilities

  • Participating as a Senior Developer on technical project involving the use of DataStage for development of ETL processes.
  • Develop written Technical Specifications describing details necessary to build ETL jobs based on logical and physical data models and business functional objectives.
  • Develop and unit test ETL jobs according to requirements in the Technical Specifications.
  • Extensively used Teradata Connecter / Enterprise stages to Extract / Load data from Teradata Tables.
  • Written many bteq, tpt, mload, fast load and fast export scripts to load and export data from Teradata
  • Used Control-M as a scheduling tool to handle event based scheduling and time based scheduling.
  • Responsible for Performance tuning of DataStage jobs with proper DataStage partitioning techniques and Node configuration and also Teradata Scripts
  • Performs performance tuning and capacity planning activities relevant to DataStage ETL processes.
  • Facilitates root cause analysis on DataStage ETL issues, and communicate issues and resolutions effectively.
  • Applies policies, procedures and standards relating to BI ETL process development, in conjunction with Data Warehouse best practices.
  • Working closely with other associates working on the same project.
  • Required to work on moderately to very complex tasks.
  • Follow SDLC processes and master the rules governing the project.
  • Used Quality Centre to track defects and updated the status as and when the changes are done
  • Wrote complex Shell Scripts to handle pre and post job runs
  • Demonstrates a commitment to core values of safety, integrity, process improvement, and customer satisfaction.

Environment: IBM Information Server 9.1/8.7, Db2, Teradata V14, Teradata SQL Assistance 14, Shell Script, SQL, UNIX, Control-M scheduling.

Confidential, Des Moines, IA

DataStage Consultant

Responsibilities:

  • Extensively used most of the transforms of DataStage for various types of transformations.
  • Validated and successfully executed jobs using DataStage Director.
  • Used Quality Stage standardizes stage to reformat data from multiple systems for effective matching and output formatting.
  • Worked closely with business users to address their concerns with poorly performing reports. Involved extracting the SQL queries and analyzing their Oracle execution plans and generating Oracle trace files to debug. Develop several Oracle Hint objects to influence queries and alternate methods for report development.
  • Set up benchmark reports to understand their pre and post upgrade performance.
  • Involved in tuning DataStage repository and jobs for better performance.
  • Designed the mappings between sources (external files and databases) to staging targets.
  • Used almost all stages like Sequential file, Hash file, OCI9i, ODBC stage etc and also extensively involved in creating custom routines and transforms.
  • Constructed SQL Scripts to validate the data after loading process.
  • Troubleshooting and support during operational cycle.
  • Attended defect logged by the TSG Groups and UAT Users.
  • Involved in product support on a rotational basis.

Environment: DataStage EE 7.5.3/8.0 (Manager, Designer, Director, Administrator), Quality Stage, Information Analyzer, Business Objects XI, PL/SQL, SQL Server, Oracle10G, Erwin, UNIX shell script, PERL, UNIX, IBM-AIX6.0 O/S, DB2, Test Director.

Confidential, Berkeley Heights, NJ

DataStage Consultant

Responsibilities:

  • Extracted the data from different tables related to customer, account, policies, claims from EPCG1 which is Oracle database using OCI stage.
  • Worked extensively on different types of stages like Oracle Connector, Transformer, Filter Aggregator, Lookup, Join, XML stage, DCR connector stage, OCI, Flat file and ODBC.
  • Generated the ID for tables in EPCG2 and inserted them at the time of loading by creating sequence in Oracle to make it unique to Entire DB instead of unique to the table.
  • Generated the random string in the database and inserted them at the time of loading the columns as per specifications.
  • Make the tables related to each other to access the data by performing look up on corresponding columns and thereby accessing the records by entering any of the related info i.e.; account number or customer number or policy number or claim number and so on.
  • Applied the required ETL logic to meet the mapping requirements which will make the user interface to access the information either by entering account, customer, policy and claims.
  • Applied logic to synchronize the quotes in EPCG1 to EPCG2 dynamically, to make the information available in EPCG2.
  • Applied logic to get only final transactions of polices to move to EPCG2.
  • Kept the records in EPCG1 until the policy got renewed by applying filter criteria on pending endorsement number column.
  • Created intermediate tables to pass the ID generated for tables to other tables to link them up and at the same time to make the generated ID unique for Database,
  • Load the data in the sequence as per specifications into EPCG2 which is Oracle Database.
  • Load the tables with different Batch ID to keep track of data loaded at different time.

Environment: DataStage EE 8.7/8.5/8.1 (Designer, Director, Administrator), Quality Stage, Information Analyzer, PL/SQL, SQL Server, Microstrategy9, Oracle 11g, Red Hat Linux 5, AIX 6.1, UNIX shell script, PERL,ERwin4.0, Windows XP.

Confidential, New York, NY

DataStage Consultant

Responsibilities:

  • Involved in the design of an efficient, reliable ETL mechanism for updating the Data Warehouse, Data Marts and downstream systems.
  • Processed Cleansing, Purging and Optimizing the data in warehouse. Developed and implemented all ETL (Extract, Transform and Loading) Components based on the filter rules to obtain needed data from different source systems for calculating required metrics using PL/SQL.
  • Used ROLAP to work with relation database.
  • Used Parallel Extender for splitting the data into subsets and flowing of data concurrently across all available processors to achieve job performance.
  • Worked extensively on different types of stages like Transformer, Sorter, Aggregator, Lookup, OCI, Flat file and ODBC.
  • Created/Modified Universes by Adding objects, Tables/Derived tables with Oracle and as Backend Databases.
  • Involved in performance tuning. Using hints/index and other optimizing techniques to improve performance.

Environment: DataStage EE 8.1 (Designer, Director, Administrator), Quality Stage, Information Analyzer, PL/SQL, SQL Server, Oracle 11g, UNIX shell script, PERL, ERwin4.0, Windows 2003 Server.

Confidential, Iselin, NJ

DataStage and Data Profiling Consultant

Responsibilities:

  • Used Information Analyzer to develop rules and profile the data to provide complete analysis of source systems and target systems, and assesses the structure, content, and quality of data.
  • To implement the rules used Information Analyzer and SQL Server which are provided by the Business User.
  • Used Nightly process to generate file on CAMRA server.
  • Autosys File watcher will wait for Camra Company file and upon Success of Filewatcher the files will move from Camra server to Datastage server.
  • Load the extracted files into Staging Tables in FIF INVACC STG schema in staging area in UU685 server in Oracle.
  • Once Tables are loaded in to staging area then Reference Jobs are loaded and Reference Tables are loaded.
  • Worked extensively on different types of stages like Oracle Connector, Transformer, Filter Aggregator, Lookup, Joiner, OCI, Flat file and ODBC.
  • Created/Modified Universes by Adding objects, Tables/Derived tables with Oracle and as Backend Databases.
  • Upon success of Reference Tables loaded from staging tables the ODS Tables are loaded.
  • Extract data From PeopleSoft source Tables.
  • Recon Mapping Table is loaded from the Recon mapping spreadsheet which has columns from both Source and Target.
  • Recon Results Table is loaded with rules developed by the business user which reconciles Recon amount and People soft source amount.
  • With the data model mapping and rules giving by the business users, Once the data is loaded in ODS Tables, Data quality profiling was done on ODS tables and specified columns which needs to meet the business requirements.

Environment:

DataStage EE 8.1 (Designer, Director, Administrator), Quality Stage, Information Analyzer, PL/SQL, SQL Server, Oracle 11g, Red Hat Linux 5, AIX 6.1, UNIX shell script, PERL,ERwin4.0, Windows XP.

Confidential, Oldsmar, FL

Datastage Consultant

Responsibilities:

  • Worked in collaboration with Data Warehouse architects to design and develop Data Warehouse solutions. Work with Business Analysts and Functional Team members to translate Business requirements into technical specifications.
  • Extensively used ETL to load data from XML Files, SQL Server to ORACLE Data Warehouse.
  • Developed mappings with performance, accuracy and efficiency in mind.
  • Used Information Analyzer to provide complete analysis of source systems and target systems, and assesses the structure, content, and quality of data, whether at the column level, the cross-column level, the table or file level, the cross-table level, or the cross-source level.
  • Developed data Mappings between source systems and target components using Mapping Design Document.
  • Developed robust mappings with built in reconciliation and error handling.
  • Worked extensively on different types of transformations Change capture, Modify, Stored procedure, Peek, Tail, Head, Sequence generator, Aggregator, Column Import, Column Export, Inter Processer, Quality Stage, and FTP Stage.
  • Involved in writing transforms and routines.
  • Used various stages of Quality Stage for best-of-breed representation of the matched data.
  • Setup folders, groups, users, permissions and performed Repository Administration using Repository Manager.
  • Developed several Parallel jobs to improve performance by reducing the runtime for several jobs.
  • Designed and Developed jobs using Server jobs. Implemented Link Portioned & Link Collector Data into subsets and to dynamically distribute to all available Nodes to achieve best job performance.
  • Wrote PL/SQL Packages, Stored procedures to implement business rules and Validations.
  • Extensively worked with DS Administrator, DS Manager, DS Director and DS Designer
  • Documented the development of programs, Logic, Coding, and Testing.
  • Interacted with off shore development team.
  • Involved in code walk through with the fellow developer to follow the guidelines for best practices.

Environment: DataStage EE 7.5 (Manager, Designer, Director, Administrator), Quality Stage, Information Analyzer, PL/SQL, SQL Server, Oracle 10g, UNIX shell Script, AIX6.0, PERL, ERwin4.0, Windows 2003 Server.

Confidential, NY

DataStage Consultant

Responsibilities:

  • Designed and developed validation processes for Data Warehouse using DataStage.
  • Used DataStage Manager for importing metadata from repository, new job and creating new data elements.
  • Used DataStage Director Schedule running the server jobs, events and to resolve error conditions.
  • Extensively Worked with External Loader (Fast Load) connections through workflow manager to load the Target tables.
  • Used DataStage Administrator to control purging of Repository and Data Stage client applications or jobs they run and reset.
  • Developed SQL Scripts to validate the data after loading process.
  • Used Parallel Extender for splitting the data into subsets and flowing of data concurrently across all available processors to achieve job performance.

Environment: DataStage 7.5.3, Windows 2000 O/S, Teradata, DB2, Oracle 9i, PL/SQL, Windows NT.

We'd love your feedback!