We provide IT Staff Augmentation Services!

Etl Datastage Consultant Resume

5.00/5 (Submit Your Rating)

St Louis, MO

SUMMARY

  • 7+ years of total IT experience in the Analysis, Development and Implementation of Data Warehousing Systems (OLAP) using Datastage.
  • Extensive experience in Ascential Datastage 8.5/8.0.1/7.5/7.1 using Components like Datastage Designer, Datastage Director, Datastage Administrator, Quality stage, Information server and Parallel Extender.
  • Extensively worked on identifying dependencies and creating sequencer jobs to schedule server and parallel jobs.
  • Migrated jobs from development to QA and to Production environments.
  • Used the Data stage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
  • Experienced in writing system specifications, translating user requirements to technical specifications, ETLSource - Target mapping document and testing documents.
  • Designed Mapping documents ETL architecture documents and specifications.
  • Development of detailed specifications for data management scripts.
  • Developed UNIXKornshellscripts to automate existing processes and to update the Security Modules.
  • RDBMS experience with Oracle 11g/10g/9i/SQL Server, Sybase, DB2 including database development, PL/SQL programming.
  • Experience in Dimensional modeling Methodologies such as Star Schema, Snowflake Schema, Fact and Dimension Tables.
  • Extensive knowledge in SQL & PL/SQL and expertise in writing Stored Procedures, functions and Packages.
  • Expertise with handling data from different systems such as Oracle, SQL Server, DB2, Teradata, XML Files, Flat Files, etc.
  • Involved in theTeradataset up testing that included testingTeradataTools & Utilities.
  • Experience in basic DataStage Administration.
  • Ability to quickly grasp new concepts, both technical and business related and utilize as needed.
  • Excellent leadership, analytical, technical, and communication skills.

TECHNICAL SKILLS

ETL Tools: Datastage 8.5/8.0.1/7.5.2/7.1 (Administrator, Manager, Designer, Director, Parallel Extender/Orchestrate, Information Server)

Languages: PL/SQL, C/C++, UNIX/AIX Shell scripting.

Database: Oracle 11g/10g/9i/8i, SQL Server 2008/2005, DB2, Editors (SQL Navigator, Toad), Sybase, Teradata-12.1.

Operating System: Windows XP/2003/98,Win NT, UNIX, Linux, AIX

PROFESSIONAL EXPERIENCE

Confidential, St.Louis MO

ETL Datastage Consultant

Responsibilities:

  • Designed DataStage parallel jobs using designer to extract data from various source systems, Transformation and conversion of data, Load data to data ware house and Send data from warehouse to third party systems like Mainframe.
  • Involving with business users for identifying, prioritizing & resolving numerous data issues, create ETL Project Plans, design and develop
  • Extensively involved with business team for analyzing the source systems data and building the design documents.
  • Designed jobs using complex stages like Transformer, Change Capture, Change Apply, Remove Duplicates, Join, Lookup, Merge, Funnel, Aggregator, Oracle Enterprise, Teradata Connector and DB2 connector.
  • Analyzed the new requirements and existing environment to gather required information to migrate the database from Teradata to Oracle.
  • Used several data stage Sequence stages like Job Activity, Execute command, Sequencer, Exception Handler, Wait for a file activity, Terminator activity, Notification activity.
  • Extensively usedUNIXShell Scripts to trigger the DS jobs through a Master Sequencer.
  • DevelopedUNIXshell scripts to automate data loading in batch mode.
  • Written Shell Scripts which are used as the Pre and Post jobs command in DataStage jobs. Created shell scripts that will invoke the Data Stage jobs passing all variables for job to execute with parameterized databases connection information.
  • Experience developing complex transformations, surrogate keys, routines, dimension tables and fact tables.
  • Designing archive and purge jobs and participated in perm space saving activities using Teradata Multi valued compression techniques.
  • Loading of Teradata Tables through batch jobs.
  • Used Environment Variables, Stage Variables and Routines for developing Parameter Driven Jobs and debugging them.
  • Did the detailed profiling of operational data to get better understanding of the data that can be of analytical purpose for business objects.
  • Have addressed production, UAT issues, proper action was taken accordingly based on priority and requirement.
  • Actively worked during nights and weekends during go-live and post production

Environment: Data stage 8.5, Teradata 12.1, oracle 11g, Toad for Oracle, AIX, and Unix shell scripting.

Confidential, Columbus, Ohio

Datastage Developer

Responsibilities:

  • Worked with business analyst to identify, develop business requirements, transform it into technical requirements and responsible for deliverables.
  • Performed data conversion from Mainframe files, DB2, Oracle and Flat Files.
  • Provide the staging solutions for Data Validation and Cleansing with Datastage ETL jobs.
  • Planning for project execution.
  • Used Parallelism concepts for distributing load among different processors by implementing Pipeline and partitioning of data.
  • Used the Datastage Designer to develop processes for extracting, transforming, integrating, and loading data into Enterprise Data Warehouse.
  • Developed variousUNIXshell scripts to meet all the project requirements.
  • Used Parallel Extender for Parallel Processing for improving performance when extracting the data from the sources.
  • Used various Parallel Extender partitioning and collecting methods.
  • Extensively worked with Job sequences using Job Activity, Email Notification, Sequencer, Wait for File activities to control and execute the Datastage Parallel jobs.
  • Defined Stage variables for data validations and data filtering process.
  • Review and updates to the ETL High Level Design.
  • Extensively written shell scripts in different scenarios.
  • Implemented Debugging Methodologies with Break Point Options.
  • Designed and implemented slowly changing dimensions methodologies.
  • Transfer data from various systems through FTP Protocols.
  • Written batch Job Controls for automation of Execution of data Stage Jobs.
  • Extensively worked with DataStage Job Sequences to Control and Execute Data Stage Jobs and Job Sequences using various Activities and Trigger.

Environment: DataStage 8.1, Oracle 10g, AIX 5.1, Unix shell scripting, Mainframe system.

Confidential, Wilmington, DE

ETL Data Stage Developer

Responsibilities:

  • Developed the data models based on Kimball’s Warehousing Methodology.
  • Developed star schema data model using suitable dimensions and facts.
  • Analyzed scope of application, identifying the relationship within and between the groups of data.
  • Used Parallel Extender to enhance the job performance by implementing Pipeline Parallelism and Partition Parallelism.
  • Developed various DataStage jobs using Teradata Enterprise Stage, Teradata Multi Load to build data warehouse system.
  • Used Link Collector, Link Partitioner for performing data collection and data partitioning Operations.
  • Used Basic Routines to pass values from Sequencer to jobs in runtime.
  • Used DataStage Designer in the development process for extracting, cleansing, transforming, integrating, and loading data into target data marts.
  • Generated Surrogate Keys for the Dimensional tables using the DS Functions.
  • Used Hash file stage for faster look-ups of data in server jobs.
  • Used DataStage Director to validate, run, view/print logs, schedule, run, and monitor DataStage jobs.
  • Used the DataStage Administrator to assign, move, rename or delete projects and manage or publish jobs from development to production status.
  • Performed the Unit testing and Integration testing of the jobs to check the compliance of the ETL to the requirements documents.
  • Extensively used Parallel Stages like Join, Merge, Lookup, Filter, Remove Duplicates, Funnel, Row Generator, Modify, Peek etc. for development and de-bugging purposes.
  • Implementing performance-tuning techniques along various stages of the ETL process.

Environment: Ascential Data stage 8.0.1 (Parallel), Oracle 10g, DB2, SQL Plus, Unix, Windows 2003.

Confidential, Chicago

Data Stage Developer

Responsibilities:

  • Used Parallel Extender for distributing load among different processors by implementing pipeline and partitioning of data in parallel extender.
  • Involved in Designing Parallel Extender Jobs.
  • Created containers to use in multiple jobs.
  • Used debugger to test the data flow and fix jobs.
  • Worked with Business customers to identify the different sources of data in operational systems and developed strategies to build data warehouse.
  • Defined data base triggers & PL/SQL stored procedures for business validations.
  • Extensively wrote Routines and Transforms.
  • Created and Monitored sequences using Data stage sequencer
  • Extensively used Parallel Stages like Join, Merge, Lookup, Filter, Remove Duplicates, Funnel, Row Generator, Modify, Peek etc. for development and de-bugging purposes
  • Extensively worked with Data Stage Job Sequences to Control and Execute Data Stage Jobs and Job Sequences using various Activities and Triggers.
  • Used Data Stage Director and the runtime engine to schedule running the server jobs, monitoring scheduling and validating its components.

Environment: Data Stage 7.5, oracle 10g, windows 7, UNIX/AIX, SQL plus.

Confidential

ETL developer

Responsibilities:

  • Used server jobs to Extraction, Transformation and Load.
  • Used DataStage Designer for developing various jobs to extract, cleansing, transforming, integrating and loading data into Data Warehouse.
  • Developed several transformations in the process of building Data warehouse database.
  • Analyzed and designed source code documentation for investment Data Warehouse
  • Generating of unique keys for composite attributes while loading the data into Data Warehouse.
  • Used COBOL programs to extract data from the mainframes and create a load ready file.
  • Used DataStage Manager for managing DataStage repository (view and edit), define custom routines & transforms, Import and export items between different DataStage systems or exchange metadata with other data warehousing tools.
  • Extensively worked with Data Stage Job Sequences to Control and Execute Data Stage Jobs and Job Sequences using various Activities and Triggers.
  • Used DataStage Director and the runtime engine to schedule running the server jobs, monitoring scheduling and validating its components.
  • Used Hashed file to extract and write data and also to act as intermediate file in a job. Hashed file is also used as reference table based on single key field.

Environment: Datastage 7.1 (Manager, Designer, Director, Administrator) Oracle 9i, UNIX and Windows 2000.

Confidential

Data stage developer

Responsibilities:

  • Understanding the functional requirement specifications and design documents.
  • Analyzing the source and target flat forms.
  • Identify source systems, their connectivity, related tables and fields and ensure data suitably for jobs.
  • Developed jobs according to ETL Specification to load test data.
  • Used most of the transformations such as the Transformer, Sequential File, Joiner, Lookup and Aggregator etc.
  • Created unit test cases for jobs.
  • Involved in support activities after the implementation.

Environment: Datastage 7.5, Oracle 8i, UNIX, SQL Loader, AutoSys.

We'd love your feedback!