We provide IT Staff Augmentation Services!

Senior Datastage Developer Resume

5.00/5 (Submit Your Rating)

Oakland, CA

SUMMARY

  • Confidential is an IBM Certified Professional wif 8+ years of IT experience, wif special expertise in Development, Analysis and Design of ETL methodologies in all teh phases of teh Data Warehousing life cycle.
  • Confidential TEMPhas extensive experience IBM Web Sphere 8.5/8.1.0/8.01 (Data stage, Information Server, Quality Stage, Information Analyzer, Metadata Server) and experience in Ascential DataStage 7.5 using components like DataStage Designer, DataStage Manager, DataStage Director, DataStage Administrator and Parallel Extender. Expert in all teh stages of Software Development Life Cycle.Skills Inventory
  • Strong Decision Support Systems experience using Business Intelligence tool Business Objects.
  • Expert in developing DataStage jobs using star schema and snowflake schema modeling and conversant wif Data Warehouse concepts like fact tables and dimension tables.
  • Created and implemented common UNIX shell scripts to FTP teh files from/to different servers, validate, process teh Flat Files for different projects.
  • Strong understanding of teh principals of Data Warehouse using Fact Tables, Dimension Tables, Star Schema modeling and Snowflake Schema modeling.
  • Extensive experience in using highly scalable parallel processing infrastructure using DataStage Enterprise Edition.
  • Expert in writing, testing and implementing triggers, functions and procedures at database level using PL/SQL.
  • Experienced in incorporating various data sources like Oracle, MS SQL Server, DB2, Teradata, XML and flat files into teh staging area.
  • Experienced in troubleshooting of DataStage jobs and addressing production issues like performance tuning and enhancement.
  • Having good experience in teh preparation of JIL scripts to schedule teh jobs through Autosys.
  • Expertise in data migration projects wif (target - source) same database as well as wif heterogeneous databases.
  • Strong analytical, organizational, presentation and problem solving skills.

PROFESSIONAL EXPERIENCE

Senior DataStage Developer

Confidential, Oakland, CA

Responsibilities:

  • Reviewed teh Functional Design Specification (FDS) provided by teh Business Team, Raised concerning issues present in teh FDS by understanding teh functionality illustrated to do teh conversion.
  • Extensively used IBM DataStage Designer to develop processes for extracting, cleansing, transforming, integrating and loading data into Data Marts and Involved in preparing of High Level, Low Level Design Documentation.
  • Developed and loaded data warehouse tables such as dimension, fact and aggregate tables using IBM DataStage.
  • Developed DataStage jobs to implement complex business rules and transformation logic using lookup, join, modify, filter, copy, aggregator, sequence stages like job activity, exception handler, execute command, wait for file activity and Used job sequences to automate teh ETL process.
  • Exclusively used transformer stage to do data validation, cleansing, converting as per business requirements.
  • Implemented SCD's using CDC Stage, surrogate key generator.
  • Created re-usable components using shared containers for local use or shared use.
  • Developed simple UNIX scripts to do file transfers, file archiving and file maintenance and have good work experience wif UNIX commands.
  • Wrote PL/SQL statements and Stored Procedures in Oracle for extracting data as well as for writing data into tables.
  • Performed teh unit testing for various conditions as per data quality and business requirements.
  • Responsible for performance tuning of DataStage code to increase teh performance and throughput.
  • Provided support to teh QA team to run all teh respective objects in DEV, QA and PRD environments during scheduled Cut-over’s at various phases of teh project.
  • Documented all teh implementation process in detail describing teh overall DataStage process and Part of teh Production Support team to monitor and fix any production issues/failures and making sure that teh SLA’s are being met on a timely manner.
  • Created Autosys jils for scheduling and running DataStage jobs.

Environment:IBM WebSphere DataStage 9.1/8.7 (Designer, Director, Administrator, Quality Stage, MetaStage), Oracle 10g, DB2,Toad, DB2 Visualizer, SQL Developer, Autosys, AIX UNIX,K-Shell scripts, MS Visio.

Senior DataStage Developer

Confidential, Concord, CA

Responsibilities:

  • Communicated wif business users and management to get business requirements and translate to ETL specifications.
  • Developed Full Software Development Life Cycle (SDLC) including requirement analysis, design, development, testing, implementation and Project documentation.
  • Designed Mappings between sources to operational staging targets, using Star Schema, Implemented logic for Slowly Changing Dimensions (SCD).
  • Developed jobs for handling different data transformations as per specified requirements using stages like Join, Merge, Lookup, Transformer and Aggregator etc.
  • Extensively used SCD, Sort, Merge, Aggregator, Peek, Dataset, Funnel and Remove Duplicates stages.
  • Designed teh Unit testing and integrated testing process and necessary documentation.
  • Used DataStage Manager for importing and exporting jobs into different environments and projects.
  • Used UNIX scripts to execute jobs and also used teh DataStage Director for scheduling, executing and monitoring jobs.
  • Used shared containers to reuse teh specific business logic in various jobs to eliminate redevelopment.
  • Extensively worked on DataStage Job Sequencer to Schedule Jobs to run jobs in Sequence.
  • Experienced in troubleshooting of DataStage jobs and addressing production issues like performance tuning and enhancement.
  • Experience wif Scheduling tool Autosys for automating teh ETL process.

Environment: IBM Information Server 8.7 (Designer, Director, Manager and Administrator), QualityStage, Autosys, K-Shell Scripts, Win SCP, Oracle 10g, PL/SQL, Toad 7, SQL Developer.

Senior DataStage Developer

Confidential -NC

Responsibilities:

  • Involved in understanding business processes and coordinated wif business analysts to get specific user requirements to build Data Marts.
  • Data Profiling, Designed and developed teh DataStage server as well as parallel jobs for extracting, cleansing, transforming, integrating and loading data using DataStage designer.
  • Developed DataStage jobs to load teh data into tables using fast load utility.
  • Worked wif DataStage director to schedule, monitor and analyze performance of individual stages and run DataStage jobs.
  • Imported and exported repositories across project using DataStage manager.
  • Set various environment variables and parameters in DataStage administrator and also used them in managing teh projects.
  • Used several stages like sequential file, hash file, aggregator, funnel, change capture, change apply, transformer, merge, join and lookup during teh development process of teh DataStage jobs.
  • Involved in teh preparation of ETL documentation by following teh business rule, procedures and naming conventions.
  • Used shard containers for reusability and reducing job complexity.
  • Responsible for unit, system and integration testing. Development test scripts, test plan and test data. Participated in UAT (User Acceptance Testing).
  • Analyzed data wif discrepancies through error files and log files for further data processing and cleansing.
  • Responded to user request on queries on teh enterprise data warehouse and creation of reports using cognos 8.
  • Created Autosys jils for scheduling and running DataStage jobs.
  • Used UNIX commands like awk, sed, and cat.

Environment: Data Stage 8.5 (Designer, Director and Administrator), Oracle 8i/10g, IBM AIX, MS SQL Server, Flat files, Oracle 10g, TOAD,Windows XP, MS Word, Excel, Autosys.

Senior DataStage Developer

Confidential, SFO, CA

Responsibilities:

  • Involved in understanding Business Process, Data Profiling and coordinated wif Business Analysts to get specific user requirements to build teh Data Marts.
  • Involved in preparing teh source to target data mapping for ETL design and development.
  • Developed DataStage ETL jobs and Data Loader definitions in teh Enterprise Warehouse based on teh client’s requirements.
  • Used Oracle PL/SQL for writing stored procedures, packages for extracting teh data.
  • Developed DataStage jobs using star schema and snowflake schema modeling and conversant wif Data Warehouse concepts like fact tables and dimension tables.
  • Created Shared Containers to increase Object Code Reusability and to increase throughput of teh system.
  • Developed jobs in Parallel Extender PX using different stages like Transformer, Aggregator, Lookup, Join, Merge, Modify, Remove Duplicate, Oracle Stage, Sort, Peek, Row Generator, Column Generator, Sequential File, and Data Set.
  • Performed teh Unit testing for jobs, sequencers and services, developed to ensure that it meets teh requirements.
  • Highly involved in Performance enhancement of teh process as teh batch window to load teh data was very small. Using various performance improvement techniques to achieve teh target.
  • Extensively worked wif Job sequences using Job Activity, Email Notification, Wait for File activities to control and execute teh DataStage Parallel jobs.
  • Created Autosys jils for scheduling and running DataStage jobs.

Environment: IBM WebSphere Information Server 8.1/7.5.2(Designer, Quality Stage, Director, Administrator) Teradata, Oracle 9i/10g, TOAD 9.5, Win SCP, Windows XP,UNIX- AIX, XML, MS Word, MS VISIO, Excel, Autosys.

DataStage Developer

Confidential, Sunnyvale, CA

Responsibilities:

  • Involved in Data Profiling, Analysis, Requirements gathering, function/technical specification, development and testing.
  • Involved in Design and Data Modeling using Star schema.
  • Created snapshot for teh transactional tables in distributed databases.
  • Utilized Data stage Parallel Extender PX, to optimize performance in dis very large database environment.
  • Involved in critical multiple instance DataStage jobs which will send teh outbound files for different Lobs (line of business) at teh same time and monitored teh jobs accordingly.
  • Scheduled teh parallel jobs using DataStage Director, which is controlled by DataStage engine and also for monitoring and performance statistics of each stage.
  • Created Error Tables containing data wif discrepancies to analyze, re-process teh data.
  • Extensively used Parallel Stages like Join, Transformer, Merge, Lookup, Filter, Aggregator, Modify, Copy, Sort, Funnel, Remove Duplicates, Surrogate key Generator, Row Generator, Column Generator, and Peek for development and de-bugging purposes
  • Used DataStage Manager to Import and Export DataStage components and Import table definitions from source databases.
  • Developed Fact Tables, Dimension Tables, Star Schema modeling and Snowflake Schema modeling.
  • Used Teradata Bulk Load stages to Load teh data into Teradata Database.
  • Involved in teh design, development and testing of teh PL/SQL stored procedures, packages and triggers for teh ETL processes.
  • Written SQL scripts to create and drop teh indexes those are passes as parameters in teh pre & post sessions.
  • Developed shell scripts for job scheduling and logging.
  • Involved in performance tuning of SQL queries by providing hints, obtaining Explain Plan, Analyzing tables and adding indexes.
  • Involved in full integration test and code reviews of all jobs wifin each sequence before migrating teh jobs and sequencers from teh Development environment (Dev) to teh QA environment, and from teh QA environment to teh Production environment.

Software Environment: IBM Information Server 8.1/8.0.1, Ascential DataStage 7.5, Oracle 10g/11g, SQL, PL/SQL, SQL Loader, Teradata, UNIX Shell Script, TOAD, ERWIN 4.2, Win XP and AIX UNIX, Autosys.

DataStage Developer

Confidential, Plano, TX

Responsibilities:

  • Developed DataStage Parallel & Server jobs for extraction transformation and loading of teh data from source systems.
  • Used Environment Variables, Stage Variables and Routines for developing Parameter Driven Jobs.
  • Extensively used all activities like Routine Activity, Wait for File Activity, Exception Handler and Notification Activity.
  • Worked extensively on different types of stages like Sequential file, Lookup File set, ODBC Stage, Aggregator, Transformer, Copy, Merge, Join, Filter, Column Generator, Funnel, Peek, Change Capture, Change Apply Stage, and several other stages for developing Parallel Jobs.
  • Implemented teh Slowly Changing Dimension, SCD Type-II strategy in DataStage, for teh OLAP Dimension tables storing history data.
  • Used DataStage Director to Run and Monitor teh Jobs performed, automation of Job Control using Batch logic to execute and schedule various DataStage jobs.
  • Created job sequencers using DS parameters.
  • Coding Data Correction Utilities on teh Corporate Data Warehouse (CDW)
  • Created batch files to archives teh production files and cleans from production once it’s archived.
  • Created Test Plans and Test Scripts for Unit and Integration Testing for designed jobs.
  • Loading data into warehouse environment, monitoring certain automatic loads, correction reloads, all in support of an existing environment.
  • Worked wif others- onsite team and offshore team, in a supporting role, to ensure ongoing quality of and availability of data warehouse environment.

Environment: Ascential DataStage 7.5 Parallel Extender (Designer, Manager, Director, Administrator), DataStage BASIC language Expressions, Windows NT 4.0, PL/SQL, Oracle 9i, MS SQL Server, UNIX, Sequential files, MS Access.

Hermes Technologies

Confidential

Responsibilities:

  • Managed teh Datastage repository using Datastage Manager.
  • Suggested various changes in teh physical model to support teh business requirements.
  • Developed server jobs to load teh data from flat files, text files and MS SQL.
  • Set various parameters in Datastage Administrator for performance tuning.
  • Used Datastage Designer to develop various jobs.
  • Utilized shared containers for code reusability and for implementing teh predefined business logic.
  • Created and scheduled teh job sequences by checking job dependencies.
  • Wrote complex SQL queries using joins, sub queries and correlated sub queries.
  • Wrote PL/SQL stored procedures, functions and packages and triggers to implement business rules into teh application.
  • Developed shell scripts to invoke back end SQL and PL/SQL programs
  • Performed Unit Testing to check teh validity of teh data at each stage.
  • Used Datastage Director to debug teh jobs, to view teh error log to check for errors.
  • Implemented best practices in teh development environment (code standards, code migration).

Software Environment: Ascential DataStage 7.5, Windows NT 4.0, Oracle 8i, UNIX, Sequential files, MS Access 2000.

We'd love your feedback!