We provide IT Staff Augmentation Services!

Sr. Datastage Consultant Resume

4.00/5 (Submit Your Rating)

Summary:

  • Over 8 years of experience in IT as an application developer with experience in the total life cycle of Software Development Applications involving Requirements, Design, Analysis, Development and Testing.
  • I currently possess Work Authorization (EAD), and do not require sponsorship, and could work indefinitely.
  • Over 5 years of in-depth experience in Extraction Transformation and Loading (ETL) processes using Ascential DataStage 8.1.1/7.5/7.1/7.0/6.0XE/5.2/EE (Parallel Extender).
  • Worked on DataStage client tools DataStage Designer, DataStage Director, DataStage Manager and DataStage Administrator.
  • Experience in Designing, Compiling, Testing, Scheduling, and Running DataStage jobs.
  • Developed Server jobs for extracting, transforming, integrating and loading data to targets.
  • Excellent experience in using Stages like Complex Flat File, Dataset, Copy, Fileset, Oracle Enterprise, Join, Sequencer, Aggregator, Merge, Filter, Transformer, Lookup, Funnel, Compress etc.,
  • Good Understanding in design and implementation of Star schema, Snowflake schema and multi dimensional model.
  • Worked with various databases Oracle 9i/8i/8.0/7.x, DB2, MS Access, SQL Server and Sybase.
  • Extensive Experience working with Database tool TOAD, SQL Loader etc
  • Expertise in data warehousing techniques like data cleansing, Slowly Changing Dimension phenomenon and Change Data Capture.
  • Experience working with Parallel Extender for Parallel processing to improve job performance while working with bulk data sources. Worked with most of the parallel stages applying differentpartitioning techniques.
  • Strong working knowledge with Oracle database Design and SQL Scripting, DB2, PL/SQL and TOAD
  • Experience in debugging, troubleshooting and performance tuning.
  • Successfully interacted with end-users, developers and top management.
  • Excellent analytical, problem solving, communication and interpersonal skills, with ability to interact with individuals at all levels.

TECHNICAL SKILLS:

  • ETL Tools:DataStage8.1.1/7.5.x/7.x/6.x/5.x/XE/EE (Manager, Designer, Director, and Administrator) with Server and Parallel Extender, and Quality Stage.
  • Reporting Tools:Business Objects XI r2/6.5/6.1.x, Crystal Reports XI/10/8.5
  • Data Modeling:ERWin Data Modeler
  • Languages:Java, C/C++, SQL, PL/SQL, Visual Basic
  • Web Development:VB Script, HTML
  • Database Tools:PL/SQL Developer, SQL Loader, TOAD
  • Databases:Oracle 10g/9i/8i, SQL Server 2005/2000, Teradata v2r6/v2r5, UDB, DB2 7.1/6.1
  • Operating Systems:UNIX Korn Shell, AIX, Windows NT/95/98/2000/XP, MS DOS, Sun Solaris

PROFESSIONAL EXPERIENCE:

Confidential, NJ (Jan 2009 Current)
Sr. DataStage Consultant

  • Involved in designing technical specification documents for different interfaces.
  • Performed ETL process using DataStage 8.1.1 version.
  • Used stage variables for source validations, to capture rejects and used Job Parameters for Automation of jobs.
  • Designed and developed jobs using both Parallel Extender and server jobs.
  • Used DataStage Designer to develop jobs for extracting, cleaning, transforming and loading data into data warehouse.
  • Used DataStage Director for validating, execution and monitoring jobs.
  • Installation and Configuration of Ascential Quality Stage system for evaluation purposes. Designed, Documented and implemented various standards for the quality of data warehouse data
  • Used DataStage Manager for importing metadata into repository, for importing and exporting jobs into different projects.
  • Identified and tracked the slowly changing dimensions, heterogeneous Sources and determined the hierarchies in dimensions.
  • Extensively worked on Error handling, cleansing of data, performing lookups for faster access of data.
  • Used stages like Transformer, sequential, Oracle, Aggregator, Data Set, File Set, CFF, Remove Duplicates, Sort, Join, Merge, Lookup, Funnel, Copy, Modify, Filter, Change Data Capture, Change Apply, Head, Tail, Sample, Surrogate Key, External Source, External Target, Compare.
  • Involved in Performance Tuning of the Parallel Extender jobs to the maximum extent and achieved the best performance by reducing the Loading Time.
  • Used different Parallel Extender partitioning techniques in the stages to facilitate the best parallelism in the Parallel Extender jobs.
  • Created master controlling sequencer jobs using the Data Stage Job Sequencer.
  • Used several stages in Sequencer like Abort Job, Wait for Job, Nested Condition and Mail Notification stages to build an overall main Sequencer and to accomplish Re-startability.
  • Supported operations team during production for different interfaces.
  • Used Autosys in UNIX for Job scheduling.
  • Wrote UNIX Korn Shell scripts to kick off the DataStage jobs.
  • Performed debugging, unit testing of jobs and created migration of documents.
  • Environment: IBM Data Stage 8.0.1(Designer Client, Director Client, Multi-Client Manager)/7.5.2 EE (Designer, Director, Manager and Administrator), ORACLE 10g, DB2, SQLSERVER, Telnet.SQL Developer, KSH, and AIX UNIX.

Confidential,MI (Sep 2008 Dec 2008)
Sr. ETL Consultant

  • Project involved extracting data from GM ReDS Database into the OnStar ASD Database through 13 tables by generating 14 ASD flat files.
  • Involved in developing Technical Design specification documents for different interfaces.
  • Used DataStage Administrator extensively for setting environment variables.
  • Designed and developed jobs for loading data from ReDS Database to OnStar ASD Database.
  • Used DataStage Designer to develop jobs for extracting, cleaning, transforming and loading data into data warehouse.
  • Used DataStage Manager for importing metadata into repository, for importing and exporting jobs into different projects from one Environment to the other.
  • Used DataStage Director for validating, executing, scheduling and monitoring jobs.
  • Used DataStage Parallel Extender stages like Sequential file, Datasets, Copy, Fileset, Oracle Enterprise, Join, Sequencer, Aggregator, Merge, Filter, Transformer, Lookup,, Funnel, Compress stage.
  • Involved in development of Common Error Management process at Project level.
  • Used several stages in Sequencer like Execute Command, Job Activity, Notification Activity, Routine Activity, Terminator Activity, User Variables Activity and conditions like Abort Job, Wait for Job, Nested Condition and Mail Notification to build an overall main Sequencer and to accomplish Re-startability.
  • Performed testing, debugging of the jobs and migrated different projects from one environment to the other.
  • Environment: IBM DataStage7.5.2 EE, DB2 7.x, Oracle 9i, SQL, PL/SQL, TOAD, Erwin, Unix Korn Shell Scripts, TOAD, AIX

Confidential,MO (May 2008 Aug 2008)
DataStage Developer

  • Spend Analysis Project (vendor expenditure management) - Source Database is SAP/R3 BW and the data to monitor was that of the Account Payee Info, Purchase Order Info and pCard Info. This info has to be output to the Zycus tool which does the UNSPSC classification and then from DataStage sent to the Frictionless database for final monitoring of data
  • Involved in developing Technical Design specification documents for different interfaces.
  • Developed several Server and Parallel jobs to improve performance by reducing runtime using different partitioning techniques.
  • Performed ETL process using IBM WebSphere DataStage 7.5 Version.
  • Used stage variables for source validations, to capture rejects and used Job Parameters for Automation of jobs.
  • Used DataStage Designer to develop jobs for extracting, cleaning, transforming and loading data into data warehouse.
  • Used DataStage Director for validating, execution, monitoring jobs and check the log files for errors.
  • Involved in development of Common Error Management process at Project level.
  • Developed user defined routines for several jobs.
  • Developed the jobs and combined all the jobs into one job to send it to Frictionless database.
  • Created Korn Shell scripts to perform validations and run jobs on different instances (DEV, TEST and PROD).
  • Wrote UNIX Korn shell script to kick off the DataStage jobs.
  • Used ETL Timestamp job to have a single time for all the jobs when the job runs from day 2 to day 11 every month and as and when required.
  • Used CRON in UNIX for Job scheduling.
  • Used Enterprise Architect (EA) for creation of Documentation of the project.
  • Performed unit testing of all monitoring jobs manually and monitored the data to see whether the data is matched, if matched send it to the frictionless database otherwise reject and also created migration of documents.
  • Environment: IBM WebSphere DataStage7.5.2 (Manager, Designer, Director) Parallel Extender, Quality Stage, Profile Stage, Microsoft Access, DB2 6.x, Oracle9i, PL/SQL, TOAD, Unix Korn Shell Scripts, Windows XP.

Confidential,CA (Sep 2007 Apr 2008)

ETL Developer

  • Project involved loading of Capitation data into Financial Data Store (FDS) and General Ledger by tagging appropriate accounting attributes based on business driven configurations, target for this project was Oracle Applications (General Ledger, Accounts Receivables, and Accounts Payable). Sources were provided in different formats database extracts, multi-level files and sequential files. Data was integrated from Claims, Premiums, Capitation, and Billing systems.
  • Involved in developing Technical Design specification documents for different interfaces.
  • Developed several Parallel jobs to improve performance by reducing runtime using different partitioning techniques.
  • Performed ETL process using DataStage Enterprise Edition.
  • Used stage variables for source validations, to capture rejects and used Job Parameters for Automation of jobs.
  • Designed and developed jobs using Parallel Extender.
  • Used DataStage Designer to develop jobs for extracting, cleaning, transforming and loading data into data warehouse.
  • Used DataStage Director for validating, execution and monitoring jobs.
  • Used almost all stages like Sequential file, Dataset, Lookup, Join, Funnel, Filter, Modify, OCI9i and Transformer stage etc
  • Developed user defined routines for several jobs.
  • Used several stages in Sequencer like Abort Job, Wait for Job, Nested Condition and Mail Notification stages to build an overall main Sequencer and to accomplish Re-startability.
  • Supported operations team during production for different interfaces.
  • Used DataStage Manager for importing metadata into repository, for importing and exporting jobs into different projects.
  • Used Autosys in UNIX for Job scheduling.
  • Environment: Ascential DataStage7.5.2/7.1.1 (Manager, Designer, Director, Administrator) Parallel Extender,, Quality Stage, Profile Stage, Business Objects 6.5, Oracle9i, TOAD, PL/SQL, Korn Shell Scripts, AIX, Autosys.

Confidential,PA (Oct 2005 Aug 2006)
DataStage Developer

  • Developed server jobs to extract, load and transform data using DataStage from heterogeneous systems to Oracle.
  • Used Stage variables for Source Validations and to capture the rejects.
  • Improved performance of several jobs using stages like IPC stage, Link Partitioner and Link Collector Stages.
  • Developed wrapper shell scripts to run Sequencer jobs for each interface.
  • Used Job Parameters for Automation of jobs.
  • Used DataStage Designer to develop jobs for extracting, cleaning, transforming and loading data into data warehouse.
  • Used almost all stages like Sequential file, Hash file, OCI9i, ODBC stage etc and also extensively involved in creating custom routines and transforms.
  • Developed Shared Containers for reusability in all jobs for several projects.
  • Developed user defined routines for several jobs.
  • Designed and developed Server jobs. Sometimes used Parallel Extender for splitting bulk Data into subsets and to dynamically distribute to all available Nodes to achieve best job performance.
  • Used DataStage Director for scheduling, validating, running and monitoring jobs.
  • Used DataStage Manager for importing metadata into repository and also used for Importing and exporting jobs into different projects.
  • Supported the customer service 24/7.
  • Performed debugging and unit testing of the jobs.
  • Environment: Ascential DataStage7.5.1(Manager, Designer, Director, Administrator), Parallel Extender, Oracle9i/8i, SQL Sever 2000, SQL, TOAD, Unix Korn Shell Scripts, AIX.

Confidential,AR (May 2004 September 2005)
DataStage Developer

  • Data Warehouse development project which involved consolidating the company’s data from different operational sources and then transformed and loading it into a centralized data warehouse for various strategic business analyses.
  • Worked on programs for scheduling data loading and transformations using DataStage from legacy systems to Data Warehouse.
  • Designed the mappings between sources (external files and databases) to operational staging targets.
  • Used the DataStage Designer to develop processes for extracting, cleansing, transforms, integrating and loading data into data warehouse database.
  • Worked on Parallel Extender to run complete parallel application.
  • Used Parallel Extender environment for Partition Parallelism, the same job would effectively run simultaneously by several processing nodes, each handling separate subset of total data.
  • Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
  • Used the DataStage Director and the runtime engine to schedule running the solution, testing and debugging its components and monitoring the resulting executable versions (on ad hoc or scheduled basis).
  • Wrote UNIX Korn Shell Script to kick off the DataStage jobs.
  • Developed Shell scripts to automate file manipulation and data loading procedures.
  • Environment: DataStage7.0 (Manager, Designer, Director, Administrator), Parallel Extender, DB2, SQL Server, SQL, TOAD, UNIX Korn Shell Script.

Confidential,TX (Dec 2002 Apr 2004)
Programmer/Analyst

  • Simulated the Petroleum Reservoir project and designed a prototype to predict the production of oil using Neural Networks, Fuzzy Logic Expert systems and Genetic algorithms.
  • Designed screens and reports layout.
  • Created screens, workflow and taking care of validations.
  • Online help documents were written using HTML, which are informative to user while using this application.
  • Included features using layers, DHTML, Dynamic data stored in MS Access Database.
  • Was part of a team that developed a complete user interactive web site with administrative options so that the site can be controlled
  • Total business analysis of the application and implement using Oracle database, VB 5.0
  • Developed the ActiveX competent for the complex validation and the database query.
  • Used PL/SQL to write the Stored Procedures /triggers and data validation routines.
  • Environment: Oracle 8i, Crystal Reports 5.0, Visual Basic, VB Script, ActiveX, ASP, HTML, DHTML.

We'd love your feedback!