We provide IT Staff Augmentation Services!

Sr. Datastage Developer Resume

0/5 (Submit Your Rating)

New York City, NY

SUMMARY

  • 8+ years of IT experience with special emphasis on Development, Analysis and Design of ETL methodologies in all the phases of the Data warehousing life cycle with knowledge in ETL, DSS and Data warehousing & OLAP technology, and as Data Analyst, Data Modeler and ETL tool expert in Data Warehousing
  • Over 7 years of experience in IBM Information Server DataStage 8.1/7.X/6.X/5.2, using Components like DataStage Designer, DataStage Director, DataStage Administrator and Parallel Extender.
  • Over 3 years of programming experience using Oracle (PL/SQL) Stored Procedures and UNIX.
  • Strong Data Warehousing experience using Business Objects (Designer/ Supervisor, Business Objects, Broadcast Agent and Web Intelligence Expertise in creating / maintaining Universes and Reports using Business Objects 6.0/ 5.x/ 4.x).
  • Expertise in Data Warehousing / ETL programming and fulfillment of data warehouse project tasks such as data extraction, cleansing, transforming and loading.
  • Strong understanding of the principles of DW using Fact Tables, Dimension Tables and Star / Snowflake schema modeling
  • Experience in Universe Design, WebI and InfoView Administration, creating Ad - hoc reports and archiving the reports
  • Efficient in all phases of the development lifecycle, coherent with Data Cleansing, Data Conversion, Performance Tuning, System Testing.
  • Expertise in creating reusable components such as Shared Containers and Local Containers.
  • Familiarity in in corporation of various data sources such as Oracle, MS SQL Server, DB2, XML and Flat files into the staging area.
  • Experience in Data Modeling, Multi Dimensional Modeling and involved in creation of Star Schema and Snowflake dimensional data marts using Erwin tool.
  • Proven track record in troubleshooting of DataStage jobs and addressing production issues like performance tuning and enhancement.
  • Acquaintance with PL/SQL, Stored Procedures, Packages, Database Triggers and SQL * Loader.
  • Pervasive Knowledge of IT industry awareness with Banking & Finance, Health Care.
  • Strong understanding of business processes & interface with IT.
  • Strong writing and documentation skills for the management, development.
  • Strong diagnostic, indicative, organizational, interactive, learning and team expertise.

TECHNICAL SKILLS

Software/Hardware: IBM Information Server /Ascential DataStage 8.1/7.5/7.0/6. X/5.X (server and Parallel Extender), ERwin 4.0, SQL*PLUS, PL/SQL, XML, Oracle 11g/10g/9i/8.x/7x, DB2 9.7/9.5, SQL Server 2007/2005, MS Access 7.0/2000, UNIX AIX 6.1, Red Hat Linux, Sun Solaris 2.6, Windows 7 /XP/2000, Unix shell scripting. HTML, C/C++, JAVA, XML, XSL, JavaScript, Dream weaver, Flash 5.0, Developer 2000

PROFESSIONAL EXPERIENCE

Confidential, New York City, NY

Sr. DataStage Developer

Responsibilities:

  • Designed and developed both server and parallel jobs according to the business requirements.
  • Implemented FpML (Financial Product Markup Language) parsing in DataStage v8.5 using XML 3.0
  • Developed jobs which are used by Cognos in preparing various reports as required by the business.
  • Developed jobs for calculating the End-of-Day position of the parties that are involved in a trade based on the individual USI (Universal Swap Identifier)
  • The daily volume for the Position Calculation is more than 3.5 million records
  • Used CDC, XML 2.0/3.0, MQ Connector, Aggregator, Pivot, Modify, Join, Look up and Merge stages
  • Worked extensively on different versions of FpML (Financial Product Mark Up Language ) to understand the schema structure.
  • Worked with more than 42 XSD’s (Schema definition of XML) for FpML
  • Used M-Queue to achieve the Real-Time Data Warehouse
  • Created tables in Oracle Database and loaded the data.
  • Extracted data from DB2 using stored procedures and loaded into Oracle.
  • Wrote shell scripts for automation and for running DataStage jobs.
  • Established best practices in Data Stage to achieve optimal performance.
  • Used shared containers for reusability.
  • Involved in addressing the FpML issues and creating PMR’s, supportive documentation to IBM.
  • Worked with IBM to test the patches for the new XML stage in DataStage 8.5.
  • Participated in daily meetings to conclude the Fact and Dimension tables.
  • Worked on the conversion from CSV to XML using Javascript.

Environment: IBM Information Server 8.1/8.5 (PX), Oracle 11g, Toad 10.6, IBM Data Studio Developer 2.1, Serena Version Control 8.2, UNIX AIX, Secure CRT 6.6, MS Access, Control-M, Crontab, Oxygen XML Editor 9.3, Microsoft Visio 10.0.

Confidential, San Diego, CA

Sr. DataStage Developer

Responsibilities:

  • Participated business meetings with vendors and clients in finalizing the enhancements.
  • Created high level design documents for extract, transform, validate and load ETL process and flow diagrams.
  • Created Data Models using ER-Win
  • Created tables in Oracle Database Schema and loaded data.
  • Validated data between source and target.
  • Created stored procedures in PL/SQL to load batch data.
  • Created new project environments in Development, Test and Production for CIM (Customer Information Management).
  • Studied the existing systems, and created generic jobs to reduce the man hours/ jobs.
  • Assigned tasks to Development Team and participates code review sessions.
  • Co-coordinated Off shore and on shore development, Testing and support teams.
  • Conducted business meetings to resolve the design issues.
  • Involved in project development and created parallel jobs using DB2 UDB, Oracle, ODBC.
  • Lookup, join, sequential file, transformer, dataset, peak, funnel, sort, aggregator, remove duplications, modify, CDC, row generator, row merger and other stages.
  • Involved in data mapping from source to target as per business requirements.
  • Created wrapper script to run jobs/ exception handling/ email notification which basically controlled the number of job runs in the server, and success/ failure reports.
  • Established best practices for Data Stage jobs to ensure optimal performance, reusability, and restartability.
  • Migrated projects between Development, Test and Production.
  • Created Design Documents, Test Plans, Design Standards Guide.
  • Wrote shell scripts for automation, job run, FTP, file processing, initial load, batch loads, cleanup, job scheduling and reports.
  • Involved in Data Validation and analysis.
  • Trouble shooted Production Issues.
  • Tuned production jobs to reduce the cycle time and resource utilization.

Environment: IBM Information Server 8.1 (PX), CSV version control, Oracle 11g, DB2 - 9.7, UNIX AIX, MS Access, Control-M, Crontab, Erwin, Toad, FTP Switch, SQL Server2008.

Confidential, Arlington, TX

Sr. DataStage Developer

Responsibilities:

  • Participated in business meetings with vendors and clients in finalizing the enhancements.
  • Created high level design documents for extract, transform, validate and load ETL process and flow diagrams.
  • Setup new project environments for new projects.
  • Studied the existing systems, and created generic jobs to reduce man hour.
  • Involved in new projects development and created parallel jobs using DB2 UDB, ODBC. Net, lookup, join, sequential file, transformer, dataset, peak, funnel, sort, aggregator, remove duplications, modify, CDC, row generator, row merger and other stages.
  • Involved in data mapping from source to target as per business requirements.
  • Created wrapper script to run jobs/ exception handling/ email notification which basically controlled the number of job runs in the server, and success/ failure reports.
  • Established best practices for DataStage jobs to ensure optimal performance, reusability, and restartability.
  • Wrote shell scripts for automation, job run, file processing, initial load, batch loads, cleanup, job scheduling and reports.
  • Involved in system and performance testing and performance tuning of SQL queries.
  • Extracted data from SQL Server and loaded into Oracle Database.
  • Took part in code review and performance analysis of new jobs.
  • Designed and tested the migration of DataStage jobs from development system to test system and then to production system for operational data store and Data Warehouse.
  • Scheduled jobs using UNIX crontab and ZEKE Scheduler.
  • Involved in framework design to minimize the number jobs in development.
  • Developed load utility using MS Access for loading tables.
  • Worked with DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
  • Involved in metadata driven processes, where we only need to insert a row in DB2 table to run new similar sources.

Environment: Ascential DataStage PX 7.5, DB2 UDB 9.5, VB, Oracle 10g, SQL Server 2005,UNIX AIX, MS Access, Crontab, ZEKE Scheduler, Erwin, Control Center.

Confidential, Richmond, VA

DataStage Developer

Responsibilities:

  • Worked on Both DataStage Parallel and Server edition environments.
  • Involved in designing and development of both server jobs and parallel jobs to load data from text files, sequential files, flat files, MS Access.
  • Created High Level design Documents for Extract, Transform, Validate and Load ETL Process and flow Diagrams.
  • Worked on Enhancements of the Project including Populating new Fields in the customer Master Table, loading new ODS structure into BW and capturing data errors.
  • Created load ready files for BW and created jobs to extract, transform and load mainframe data into SAP BW.
  • Participated in business meetings in finalizing the enhancements.
  • Involved in analyzing their requirement and populating metadata for the new fields.
  • Creating source files by loading data from various tables in the repository.
  • Worked extensively on Complex Flat Files and Wrote routines as per PM USA business requirements.
  • Creating both local and shared containers to use or move data in or across the repositories.
  • Used Change capture, Aggregator, Merge stages to compare, perform summation and combining data sets.
  • Created Job Sequencers and applied Dependency logic using DataStage Job Sequence.
  • Took part in code review and performance analysis of new jobs.
  • Also involved in production support along with designing and development of jobs.
  • Scheduling jobs in the production environment by using the scheduling functionality of the DataStage director.
  • Monitoring jobs and finding out the failed jobs and resolve them accordingly.
  • Monitoring disk space and resolving the issue by deleting large log files.
  • Creating tickets for all failed or hung jobs and also for the disk space usage.

Environment: Ascential DataStage 7.5/7.0 (Parallel Extender/Server), Oracle 10g,9i, MS Access, UNIX, Livelink, Sequential files, Complex Flat files, SQL Server 2000

Confidential, Auburn Hills, MI

DataStage Consultant

Responsibilities:

  • Designed DataStage ETL jobs for extracting data from heterogeneous source systems, transform and finally load into the Data Marts.
  • Identify source systems, their connectivity, related tables and fields and ensure data suitable for mapping.
  • Creating source table definitions in the DataStage Repository by studying the data sources.
  • Creation of hash tables used for referential integrity and/or otherwise while transforming the data representing valid information.
  • Proper selection of the hash table design parameters for faster table look-up.
  • Creation of re-usable components using shared containers for local use or shared use.
  • Import and export of repositories across projects.
  • Creating Error Files and Log Tables containing data with discrepancies to analyze and re-process the data.
  • Writing routines for Error Correction and inserting default values for specific errors
  • Use of Aggregator stages to sum the key performance indicators used in decision support systems.
  • Troubleshooting the designed jobs using the DataStage Debugger
  • Tuning DataStage transformations and jobs to enhance their performance.
  • Writing PL/SQL and stored procedures for extracting as well as writing data
  • Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions on ad hoc or scheduled basis
  • Creation of jobs sequences.
  • Creation of job schedules to automate the ETL process.
  • Enhancing the job properties for performance tuning.
  • Documentation of Data Acquisition and Interface System Design.

Environment: Ascential DataStage 7.5/6.0 (Server and Parallel Extender), Sun Solaris, Oracle 9i

Confidential, NY City, NY

ETL Developer

Responsibilities:

  • Developed mapping document to map the source and the target columns and various transformations required from source to target.
  • Managed the DataStage repository using DataStage-Manager.
  • Developed Data Stage Server as well as Parallel jobs to load the data from flat files, text files, tag text files and MS Access.
  • Set various parameters in Data Stage Administrator for performance tuning.
  • DataStage Designer is used to develop various jobs.
  • Unit Testing is done at various times to check the validity of the data at each stage.
  • DataStage Director is used to debug the job and to view the error log to check for errors.
  • Utilized share containers for code reusability and for implementing the predefined business logic
  • Worked with the modeler and suggested various changes in the physical model to support the business requirements.
  • Developed various transformations using modify stage, transformer stage, used other stages such as merge stage, look up stage, funnel stage, filter stage, copy stage, look up file set stage.
  • Worked with internal staff to implement best practices in the development environment (code standards, code migration, etc
  • Developed jobs to load data into ALMIS (America's Labor Market Information System) and CIDS (Career Information and Development System).
  • By checking job dependencies, created and scheduled the job sequences.
  • Automation is done by using batch logic, scheduling jobs on a daily, on a weekly and yearly basis depending on the requirement using DataStage Director.

Environment: IBM/Data Stage 7.5 (Parallel Extender/Server) Windows NT 4.0, Linux, Oracle 10g, 9i, MS Access, FoxPro, UNIX, SQL Server 2000, Sequential files, MS Access, CVS files, XML files

Confidential, Northbrook, IL

DataStage Developer

Responsibilities:

  • Analyzed and Designed ETL processes.
  • Identified / documented data sources and transformation rules required to populate and maintain data warehouse content.
  • Created DataStage Server jobs to load data from sequential files, Flat Files and MS Access.
  • Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
  • Used the DataStage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data into different Data Marts.
  • Prepared Data Volume estimates.
  • Defined the data definitions, and created the target tables in the database.
  • Wrote routines to schedule batch jobs to obtain data overnight from various locations.
  • Mapped the source and target databases by studying the specifications and analyzing the required transforms.
  • Troubleshot jobs using the debugging tool.
  • Analyzed the performance of the jobs and project and enhance the performance using the standard techniques.
  • Standardized the Nomenclature used to define the same data by users from different business units.
  • Created job sequences and schedules for automation.
  • Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad hoc or scheduled basis).
  • Used DataStage to transform the data to multiple stages, and prepared documentation.
  • Provided data modeling support for numerous strategic application development projects.
  • Analyzed business functionalities and building the fundamental blocks.
  • Created ETL execution scripts for automating jobs.
  • Worked on writing routines to read parameters from hash file at runtime.
  • Unit tested the mappings to check for the expected results.
  • Documented the Purpose of mapping so as to facilitate the personnel to understand the process and in corporate the changes as and when necessary.
  • Built Business Objects Universes for the Fact Tables.
  • Generated Cross-tab reports in BO

Environment: Ascential DataStage 6.0/5.1 (Designer, Director, Manager), Windows NT 4.0, UNIX, Oracle 8i, PL/SQL, Dbase3 Files, DOS and UNIX Sequential Files, MS Access, Business Objects 6.1.

Confidential

Developer

Responsibilities:

  • Involved in designing the database model.
  • Designed and developed forms for the user interface using Oracle Forms.
  • Wrote PL/SQL Scripts to create, alter and drop database objects likes tables, views, sequences, procedures and functions.
  • Wrote stored procedures and functions to retrieve the data from the database using PL/SQL.
  • Different database triggers containing PL/SQL were created and stored in the database and fired off when contents of database were changed.
  • Involved in performance tuning of the application.
  • Designed and developed matrix reports using Oracle Reports for the analysis of the data.
  • Migrated the data from the flat files to the database using SQL*Loader control scripts.
  • Implementation of DataStage version 5.1 for creating Decision Support System.
  • Invoked Stored Procedures and shell Scripts from DataStage by using the concept of before and after subroutines.
  • Wrote basic routines for complex business transformation within DataStage.

Environment: SQL*Forms, SQL*Menu and SQL*Report writer, Oracle 7.0 with SQL*Plus, PL/SQL, DataStage 5.1, UNIX, Windows 3.1 and Access 95

We'd love your feedback!