We provide IT Staff Augmentation Services!

Data Stage Developer/ Etl Tester Resume

0/5 (Submit Your Rating)

Parsippany, NJ

SUMMARY

  • Over 7+ years of IT experience in design, development and implementation of data integration and Oracle development applications.
  • More than 6+ years of experience in Extraction, Transformation and Loading (ETL) process using IBM Infosphere DataStage 8.1, Ascential DataStage 7.5 (Administrator, Director, Manager, Designer), Parallel Extender, Information Analyzer and development of Data Warehouse/Data mart Applications.
  • Experience in Full Software Development Life Cycle (SDLC) including requirement analysis, design, development, testing, implementation and project documentation.
  • Strong understanding of the principles of Data Warehouse functions including the use of Fact Tables, Dimension Tables on Star Schema modeling, and Snowflake Schema modeling.
  • Designed and developed jobs using Parallel Extender for distributing load among different nodes by implementing pipeline and partitioning of data in parallel extender to achieve best job performance.
  • Strong knowledge in scheduling DataStage jobs using Control - M and Autosys.
  • Excellent experience in troubleshooting of DataStage jobs and addressing production issues like performance tuning and enhancements.
  • Proficiency in data warehousing techniques for Transforming, Slowly Changing Dimension phenomenon and Surrogate key assignment.
  • Very good experience in setup parallel and user defined Project specific Environmental Variables at Project level and using them as job parameters at job level.
  • Excellent knowledge of studying the data dependencies using Metadata stored in the DataStage Repository.
  • Experience in integration of various data sources like Oracle, ODBC, SQL SERVER, CSV files and Flat files into the Staging Area.
  • Experience in implementing ETL flow across databases like Oracle 11g/10g, DB2UDB 9.5/8.1/7.2 across multiple operating platforms like UNIX.
  • Experience in Extracting data from Unix Flat Files and Complex Flat Files.
  • Develop processes for cleansing, transforming, extracting, integrating and loading data with use of Datastage.
  • Self-motivated, customer-focused, teamwork oriented and strategically focused experienced professional with strong analytical, pattern detection and problem solving abilities.

TECHNICAL SKILLS

ETL Tools: IBM Information Server V8.1, Ascential Datastage 7.5

Operating Systems: Unix, Windows XP, Windows 2000, Solaris,IBM-AIX,HP-UX

Scheduling Tools: Autosys, Control-M.

Languages: C, C++, PL/SQL, Shell Script (Korn), Java Script, HTML, XML.

Databases: Oracle 11g/10g/9i, DB2 UDB 8/9, DB2, ODBC, SQL Server.

Packages: MS Office 2010/ 2007/ 2003 - Word, Excel, Access, PowerPoint, MS Visual Studio 2010/ 2008, MS Visual Basic 6.0

Knowleges: Datastage 8.5 and 8.7, TOAD, People Soft

PROFESSIONAL EXPERIENCE

Confidential, Parsippany, NJ

Data stage Developer/ ETL Tester

Responsibilities:

  • Used Data stage Designer to develop jobs for Extracting, Cleansing, Transforming and Loading data into data warehouse.
  • Developed the jobs in new Enterprise Data warehouse environment by using IBM Info Sphere 8.1
  • Complete Individual participation in documenting Documentation Inspection (DI) in order to present the result to the Business Intelligence department.
  • Worked with various Parallel stages like look-up, Join, Merge, Sort, Copy, Aggregator, Transformer etc.
  • Used Row-generator stage, for the creation of a dummy datasets with previous day’s data. This is needed for the first time run and resetting data to generate a full file if required.
  • Used Change Capture stage for the Creation of datasets by comparing current days and previous day’s datasets to select and write the insert/update and delete records to target dataset.
  • Created a Parameter Set to for reusability in the entire project.
  • Created Shared Containers to simplify the Datastage design, to use as a common job component throughout the project
  • Used the Data Stage Director and its run-time engine to schedule and run the jobs, testing and debugging its components and monitoring the resulting executable versions on scheduled basis.
  • Created job sequences to control the flow of jobs.
  • Performed Unit and Integration testing and validated the test cases by comparing the actual results with expected results.
  • Extensively used Data stage Designer, Administrator and Director for creating and validating jobs.
  • Resolved data issues during the testing processes and reloaded the data with all the necessary modifications.
  • Involved in Performance Tuning and troubleshooting of ETL programs, tuned Datastage and Stored procedures Code Analyzed and enhanced the performance of the jobs and project using standard techniques.
  • Regularly interacted with Developers to discuss various problems and issues.

Environment: s: IBM Info Sphere Information Server 8.1(Data Stage), Oracle (11g), ODBC, Flat files, SQL, PL/SQL, Toad, Autosys, Unix AIX, HP-UX.

Confidential, Phoenix, AZ

Data stage Developer

Responsibilities:

  • Worked with Business Analyst to identify, develop business requirements, transform it into technical requirements and responsible for deliverables.
  • Worked on troubleshooting, performance tuning and performance monitoring for enhancement of DataStage jobs.
  • Created the Functional/Technical specification documents by maintaining standards of the enterprise.
  • Designed the technical document for various jobs, unit test documents with various scenarios and acceptance level of test case results.
  • Actively participated in discussions and implementation of error Handling and reject management, Audit management process
  • Designed and developed parallel jobs for extracting, cleansing, transforming and loading the data from the database and load into the ODS and GL.
  • Extracted the source data from Oracle databases and loaded into the target Oracle database.
  • Worked extensively on different stages like Aggregator, Merge, Join, Modify, Lookup, Filter, Oracle Enterprise, Column Generator, Row generator stages for Data cleansing and Data Transformation.
  • Used copy stage, for copying current days data into previous days dataset. This dataset will be used for comparison for next day’s batch.
  • Created job sequencers.
  • Created a Parameter Set to for reusability in the entire project.
  • Worked with different data sources such as Oracle, ODBC and Flat files from Mainframe System.
  • Extensively used Autosys Scheduler Tool to schedule Data Stage jobs
  • Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad-hoc or scheduled basis).
  • Involved in weekly project plan meetings to track the progress of work and to reach the mile stones.

Environment: Data Stage 8.1 Enterprise Edition/Parallel Extender, Oracle (10g), ODBC, TOAD 7.4, Control-M, PL/SQL, C++, UNIX 5.2.

Confidential, Oldsmar, FL

Data stage Consultant

Responsibilities:

  • Worked in collaboration with Data Warehouse architects to design and develop Data Warehouse solutions. Work with Business Analysts and Functional Team members to translate Business requirements into technical specifications.
  • Extensively used ETL to load data from XML Flat Files, Oracle Apps to ORACLE Data Warehouse.
  • Developed mappings with performance, accuracy and efficiency in mind.
  • Used Information Analyzer to provide complete analysis of source systems and target systems, and assesses the structure, content, and quality of data, whether at the column level, the cross-column level, the table or file level, the cross-table level, or the cross-source level.
  • Developed data Mappings between source systems and target components using Mapping Design Document.
  • Developed robust mappings with built in reconciliation and error handling.
  • Worked extensively on different types of transformations Change capture, Modify, Peek, Tail, Head, Sequence generator, Aggregator, Column Import, Column Export, Inter Processer, Quality Stage, and FTP Stage.
  • Involved in writing transforms and routines.
  • Used various stages of Quality Stage for best-of-breed representation of the matched data.
  • Setup folders, groups, users, permissions and performed Repository Administration using Repository Manager.
  • Developed several Parallel jobs to improve performance by reducing the runtime for several jobs.
  • Designed and Developed jobs using Server jobs. Implemented Link Portioned & Link Collector Data into subsets and to dynamically distribute to all available Nodes to achieve best job performance.
  • Wrote PL/SQL Packages, Stored procedures to implement business rules and Validations.
  • Extensively worked with DS Administrator, DS Manager, DS Director and DS Designer
  • Interacted with off shore development team.
  • Involved in code walk through with the fellow developer to follow the guidelines for best practices.

Environment: DataStage EE 8.1/7.5 (Manager, Designer, Director, Administrator), Quality\Stage, Information Analyzer, PL/SQL, Oracle 10g, UNIX shell script.

Confidential, East Rutherford, NJ

Data Stage Developer

Responsibilities:

  • Involved in status meetings and interacted with the business analyst to get the business rules.
  • Imported meta data from various transactional data sources residing on SQL Server 2008, Oracle 10g and Flat files.
  • Used Information Analyzer for Column Analysis, Primary Key Analysis and Foreign Key Analysis.
  • Identified and documented the slowly changing dimensions.
  • Designed Parallel jobs using various stages like join, merge, remove duplicates, filter, dataset, lookup file set, modify, aggregator and funnel stages.
  • Converted complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance.
  • Enhanced the reusability of the jobs by making and deploying shared containers and multiple instances of the jobs.
  • Imported and exported repositories across DataStage projects.
  • Involved in the migration of DataStage jobs from development to production environment.
  • Extensively used Autosys for automated scheduling of UNIX shell script jobs on daily, weekly monthly basis with proper dependencies.
  • Used Oracle PL/SQL for writing stored procedures, packages for extracting the data.
  • Used various stages of Quality stage like standardize stage, survive stage, format convert, transfer and unijoin stages.
  • Performed Unit testing and System Integration testing by writing test cases
  • Involved in creating technical documentation for source to target mapping procedures to facilitate better understanding of the process and in corporate changes as and when necessary.
  • Worked on troubleshooting, performance tuning and performance monitoring for enhancement of DataStage jobs.

Environment: IBM Information Server DataStage 8.1, Oracle 10g, TOAD 8.6, Autosys, Windows 2000, UNIX Shell Scripting, SQL*Loader, Information Analyzer.

Confidential, New York, NY

Data stage Developer

Responsibilities:

  • Involved in creating ER and dimensional relational data models using data modeling tool.
  • Developed datastage ETL jobs.
  • Wrote individual functions for code reuse.
  • Responsible for documentation of work flows of all the datastage jobs.
  • Developed secondary indexed hash files.
  • Involved in unit, regression, performance and integration testing of datastage jobs.
  • Wrote shell scripts to create load ready files from external sources.
  • Wrote various Autosys JIL scripts to activate the UNIX scripts.
  • Developed shell scripts to automate file manipulation and data loading procedures.
  • Participated in weekly status meetings.
  • Responsible for troubleshooting various production systems and document resolutions.

Environment: Ascential Datastage 7.0/Parallel Extender, DB2 UDB, Oracle 9i, UNIX, SQL, PL/SQL.

Confidential

Data stage Developer

Responsibilities:

  • Identified and documented the Data source and target along with the data mapping rules and transformations.
  • Created UML diagrams for the high level project documents
  • Used various built in functions supported by oracle such as Character, Date, Conversion, Numeric, LOB, and other Miscellaneous Functions.
  • Used the Datastage Manager for importing metadata from repository, new job categories and creating new data elements.
  • Used Datastage Designer extensively to design and develop extraction jobs, transformation jobs, along with the jobs to load the transformed data.
  • Used the Datastage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad hoc or scheduled basis).
  • Proficient in performing various Data conversions using the built-in Transforms, SDK transforms, Functions and System variables.
  • Enhanced the performance using standard techniques not only in Datastage but also in database.
  • Wrote cursors involving Variables, Parameters, attributes and select for updates and more over also wrote Stored Procedures, functions and was also involved in Module Overloading.
  • Wrote Packages that involved Cursors, Variables, Constants, Exception names.

Environment: Datastage 7.5(Designer, Director, Manager, Parallel Extender) Debugger, DataStage BASIC language Expressions, UNIX, DOS and UNIX Sequential Files, .CSV File

We'd love your feedback!