Sr. Datastage Developer Resume
Richardson, TX
SUMMARY:
- Highly competent DataStage Developer/Consultant with over 9 years of experience in Information technology in Design, Development, Administrator and Implementation of various database and data warehouse technologies (IBM DataStage v11.X/9.X/8.X/7.X) using components like Administrator, Manager, Designer and Director. Over 7 years of experience in writing complex SQL queries and PL/SQL, including the use of stored procedures, functions and triggers to implement business rules and validations in the situation of Microsoft SQL, Oracle 11g/10g/9i.
- Good Knowledge about the principles of DW like Data marts, OLTP, OLAP, Dimensional Modeling, fact tables, dimension tables and star/snowflake schema modeling.
- Experienced in scheduling sequence, parallel and server jobs using DataStage Director, UNIX scripts and scheduling tools.
- Experience in using different types of stages like Transformer, Aggregator, Merge, Join, Lookup, Sort, Remove duplicate, Funnel, Filter, Pivot, Shared containers for developing jobs.
- Worked and extracted data from various data sources such as Oracle, MS - SQL Server, MS- Access, Teradata, DB2, XML and Flat files.
- Knowledge in using PL/SQL to write stored procedures, functions, and triggers.
- Experience in usage of Quality Stage for standardization and cleansing the data and also worked on various stages such as Transfer Stage, Select Stage, Sort Stage, Build Stage and join Stage
- Extensive experience in Unit Testing, Functional Testing, System Testing, Integration Testing, Regression Testing, User Acceptance Testing and Performance Testing.
- Created local and shared containers to facilitate ease and reuse of jobs.
- Worked on multiple projects on Conceptual, Logical and Physical Data Models with excellence in delivering them.
- Strong knowledge in identifying entities, attributes, metrics, relationships, optimizing the model and also assigning keys.
- Technical experience in Data Analysis and Data Modeling business needs of clients, working on effective and efficient solutions and ensuring client deliverables with challenging deadlines.
- Proficient in System Analysis, ER/Dimensional Data Modeling, Database design and implementing RDBMS specific features.
- Experienced in designing ODS architecture for modeling a Data Warehouse by using tools like Erwin, Power Designer and E-R Studio.
- Experience in Production Support, extensively worked on production support issues.
- Good Knowledge on Business Intelligence Development studio.
- Extensively used BI Integration Services to design ETL process and BI Analysis Services to create cubes.
- Quick learner and adaptive to new and challenging technological environments.
- Project Management experience with excellent problem-solving, organization and leadership skills.
TECHNICAL SKILLS:
ETL Tools: IBM InfoSphere / WebSphere Datastage 11.3/9.1/8.5/8.1/ 7.5.2/7.1 (Administrator, Manager, Designer, Director, Orchestrate, Information Analyzer, Quality Stage)
Operating Systems: IBM AIX 4.3 and Windows NT 4.0/2000/2003/ XP windows 7.
Languages: PL/SQL, Confidential / Confidential ++, UNIX (AIX, HP-UX) Shell scripting, Java.
Database: Oracle 11g/10g/9i/8i/, SQL Server 2000/2005/2008/2014 , Teradata, UDB/DB2 on AIX.
Other: Cyber fusion, SQL Assistant, Pattern Action Language (PAL), Perl scripting, Control M, Autosys, SAP MDM 5.5/7.1, Management console, DataStage Trouble shooting, Data Issue resolution, batch monitoring, skill set.
WORK EXPERIENCE:
Confidential, Richardson, TX
Sr. Datastage Developer
Responsibilities:
- Extensively involved in the data migration team to build the Re-usable Datastage job templates, common parameter sets, common Datastage job containers, SQL extract procedures and common re-usable shell scripts.
- Worked with business analyst to identify, develop business requirements, transform it into technical requirements and responsible for deliverables.
- Provide the staging solutions for Data validation and Cleansing with PL/SQL and Datastage ETL jobs.
- Implemented Aggregate, Filter, Join, Lookup, Rank and Update Strategy transformations.
- Extensively worked with DataStage 9.1 V - Designer and Director to load data from source extract files to warehouse.
- Worked with SAP R/3 server pack to connect to SAP system and extract the data using ABAP stages.
- Created Datastage jobs to load data from sequential files, CSV, Flat files, SQL Server and Oracle.
- Cleansed, standardize data using Quality stage.
- Developed various jobs using ORA OCI, ODBC, Aggregator, Sequential file stages.
- Used Fast load, Multi load scripts to load data into Oracle from flat files and COBOL copybooks.
- Worked towards optimal performance when using Stages like LOOKUP, JOIN, and MERGE.
- Designed and developed DataStage jobs for Loading Staging Data from different sources like Oracle, SQL Server DB into Data Warehouse applying business rules which consists data loads, data cleansing, and data massaging.
- Used the Datastage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions
- Created Shared Container to simplify the Datastage Design, and used it as a common job component throughout the project.
- Worked with Metadata Definitions, Import and Export of Datastage jobs using Datastage tools functionality.
- Created Parameters and Parameter sets where necessary.
- Tuned DataStage jobs for better performance by creating DataStage Hash files for staging the data and lookups.
- Created/Migrated packages from SSIS 2012 to SSIS 2014.
- Designed dynamic SSIS Packages to transfer data crossing different platforms, validate data during transferring, and archived data files for different DBMS.
- ETL design and development to populate data into datamarts and data warehouses using ETL tools like IBM DataStage , Oracle Data Integrator and SSIS .
- Scheduled the server jobs using DataStage Director, which are controlled by DataStage engine and also for monitoring and performance statistics of each stage.
- Performed functional testing for new release enhancements.
- Participated actively in the team meetings with the developers for bug reviews.
- Developed Shell Scripts to automate file manipulation and data loading procedures.
Environment: Datastage 9.1/11.3, SAP ECC, SQL Server, DB2, Oracle 11g, UNIX AIX and Windows 7.
Confidential, San Antonio, TX
Sr. Datastage Developer
Responsibilities:
- Extracted data from sources like Oracle and Flat Files and used to load into OLTP after different transformations.
- Experienced in using SQL *Loader and import utility in TOAD to populate tables in the data warehouse.
- Successfully implemented pipeline and partitioning parallelism techniques and ensured load balancing of data.
- Reviewed the project scope, requirements, architecture diagram, Conversion design documents (CDD) and development guide lines.
- Debug, test and fix the transformation logic applied in the parallel jobs
- Handled Performance Tuning of Jobs to ensure faster Data Loads.
- Designed sequence jobs using the activities such as Job Activity, Nested Condition, Notification Activity, Sequencer Activity, Terminator Activity and Execute Command.
- Performed the Integration and System testing on the ETL jobs.
- Translated business rules and functionality requirements into ETL derivations.
- Scheduled jobs using Control M scheduler utility based on the requirements and monitored the production processes closely for any possible errors.
- Migrated projects from development to QA to Production environments.
- Experience in QA testing of ETL processes.
- Worked with Developers to troubleshoot and resolve issues in job logic as well as performance.
- Imported the required Metadata from heterogeneous sources at the process level.
- Developed jobs to load the data into the Warehouse environment using the Slowly Changing Dimension techniques.
- Created Job Parameters and Environment variables to run the same job for different sources and targets.
- Used Multi-job-compiler during deployment of projects.
- Created Batches (DS job controls) and Sequences to control set of jobs.
- Used the Director to schedule running the job, testing and debugging its components, and monitoring.
Environment:IBM InfoSphere DataStage 9.1/7.5, Shell scripting, Oracle 10g, DB2, Teradata, Toad, PL/SQL, SQL*Loader, Oracle 10g, Control M.
Confidential, Minneapolis, MN
Sr. Data Analyst/Data Modeler
Responsibilities:
- Involved in the Analysis of the functional side of the project by interacting with functional experts to design and write technical specifications.
- Data base design & data model - Logical & Physical design.
- Worked on the Architecture of ETL process.
- Created Data stage jobs (ETL Process) for populating the data into the Data warehouse constantly from different source systems like ODS, flat files, scheduled the same using Data Stage Sequencer for SI testing.
- Extracted data from sources like Oracle and Flat Files.
- Preparing development timing plans & reporting to senior management about the supplier progress system & ensuring their engineering support for onsite integration & production launch.
- Developed technical infrastructure designs, data mappings, flows and report dissemination mechanisms by architecting Data Warehouses and Marts.
- Collaborated in Extraction of OLAP data from SSAS using SSIS
- Worked on Data Stage 8.x parallel version.
- Designed and developed parallel jobs, server and sequence jobs using Datastage Designer.
- Experience in using different types of stages like Transformer, Aggregator, Merge, Join, Lookup, Sort, Remove duplicate, Funnel, Filter, Pivot, Shared containers for developing jobs.
- Developed various bulk load and update procedures and processes using SQL * Loader and PL/SQL.
- Working in a team with other associate product & component developers.
- Involved in Unit Testing and Integration Testing to test jobs and also the flow.
- Worked on changed requests as per clients and projects technical specification needs.
- Awareness about the functional/business aspects for the components.
- Automated process of job monitoring which helped in minimizing the manual intervention & documenting them perfectly.
- Provide support for monthly/weekly batches in production run.
- Involved in the Documentation of the ETL phase of the project.
- Developed the reusable components, best practices that were later on used in other Data warehouse.
- Documenting business process, lesson learnt & best practices for the project.
Environment:IBM InfoSphere DataStage 8.5 (Administrator, Director, Designer), PL/SQL, Oracle 10g/9i, UNIX Shell scripts, Teradata, Flat files, SQL Developer
Confidential, Westchester, PA
Sr. Data Analyst/Data Modeler
Responsibilities:
- Designed the ETL jobs using IBM Infosphere DataStage 8.5 to Extract, Transform and load the data into staging, ODS and EDW.
- Designed and developed the ETL jobs using Parallel Edition, which distributed the incoming data concurrently across all the processors, to achieve the best performance.
- Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture (CDC), Modify, Row Generator and Aggregator.
- Responsible for generation of DDL statements, which are executed, for database creation.
- Responsible for preparing Physical/logical data models.
- Responsible for data analysis, requirements gathering, report analysis, source-to- Confidential mapping, frequency analysis, process flow diagrams, and documentation.
- Created and managed database objects including tables, indexes and procedures.
- Handled Performance Tuning of Jobs to ensure faster Data Loads.
- Designed sequence jobs using the activities such as Job Activity, Nested Condition, Notification Activity, Sequencer Activity, Terminator Activity and Execute Command.
- Performed the Integration and System testing on the ETL jobs.
- Responsible for preparing ad hoc jobs.
- Translated business rules and functionality requirements into ETL derivations.
- Scheduled jobs using Autosys scheduler utility based on the requirements and monitored the production processes closely for any possible errors.
- Migrated projects from development to QA to Production environments.
- Assisted operation support team for transactional data loads in developing SQL&UNIX scripts.
- Imported the required Metadata from heterogeneous sources at the process level.
- Created Job Parameters and Environmentvariables to run the same job for different sources and targets.
- Used Multi-job-compiler during deployment of projects.
- Created Batches (DS job controls) and Sequences to control set of jobs.
- Used the Director to schedule running the job, testing and debugging its components, and monitoring.
- Created Shared Containers for Re-using the Business functionality.
- Collaborated with BO team to design Crystal reporting and reports for enterprise reporting applications.
- Worked with Developers to troubleshootand resolve issues in job logic as well as performance.
Environment:IBM WebSphere DataStage and QualityStage 8.0.1a (Administrator, Designer, Director), IBM Information Analyzer8.0.1a, Microsoft SQL 2005/2008, IBM DB2 9.1, AIX6.0, Microsoft SQL 2008, Oracle 11g, Toad 9.5, Java, MS Access, SAP BW, SAP MDM, AS/400, shell scripts, PUTTY, WinSCP, ERWIN 4.0, HP Quality Center, Tivoli, IBM Rational Rose, AutoSys.
Confidential, Keene, NH
DataStage Developer
Responsibilities:
- Interacted with Business users and Technical Architects to analyze the data & gathering the requirements from various sources. Created Design Documents and Unit Test cases with test result documents.
- Involved with Business users and ETL Leads from different teams to implement ETL Frame Work using Datastage Server/Parallel combination of jobs.
- Extracted data from various sources like DB2, Oracle DB, Teradata, Mainframe files, Flat Files and loaded to Confidential databases and files.
- Designed jobs using different job stages such as Join, Merge, Lookup, Filter, and Dataset, Lookup file Set, Remove Duplicates, Change Data Capture, Connectors, CDC, ODBC, Switch, Modify, and Aggregator.
- Designing ETL jobs incorporating complex transform methodologies using Datastage tool resulting in development of efficient interfaces between source and Confidential systems.
- Responsible for trouble shooting, identifying and resolving data problems, Worked with analysts to determine data requirements and identify data sources, provide estimates for task duration.
- Deployed Datastage code between development and QA and followed up with the admin team for code promotion in production. Parameterized jobs for changing environments
- Developed jobs to load the data into the Warehouse environment using the Slowly Changing Dimensiontechniques.
- Involved in developing Datastage Designer Server and Parallel jobs for Extracting, Cleansing, Transforming, and Integrating/Loading Data into Enterprise Data Warehouse (EDW).
- Extensively designed, developed and implemented Parallel Extender jobs using Parallel Processing (Pipeline and partition) techniques to improve job performance while working with bulk data sources.
- Provided 24/7 production support for the entire ETL process in the organization.
Environment:IBM Web Sphere Datastage Enterprise Edition 8.5/8.7, DB2, Oracle, MYSQL, SQL Server 2005, Unix/AIX, Windows XP/2000/2007, TOAD, SQL Developer, Putty, Microsoft Visio, PL/SQL.
Confidential, New York, NY
Associate ETL Developer
Responsibilities:
- Designed the Confidential Schema definition and Extraction, Transformation and Loading (ETL) using Datastage.
- Provide solution document for data capture, data cleansing and data movement procedures.
- Mapped Data Items from Source Systems to the Confidential System.
- Developed SQL queries to performed DDL, DML, and DCL against Oracle.
- Used the Datastage Administrator to assign Privileges to users or user groups, move, rename, or delete projects, and manage or publish jobs from development to production status.
- Used the Datastage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions
- Worked with Datastage Manager for importing metadata from repository, new job categories and creating new data elements.
- Developed Shell Scripts to automate file manipulation and data loading procedures.
Environment: Ascential DataStage 7.5.2, Oracle 9i, MS Access, Linux, Windows 2003, SQL Server, PL/SQL, Shell Scripts
