Data Stage Developer Resume
Sanfrancisco, CA
SUMMARY
- Over 8 years of experience in IT Industry with extensive knowledge in Data Warehousing IBM InfoSphere Datastage, Qualitystage, Developing, Designing, and implementing of Client - Server in various industries such as Financial, Banking, and Insurance.
- 5 years of experience in Data Warehousing, with thorough knowledge of dimensional modeling.
- Have knowledge on Epic Clarity database and its data model.
- Well experienced as Datastage Admin for two projects while migrating to latest versions.
- Experienced in designing and implementation of ETL/ELT framework for complex warehouses/data marts.
- Experience on complex transformation and loading of high-volume data in terabytes.
- Extensively worked with Parallel Extender for Parallel Processing to improve job performance.
- Expertise in all phases of the Software Development Life Cycle (SDLC) including analysis, Physical and Logical design, Resource Planning, code development, testing, implementation and maintenance.
- Experienced in agile /scrum methodologies.
- Experienced in using IMM( INFORMATICA metadata management).
- Expertise in writing complex SQL queries and PL/SQL, including the use of stored procedures, functions and triggers to implement business rules and validations in the situation of Oracle 11g/10g/9i/8i.
- Experience working with SAP BW/BI landscape.
- Expertise in developing Stored Procedures, Functions, Packages, Views, Cursors, Collections (Nested Tables and Varrays), Records, Object Types and Database Triggers.
- Strong knowledge of database technologies such as ORACLE,NETEZZA and MYSQL. and principles, including data modeling, data mapping etc..
- Experience with Star and Snowflake Schema, Data Modeling, Fact and Dimensional Tables and Slowly Changing Dimensions.
- Extensive experience working with Datastage Designer and DataStage Director to run, debug and validate DataStage Jobs and DataStage Manager to view/edit repository, create/import metadata.
- Designed Parallel jobs using various stages like join, merge, lookup, remove duplicates, filter, dataset, lookup file set, modify, aggregator, Transformer.
- Experience in integration of various data sources like TERADATA,Oracle, DB2, SQL Server, MS Access and Flat files into the Staging Area. Extensively worked with materialized views and TOAD
- Experience in performance tuning, Strong performance tuning knowledge in SQL and ability to interpret plans, identify bottlenecks in queries and remediate them.
- Working experience in interacting with Business Analysts and developers to analyze the user requirements, functional specifications and system specifications.
- Experienced working with various operational sources like Teradata, SQL Server, Oracle, DB2, Flat files
- Experienced in Specifying solutions and articulate value to customers
- Experienced in creating Data Lineage documents.
- Experience in writing SQL queries, stored procedures and functions.
- Expertise in writing UNIX shell scripts and scheduling them.
- Experienced in onshore - offshore development model.
TECHNICAL SKILLS
ETL Tools: IBM Qualitystage/ InfoSphere / WebSphere Datastage 11.3/9.1/8.5/8.1/ 7.5.2/7.1 (Administrator, Manager, Designer, Director, Orchestrate, Information Analyzer, Quality Stage)
Operating Systems: IBM AIX 4.3 and Windows NT 4.0/2000/2003/ xp windows 7/8/10.
Languages: PL/SQL, C/C++, UNIX (AIX, HP-UX) Shell scripting, Java.MDM(10,10.3,11,11.4)
Database: Oracle 11g/10g/9i/8i/, SQL Server 2000/2005/2008 , DB2, UDB/DB2 on AIX.Netezza.TERADATA.
Other: Cyber fusion, SQL Assistant, Pattern Action Language (PAL), Perl scripting, Autosys, SAP MDM 5.5/7.1, Management console, DataStageTrouble shooting, Data Issue resolution, batch monitoring,TABLEAU.
PROFESSIONAL EXPERIENCE
Confidential, Sanfrancisco, CA
Data Stage Developer
Responsibilities:
- Involved in migration process from datastage 9.1 version to 11.3 version on windows platform and tested by performing and deploying jobs into Database post Migration.
- Conducted detailed data analysis / reporting using IBM Web Sphere Information Analyzer for the multiple sources from various
- Developed block diagrams and logic flowcharts
- Involved in creating Data Lineage documents, Source to Target (STM) Mapping documents and Low Level Technical Specification Documents
- Data base design & data model - Logical & Physical design.
- Worked on the Architecture of ETL process and integrated with BI tools such as TABLEAU
- Created Data stage jobs (ETL Process) for populating the data into the Data warehouse constantly from different source systems like ODS, flat files, scheduled the same using Data Stage Sequencer for SI testing.
- Engaged in dealing with production issues onsite.
- Engaged in preparing and developing Datastage reports everytime.
- Extracted data from sources like Oracle 11g and MYSQL.
- Preparing development timing plans & reporting to senior management about the supplier progress system & ensuring their engineering support for onsite integration & production launch.
- Designed and developed parallel jobs, server and sequence jobs using Datastage Designer.
- Extensively involved in using different types of stages like Transformer, Aggregator, Merge, Join, Lookup, and Sort, Remove duplicate, Funnel, Filter, Pivot, Shared containers for developing jobs.
- Involved in the Documentation of the ETL phase of the project and exposure to IMM.
- Developed the reusable components, best practices that were later on used in other Data warehouse.
- Documenting business process, lesson learnt & best practices for the project with BI tools such as TABLEAU
Environment: IBM Information server 11.3, Autosys, ClearCase, Unix Shell Scripting, Windows 7, SQL Server 2008, Oracle 11g and Putty.
Confidential, Portland, OG
Sr. DataStage ETL Analyst/ Developer
Responsibilities:
- Developed Datastage jobs based on System Use-case Documents, Source-Target mappings and Supplementary Specifications.
- Analysed XML’s, XSD along with MQ and strong in developing code around these to process them.
- Develop block diagrams and logic flowcharts.
- Monitor operations daily to ensure that theTivoli Storage Managersystem is functioning properly or not
- Created a DataStage job to implement logic to make sure the same provider records should not be loaded into the table again while running the datastage job with the same plan code.
- Taken the responsibility of deploying the datastage jobs, ddl scripts, SQL scripts to various environments like Testing and Performance Engineering.
- Involved in DDL activities like creating a table, alter table and dropping table as part of deployment process.
- Administered the DataStage for security hazards, denied access to non authorized servers.
- Involved in writing the Deployment Guide and Release Notes for various releases of the project.
- Closely worked with testing team to resolve any deployment issues and assigned defects.
- Performed DRY RUN of the datastage jobs for the current release in PE team using Tivoli setup in order to avoid any deployment issues like missing job sequence, Tivoli setup issues or missing reference data etc.
- Used Director Client to validate, run, schedule and monitor the datastage jobs that are run by WebSphere DataStage server.
- Used DataStage Designer to develop parallel jobs to extract, cleanse, transform, integrate and load data into Data Warehouse with BI tools such as TABLEAU.
- Administered DataStage projects, managed global settings and provided command interface to the datastage repository.
- Worked extensively on resolving production issues, performance tuning, Developing data stage reports and also in creating processes using Datastage for data loading and processing .
- Used Data Stage Director to schedule, monitor, analyze and debug DataStage jobs.
- Designed Data Stage job streams to specify Job execution order using Tivoli setup.
- Tuned Data Stage jobs to obtain better performance by using various tuning techniques.
- Imported and exported data stage jobs across various environments (PV & PE) using DataStage Manager.
- Unit tested Data Stage Jobs in development including creating the appropriate test data.
- Export and import table definitions using DB2 plug-ins for various purposes.
Environment: IBM Infosphere 8.1, PL/SQL, IBM DB2UDB, ClearQuest. ClearCase, RequisitePro, Tivoli, Quality stage, TERADATA.
Confidential, Charlotte, NC
ETL/ Sr. Datastage Developer
Responsibilities:
- Used DataStage as an ETL tool to extract data from sources systems to Target system.
- Designed complex DataStage mappings between sources (external files and databases) to Operational staging targets using Oracle as the target database in Data Warehouse.
- Involved in integrating data from Teradata using utilities like Multiload, Fastload.
- Involved in giving access to the developers.
- Analysed XML’s, XSD along with MQ and strong in developing code around these to process them.
- Used DataStage Designer to develop jobs for extracting, cleansing, transforming, integrating, and loading data into data warehouse database.
- Worked extensively on resolving production issues, performance tuning, Developing data stage reports and also in creating processes using Datastage for data loading and processing .
- Developed several transformations in the process of building Data warehouse database.
- Worked on retrieving data from different legacy systems such as Oracle, DB2,netezza.
- Used Lookup transformations to manipulate the information.
- Monitor operations daily to ensure that theTivoli Storage Managersystem is functioning properly or not.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Creating Data Lineage documents, Source to Target (STM) Mapping documents and Low Level Technical Specification Documents
- Involved in integrating data from different sources like Oracle, Netezza.
- The procedures are called through STP stage. The procedures are customized as per the job requirements.
- Worked on Universe Database to create Hash Files, Intermediate files while ETL process.
- Interacted with User Groups/ Corporate Testing Groups/Business people.
- Developed shell scripts to automate file manipulation and data loading.
Environment: DataStage 9.1Designer, Manager, Netezza, Sybase, Oracle 9i/8i, DB2, PL/SQL, SQL Loader, Business Objects 5.0, AIX, clearcase, UNIX, Shell Scripting,TERADATA. IBM WebSphere Quality Stage,IBM WebSphere Quality Stage
Confidential, Detroit, MI
Data stage Developer
Responsibilities:
- Designed the ETL jobs using IBM Infosphere DataStage 9.1 to Extract, Transform and load the data into staging, ODS and EDW.
- Analysed XML’s, XSD along with MQ and strong in developing code around these to process them.
- Designed and developed the ETL jobs using Parallel Edition, which distributed the incoming data concurrently across all the processors, to achieve the best performance.
- Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture (CDC), Modify, Row Generator and Aggregator.
- Responsible for generation of DDL statements, which are executed, for database creation.
- Responsible for preparing Physical/logical data models.
- Responsible for data analysis, requirements gathering, report analysis, source-to-target mapping, frequency analysis, process flow diagrams, and documentation.
- Handled Performance Tuning of Jobs to ensure faster Data Loads.
- Worked extensively on resolving production issues, performance tuning, Developing data stage reports and also in creating processes using Datastage for data loading and processing .
- Designed sequence jobs using the activities such as Job Activity, Nested Condition, Notification Activity, Sequencer Activity, Terminator Activity and Execute Command.
- Performed the Integration and System testing on the ETL jobs and also worked on SSIS,SSRS.
- Responsible for preparing ad hoc jobs.
- Translated business rules and functionality requirements into ETL derivations.
- Scheduled jobs using Autosys scheduler utility based on the requirements and monitored the production processes closely for any possible errors.
- Migrated projects from development to QA to Production environments.
- Assisted operation support team for transactional data loads in developing SQL & UNIX scripts.
- Imported the required Metadata from heterogeneous sources at the process level.
- Created Job Parameters and Environment variables to run the same job for different sources and targets.
- Used Multi-job-compiler during deployment of projects.
- Created Batches (DS job controls) and Sequences to control set of jobs.
- Used the Director to schedule running the job, testing and debugging its components, and monitoring and involved in performance tuning.
- Develop block diagrams and logic flowcharts and performed Autosys jobs and also written Jil scripts
- Created Shared Containers for Re-using the Business functionality.
- Collaborated with BO team to design Crystal reporting and reports for enterprise reporting applications.
- Worked with Developers to troubleshoot and resolve issues in job logic as well as performance.
Environment: InfoSphere (DataStage) 9.1, 8.7.2 and 7.5, DB2, Core Java, Oracle, SQL server, Business Objects 3.1, Linux and XML.
Confidential, New York
DataStage Developer
Responsibilities:
- Developed jobs Using Parallel Extender for Extraction, Transformation and Loading (ETL) the data into the data warehouse.
- Designed the Jobs using the DB2 enterprise stage, Look Up Stage, Merge Stage, Join Stage, Data Sets, Sequential Stage, Row Generator Stage, Transformer Stage and Modify Stage.
- Used DataStage Manager for importing metadata from repository, new job categories and creating new data elements.
- Used the DataStage Designer to design and develop jobs for extracting, cleansing, transforming, integrating, and loading data into different Data Marts.
- Defined the data definitions and created the target tables in the database.
- Mapped the source and target databases by studying the specifications and analyzing the required transforms.
- Wrote the SQL queries & PL/SQL code tables and Data Mart Staging Tables to validate the data results by counting the number of rows in both the tables.
- Experienced in resolving production issues and involved in performance tuning.
- Develop block diagrams and logic flowcharts.
- Worked extensively on resolving production issues, performance tuning, Developing data stage reports and also in creating processes using Datastage for data loading and processing .
- Developed UNIX shell script to run jobs in multiple instances by using a parameter file.
- Performed Import and Export of DataStage jobs using DataStage Manager to take backups and maintain them in CVS.
- Develop block diagrams and logic flowcharts and performed Autosys jobs and also written Jil scripts.
- Interacted with Solutions analysts, system staff, ETL, BO developers and the data load staff.
- Involved in Unit, Integration, System and User Acceptance Testing (UAT).
- Using ODBC stage Extracted the data from SQL Server databases, Oracle databases and loaded in to DB2 Tables
- Created Complex SQL Queries and Used in the Jobs simultaneously working on SSIS,SSRS.
- Used the inter process stage to connect passive stages as well as active stages to enhance performance
- Used the surrogate key stage to generate surrogate keys on parallel jobs
Environment: IBM Information Server (Datastage) 8.1(Designer, Manager, Director, Administrator), EPIC, Parallel Extender, Oracle 10g, IBM DB2 UDB 8.2/8.0, SQL SERVER 2000, Teradata, Windows XP, AIX 5.3/5.1, Putty.
Confidential
System/DataStage Developer
Responsibilities:
- Involved in creating entity relational and dimensional relational data models using Data modeling tool Erwin
- Designing the Target Schema definition and Extraction, Transformation and Loading (ETL) jobs using Data stage
- Developed Analytical jobs that can analyze large amounts of online and offline data using orchestrate environment and involved in performance tuning.
- Creating Data Lineage documents, Source to Target (STM) Mapping documents and Low Level Technical Specification Documents
- Using Orchestrate, integrated third party applications with in-house applications
- Used the Data stage Designer to develop processes for extracting, cleansing, transforming, integrating, and loading data into data mart Oracle database
- Worked on programs for scheduling Data loading and transformations using Data Stage from legacy system and Data Warehouse to Oracle 9i
- Developed DataStage Jobs to load the data from the source to various staging levels like Aggregator, Filter, Sort & Merge, Funnel, and Remove Duplicate Stage
- Worked with Data stage Manager for importing metadata from repository, new job, Schema files Categories and creating new data elements
- Involved in Designing Parallel Extender Jobs
Environment: Ascential Data Stage 7.5(Manager, Designer, Director, Administrator), Oracle 9i, DB2, DB2 UDB, SQL, UNIX, Windows NT 4.0.
