Datastage Developer Resume
Boston, MA
SUMMARY:
- Around 7 years of experience in System Analysis, Design and Development in the fields of Data Warehousing, Data Integration, Data Migration and developing Client Server Application using Talend(5.5),DataStage (9.1/8.7), Oracle, PL/SQL, IBM SQL procedural language.
- Played significant role in various phases of SDLC for Data Warehouse and Agile Methodology.
- Experience with Distributed database systems in OLTP and Data warehousing.
- Hands on experience in using DataStage Designer to create complex jobs using different Transformations to pull data from heterogeneous systems.
- Hands on experience in Data Mapping. Built Source to Target Mapping (STM) documents for various projects which involve multiple data sources from different databases SYBASE, DB2.
- Used Quality Stage to coordinate the delivery, consistency, removing data anomalies and spelling errors of the source information. Experience in using stages , Standardization, Scrubbing, Matching and Survivorship rules using Quality Stage.
- Experience in Design and Development of ETL processes in all phases of the Data Warehousing Life Cycle with proficiency in Decision Support Systems.
- Extensively worked with business users to gather the requirement and write business and technical specifications.
- Used Netezza Enterprise stage for doing loads into Netezza Database. Developed Sequence jobs to call SQL scripts for the ELT process in the Netezza target database .
- Involved in the migration of the jobs from DB2 to Netezza.
- Developed and executed Data Stage jobs including Job execution status, monitoring a job, job log view, job scheduling, creating batches and scheduling batches. Responsible to create Source to Target (STT) mappings to data flow diagrams to design and develop ETL jobs.
- Worked on Star/Snow flake schemas modeling, Ralph Kimball and Bill Inmon methodologies .
- Hands on experience in writing Unix Shell Scripts, PERL scripting for the automation of various ETL scripts as well as for scheduling ETL jobs.
- Involved in production support to monitor the batch runs and address any issues. Proficient in using DataStage Director to run jobs, job sequences batches with logic embedded in the Transformations.
- Experienced on developing various jobs using stages OCI, Hashed file , Sequential file, XML, Aggregator, Pivot and Sort. Worked with sequential files, Oracle as sources and Oracle and XML as Targets .
- Excellent knowledge of various RDBM Systems and SQL. Experience on using SQL, PL/SQL, T - SQL, and ORACLE Database. Worked with Flat files , XML files and COBOL / Complex Flat Files.
- Involved in production support to monitor the batch runs and address any issues. Proficient in using DataStage Director to run jobs, job sequences batches with logic embedded in the Transformations.
- Worked on IBM Tivoli Job Scheduler for job scheduling and monitoring the jobs .
TECHNICAL SKILLS:
ETL Tools: Talend, Accentual Data Stage EE 7.5, IBM Information Server 11.5/9.1/8.7/8.5/8.1 (Designer, Director, Administrator, Manager)XML, Fast Track, IBM Tivoli,TAC,UC4.
Databases: Oracle 10g/9i/8i/8.0, IBM DB2 UDB 8.0/7.0, MS SQL Server, 2010/2005/7.0/6.0 , Teradata 14.0/13.0,MS Access, IBM Netezza 7.2.0/6.0.3.
Reporting Tools: Business Objects 6.5/XI, OBIEE 10g, Cognos.
Dimensional Modeling: Start Schema, Snowflake Schema, Data Vault Model.
C, Visual Basic, PL/SQL, T: SQL.
PROFESSIONAL EXPERIENCE:
Confidential, Boston, MA
Datastage Developer
Responsibilities:
- Developed detailed system designs and review approved systems system analysts and business analyst.
- Used IBM FastTrack to upload all the documentation and column to column data mapping and job description for better understanding.
- Developed DataStage jobs logic and review DataStage jobs that require modification .
- Worked with service manager to review schedules, objectives and priorities and also initiated suggestions for improvement to DataStage jobs .
- Used DataStage designer to develop processes for extracting cleansing transforming and integrating.
- Developed incremental jobs by implementing SCD Type 2 as per business requirement and design documents and source to target mappings.
- Created Extract, transform and load processes and programs in appropriate environments.
- Created source to target maps and transformation rules for data mart creation.
- Worked with various stages with in DataStage (Transformer, Lookup, Join, Merge, Funnel, Sort, Surrogate Key Generator, CDC,XML plugins, ODBC) etc.,
- Involved in quality stage to perform data investigation, data standardization etc.
- Involved in fine tuning the jobs. Mentor development team on DataStage, Oracle and DB2, shell scripts .
- Attended daily scrum meetings to provide update on the progress of the user stories to the Scrum Master and also to notify of any blockers or dependencies.
- Used HP Quality Center to log and as well keep track of defects.
- Created Project level Parameter sets.
- Worked on performance tuning of DataStage jobs and SQL to handle large volumes of data .
- Created ETL design documents, Unit test results documents, Quality Assurance test cases and participated in QA testing. Involved in testing, debugging and monitored the resulting executables.
- Creating Sequences for all the DataStage jobs which include Job Activity, User Variable Activity, Notification Activity, Terminator Activity and Notification Activity Sequences.
- Designed sequencers and scheduled the jobs according to the requirement using IBM Tivoli
Environment: DataStage 11.5(Designer, Director and Administrator), IBM Tivoli, Oracle 10g, SQL Server, Unix, Quality Center,DB2 SQL Server, PL/SQL, SharePoint, IBM FastTrack.
Confidential, Southfield-MI
DataStage ETL Developer
Responsibilities:
- Partnered with system analysts and business analyst to gather requirements and suggested solutions from customer to get best results.
- Imported Data from Microsoft SQL server and Oracle Server into Hadoop Filesystem using Sqoop and completed data validation using Data Fabric to get imported data into landing zone
- Worked as team lead to manage work with other developers and make sure assigned work was completed by end of sprint
- Written SQL queries to extract data from different tables and those queries used in Oracle stages.
- Developed Sqoop incremental script which runs daily or monthly to capture changes to tables imported from MSQL and Oracle servers .
- Used DataStage designer to develop processes for extracting cleansing transforming and integrating.
- Designed DataStage jobs to get data from SQL server and Oracle Server to load in staging area.
- Developed incremental jobs by implementing SCD Type 2 as per business requirement.
- Involved in creating high level design documents and source to target mappings.
- Used ETL framework for orchestrating all ETL workflows involving DataStage jobs, shell scripts and store procedures. This framework manages dependencies, logging and restart ability of the work flows.
- Designing target schema definition and extraction transformation using DataStage.
- Extensively worked on error handling, cleansing of data and performing lookups for faster access of data.
- Used DataStage director to run and monitor the jobs performed, automation of job control using batch logic to execute and schedule various DataStage jobs.
- Created SSIS packages for extracting the data from SQL Server and load the data into flat files or into DB2 Database.
- Worked with various stages with in DataStage (Transformer, Lookup, Join, Merge, Funnel, Sort, Surrogate Key Generator, CDC,XML plugins, ODBC) etc.,
- Involved in quality stage to perform data investigation, data standardization etc.
- Involved in fine tuning the jobs. Mentor development team on DataStage, Oracle and DB2, shell scripts and clinical data.
- Attended daily scrum meetings to provide update on the progress of the user stories to the Scrum Master and also to notify of any blockers or dependencies.
Environment: DataStage 11.5(Designer, Director and Administrator), IBM Tivoli, Oracle 10g, SQL Server, SSIS, Apache Hadoop 2.0, HDFS, Hive, Pig, HBase, Sqoop, Service Catalog,HPSM,DB2,SQL*Plus, Rally, Oracle 11, Reflection 14.0.
Confidential, Chicago-IL
DataStage ETL Developer
Responsibilities:
- Deliver new and complex high-quality solutions to clients in response to varying business requirements.
- Understanding the Business specifications and client needs and design technical solutions.
- One to one discussion about requirements conducted JAD sessions to discuss about requirements.
- Responsible for understanding the technical specification and building the ETL jobs accordingly.
- Performed data analysis for the existing data warehouse and changed the internal schema for performance.
- Wrote mapping documents for all the ETL Jobs (interfaces, Data Warehouse and Data Conversion activities.
- Responsible to develop data stage jobs to extract data from SAP systems using ABAP Extract stage and load into enterprise Data Warehouse.
- Worked for the migration of reporting database from DB2 to Netezza.
- Responsible for Netezza extract load and transform mechanism by taking data from various sources and loading it into Netezza DB using NZSQL and NZLOAD utilities.
- Extracted data from different source systems (PeopleSoft, Informix, DB, SLQ Server DB) and moved them into the Netezza warehouse and mart.
- Extensively used Autosys for automation of scheduling for UNIX shell script jobs on daily, weekly monthly basis with proper dependencies
- Developed Sequence jobs to call SQL scripts for the ELT process in the Netezza target database.
- Created shell scripts to perform validations and run jobs on different instances (DEV, TEST and PROD).
- Job sequence design for integration entire set of jobs developed and developing Control Jobs for whole Sequences.
- Scheduling and sequencing the jobs according to the requirement.
- Responsible for creating, running, and/or scheduling their jobs as well as migrating new jobs from development to production and daily monitoring of their own objects in the Backlog and History.
- Worked on The UC4 Job Scheduler for job scheduling and monitoring the jobs .
- Participation in SIT and preparation of SIT test Cases & results Documentation.
- Participation in UAT and Rectification of bugs and Change requests.
- Production support in the Warranty period and responsible for bug fixing.
- Used Administrator for creating projects and managing the users and for setting the variables and parameters.
- Responsible for performance Tuning data stage jobs.
- Worked on creating SQL scripts for Unit Test.
- Responsible to Check In and Check Out the Data Stage code in PVC version Control System.
- Responsible for maintaining all configurable items, technical documentation.
Environment: IBM Information Server DataStage and Quality Stage, Administrator 8.7,UC4, SAP ECC (SD, MM, FICO), SAP Extract PACK (ABAP Extract Stage, BAPI Stage, IDoc Stage),Netezza 6.0(Twin fin 24,Twinfin 36) SQL Server 2008, Oracle 10g, Linux, Unix, SharePoint, AIX, Autosys, Business Objects XI, PVC Version Control, PL/SQL.
Confidential
DataStage Developer
Responsibilities:
- Extensively worked on Data stage client components Designer, Director and Administrator.
- Involved in all phases including Requirement Analysis, Design, Coding, Testing, Support and Documentation.
- Worked on loading of data from several flat files sources.
- Translating Requirements into technical design that meets goals and objectives of the business, driving business process changes and reporting on progress and issues.
- Responsible for configuring and implementing the Oracles Customer care and billing supporting by gathering functional requirements.
- Parameterization of Data Stage Jobs through Parameter File.
- Had contributed to Monitor and load the data into the system.
- Used Transformer, Funnel, Join, Merge, Lookup, Oracle Connector, Filter, Change Data Capture (CDC), Surrogate Key Generate Stages.
- Developed several complex ETL jobs for Historical data loads and ongoing data loads using various active and passive stages of DataStage.
- Involved in importing and exporting jobs category wise and maintaining the backup regularly
- Created Sequence jobs to define the job dependency.
- Scheduling the jobs to automate the process using Autosys.
- Defined Test cases and involved in testing process.
- Performance Tuning and participating in Unit Test.
- Involved in converting SQL scripts and procedures to data stage jobs. Extensively used SQL in DataStage jobs for processing data.
- Validation of the test cases using Quality Center tool of US Bank.
Environment: IBM Information Server DataStage and Quality Stage 8.1, Oracle 10g Oracle CC&B, Micro Strategy, Windows XP, AutoSys, UNIX, Metadata.