Sr. Datastage Developer Resume
Sacramento, CA
SUMMARY
- Over all 8 years of total experience in Extraction, Transformation and Loading (ETL) using DataStage 7.5/8.1/8.5/9.1 Parallel Extender.
- Extensive experience in IBM InfoSphere Datastage 9.1/8.7/8.5/8.0.1/7.5. x using Components like Datastage Designer, Datastage Director, Datastage Administrator, Information server and Parallel Extender. Designed Mapping documents ETL architecture documents and specifications using Visio and UML.
- Complete Software Development Life Cycle experience including requirements gathering, analysis/design, development and testing.
- Strong experience in working with Business Analyst to understand business requirements from business owners in order to transform business requirements into effective technology solutions.
- Strong experience in Data conversion from legacy source systems to new target system.
- Analyzed the Source Data and designed the source system documentation.
- Created the data mappings and conversion logic to cleanse the data.
- Experience in handling bulk volume of data to cleanse and load into target.
- RDBMS experience with Teradata, IBM DB2, Oracle 10g/9i/8i, PL/SQL.
- Implementation of ETL functionality of Data warehouse and Data migration applications.
- Extensive experience in loading high volume data, and performance tuning.
- Proficient in UNIX Scripting.
- Used Datastage 7.5.x 2/ 8.0.1/8.5/8.7/9.1 (Parallel Extender) as an ETL tool to extract data from source, transform and load into Target system.
- Experience in IBM QualityStage using Data Rules and Standardized Stages and MNS (Multinational Standardization).
- Good understanding of various Ab Initio parallelism techniques and implemented number of AbInitio Graphs using Data parallelism and Multi File System (MFS) techniques.
- Created impact analyses and data lineage reports and business lineage reports using Metadata workbench.
- Good knowledge in data warehouse concepts like Star Schema, Snow Flake, Dimension and Fact tables.
- Excellent data analysis skills.
- Having basic understanding of programming languages like C, C++, Java.
- Experience in Converting the Business Logic into Technical Specifications.
- Ability to quickly grasp new concepts, both technical and business related and utilize as needed.
- Strong knowledge in Datastage transformations and to enhance performance both in job and environment level.
- Worked in different Domains like Healthcare, Banking and Insurance.
TECHNICAL SKILLS
ETL Tools: Abinitio, Data Stage 7.5.x/ IBM Infosphere DataStage 8.0.1/8.5/8.7/9.1 , IBM QualityStage 8.5
Operating System: Windows NT/XP, Unix Sun Solaris 8/7.0, IBM AIX 4.3
Database: Oracle 9i/10g, 11g, SQL Server 2008/2012, IBM DB29.x/7.x/14.7, Teradata.
Scheduling Tools: AutoSys, Crontab Utility, Control - M, IBM Tivoli.
Language: C, Java, SQL, PL/SQL, Unix.
Modelling Tools: Visio, Erwin 7.1.2
PROFESSIONAL EXPERIENCE
Confidential, Sacramento, CA
Sr. Datastage Developer
Responsibilities:
- Responsible for all technical and system specifications documents for all ETL processes and perform unit tests on all processes and prepare required programs and scripts.
- Analyze and interpret all complex data on all target systems and analyze and provide resolutions to all data issues and coordinate with data analyst to validate all requirements.
- Monitor all business requirements and validate all designs and schedule all ETL processes and prepare documents for all data flow diagrams.
- Perform root cause analysis on all processes and resolve all production issues and validate all data and perform routine tests on databases and provide support to all ETL applications.
- Oversees basic and advanced transformation activities such as normalization, cleansing, aggregation, summarizing, and integration in complex ETL.
- Worked on agile methodology to develop, test and deploy ETL.
- Involved in analysis of source systems, business requirements and identification of business rules.
- Experience in parsing and shredding the XML messages using XML input stage.
- Data Stage job design, development & debugging to populate data to the target tables.
- Created and used different parameter sets and environmental variables in development of DataStage jobs.
- Scheduled jobs using IBM Tivoli Scheduler and used it for testing and debugging the components, and monitoring the resulting executable versions on an ad hoc or scheduled basis.
- Configured multiple nodes and used parallel engine capacity efficiently and developed master sequences to run multiple jobs in parallel.
- Facilitated use of same job to run multiple times by changing the job parameters using Multi-Instance option in source stages.
- Testing of code on local and development environment.
- Responsible for monitoring scheduled, running, completed and aborted jobs.
- Debugging the logic and other connectivity related issues with aborted jobs.
- Worked on QualityStage to verify US addresses using AVI stage.
- Worked on database connections, SQL joins, views, aggregate conditions and hierarchies.
- Responsible for performance tuning by editing SQL queries to enhance the performance of the databases.
- Involved in UAT.
Environment: IBM InfoSphere DataStage v9.1, IBM Quality Stage 9.1, Information Server suite product, IBM Tivoli Scheduler, ClearQuest, ClearCase, IBM DB2 9.7, IBM AIX 6.1.
Confidential, Dublin, OH
Sr. Datastage Developer
Responsibilities:
- Worked with business Analyst to understand business requirements in order to transform business requirements into effective technology solutions.
- Coordinating and allocating the team for Development of jobs.
- Involved in performance tuning of Jobs and Data Analysis to resolve defects with migrated data.
- Extensively worked with Job sequences using Job Activity, Email Notification, Sequencer, Wait for File activities to control and execute the Datastage Parallel jobs.
- Have addressed production, UAT issues and production issues, proper action was taken accordingly based on priority and requirement.
- Worked as Module Lead to guide the team regarding technical issues and to meet the timelines.
- Developed high level design documents for system architecture and process flow.
- Responsible for Performance Tuning SQL queries.
- Extracted data from flat files and then transformed according to the requirement and Loaded into target tables using various stages like sequential file, Look up, Aggregator, Transformer, Join, Remove Duplicates, Change capture data, Sort, Column generators, Funnel and Oracle Enterprise.
- Created Batches (DS job controls) and Sequences to control set of jobs.
- Extensively used DataStage Change Data Capture for DB2 and Teradata files and employed change capture stage in parallel jobs.
- Executed Pre and Post session commands on Source and Target database using Shell scripting.
- Collaborated with BI and BO teams to find how reports are affected by a change to the corporate data model and in designing dashboards and scorecards for Analysis and Tracking of key business metrics and goals.
- Utilized Parallelism through different partition methods to optimize performance in a large database environment.
- Developed DS jobs to populate the data into staging and Data Mart.
- Executed jobs through sequencer for better performance and easy maintenance.
- Performed the Unit testing for jobs developed to ensure that it meets the requirements.
- Developed UNIX shell scripts to automate file manipulation and data loading procedures.
- Designed and developed DataStage ETL code, perform Unit and Integration testing exercises and document the analysis, high-level design of ETL code.
- Provided on-call support and problem resolution for reporting and ETL application issues.
Environment: IBM InfoSphere DataStage 8.5, Teradata SQL Assistance 14.10, IMB DB2 9.7, IBM AIX 6.1, WinScp, Microsoft-Visio, AutoSys, Toad.
Confidential, Englewood, CO
Datastage Developer
Responsibilities:
- Developed the Complex ETL Jobs for Application and Parts module.
- Involved in Analysis, Development, Testing and ETL jobs
- Create, update and maintain ETL technical documentations and facilitate in migration efforts. Troubleshoot and resolve application issues.
- Understanding requirements as per the Client and translate to design documents.
- Responsible for UNIT, System and Integration testing.
- Involved in performance tuning of Jobs.
- Worked with Data Stage Manager for Export & Import Jobs and Importing the Metadata from repository.
- Developed various jobs to incorporated reprocessing error out records as part of error handling and reprocessing.
- Migration data stage 8.0 jobs to data stage 8.5 version, working with Data Stage Administrator to move, renames or deletes projects and deploying jobs from development to Test stage or from Test environment to Pre-Prod environment and from Pre-Prod to production.
- Used Data Stage Director for Executing, Monitoring, and Analyzing logs.
- Created Jobs to classify the data into subject areas as source jobs.
Environment: IBM InfoSphere DataStage v8.0/8.5, Oracle, SQL Server, Red Hat Linux.
Confidential
Sr. Datastage Developer
Responsibilities:
- Responsible to converting old legacy systems into one integrated environment.
- Fetched the data from legacy system and cleansed the old data and convert according to new business logic and loaded into new systems.
- Created the data mappings and conversion logic to cleanse the data.
- Worked with Business Analyst to understand business requirements from business owners in order to transform business requirements into effective technology solutions.
- Data Analysis to resolve defects with migrated data
- Work closely with Senior Architects and Developers to develop standards as well as working with ETL developers to ensure the development of re-usable objects
- Involved in Analysis, Development, Testing and Implementation of ETL jobs and loading the databases from Oracle 9i to 11g with multiple source systems.
- Development of ETL jobs to migrate bulk volume of data
- Used Administrator to administer the locks on the jobs and other Administration activities for data stage server.
- Involved in performance tuning of Jobs.
- Extensively worked with Job sequences using Job Activity, Email Notification, Sequencer, Wait for File activities to control and execute the Datastage Parallel jobs.
- Regularly did the Data Quality Checks on the source system.
- Worked closely with Development and QA to clarify the requirement issues.
- Have addressed production, UAT issues, proper action was taken accordingly based on priority and requirement.
Environment: IBM InfoSphere DataStage 8.0.1, DB2, IBM AIX 6.1, Sun Solaris 10, Mainframe, WinScp, Microsoft-Visio, Control-M.
Confidential
DataStage Developer
Responsibilities:
- Participating on Business Analysis Development Phase and Gathering Requirements.
- Working with Developer Department team for translating business requirements into Data Mart Design.
- Working with Database team for creating logical and physical Data Modeling process using Erwin and guide business group and users session.
- Taking part in planning and management of all Data Warehouse migration process.
- Involved in creating strategy for Star Schemas with Fact and Dimension Tables.
- Translating Business requirements into Data Mart design coordinating with team members Creating Fact, Dimensional and Aggregate Tables and Loading Data Warehouse tables.
- Responsible for getting the Data Dictionary, Designing and modifying the Data Stage jobs using Data Stage Designer, Created mappings based on Data Dictionary.
- Worked on Data migration from SQL Server 2005 and was responsible developing Data Stage Jobs, creating mapping for data transformation, extracting data from Oracle and Loading it into the Dimensional tables.
- Creating backups by using Data Stage Manager Exporting data stage components and packaging of projects.
- Implemented the Surrogate Key by using Key Management functionality for newly inserted rows in Data Warehouse.
- Developed Shell Scripts for taking backup and recovery of database. Performed physical and logical backup.
- Used AutoSys to schedule the Data stage ETL batch jobs on daily, weekly and monthly basis.
- Used Data Stage manager to import, create and edit the metadata.
- Used the Data Stage Administrator to assign privileges to users or users groups, move, rename or delete projects and manager or publish jobs from development to production status.
- Validated all applications and ran the jobs using Data Stage Director.
- Performed tuning of the repository and jobs for optimum performance.
- Prepared Test Plan and performed Unit Testing, System, Integration, Volume Testing.
- Extensively involved in writing Stored Procedures and calling the same through Data Stage Stored Procedure Transformation.
- Developed Server side functionality by using PL/SQL and UNIX shell programming.
- Constructed SQL Scripts to validate the data after loading process.
- Data Quality and validation using Quality Stage, Metadata capture and analysis using MetaStage.
Environment: DataStage EE 7.5,Erwin 4.1.5,SQLServer 2005,Oracle10g/9i, PL/SQL,AutoSys, TOAD, UNIX, Shell Scripting.