OBJECTIVE

Working as a highly competent SeniorSoftware Engineer/SeniorDataStage Develper with HSBC Software Development for around 9 years in Design, Developmentand Implementation of various database and data warehouse technologies IBM DataStage v 8.X/7.X and Informatica using components like Administrator, Manager, Designer and Director. Good experience in writing complex SQL queries and PL/SQL, including the use of stored procedures, functions and triggers to implement business rules and validations in the situation of Microsoft SQL, Oracle 11g/10g/9i and DB2.

Summary:

• Involved in complete Software Development life-cycle SDLC of various projects, including requirements gathering, system designing, data modeling, ETL development, production enhancement, support and maintenance.
• Experience in resolving Data Transformation, Cleansing and Capturing rejects and Exception and Error reporting.
• Created local and shared containers to facilitate ease and reuse of jobs.
• Generated Surrogate IDs for the dimensions in the fact table for indexed and faster access of data in server jobs.
• Knowledge in using PL/SQL to write stored procedures, functions, and triggers.
• Good experience in scheduling Jobs using AutoSys, Tivoli,Zeke,Controlm and Corntab.
• Imported the required Metadata from heterogeneous sources at the project level.
• Experience in integration of various data sources like Teradata, Oracle, DB2, SQL Server, MS Access, Sybase, Informix, MS Excel and Flat files into the Staging Area. Extensively worked with materialized views and TOAD.
• Developed parallel jobs using different processing stages like Transformer, Aggregator, Lookup, Join, Sort, Copy, Merge, Funnel, CDC, Change Apply and Filter, File stages and Database stages.
• Extensively worked on performance tuning and backup on databases like Oracle 10g/9i/8i.
• Experienced in scheduling sequence, parallel and server jobs using DataStage Director, UNIX scripts and scheduling tools.
• Experience includes working in various functionalities like Finance Supply chain management, Healthcare, Insurance and Retail.
• Experience with Star and Snowflake Schema, Data Modeling, Fact and Dimensional Tables and Slowly Changing Dimensions.
• Expertise in writingUNIX shell scripting C, Bourne, Korn and Bash shell , on AIX, HP, Sun OS, RHEL and C, C ,Perl a.
• Good knowledge on reporting tools like, Business Objects, Cognos 7 and Hyperion Essbase.
• Good experience in Transforming Business specific rules into functional Specs.
• Experience in Production Support, extensively worked on production support issues and resolved them using session logs, workflow logs, and used e-mail task for capturing issues via e-mail along with the session logs.
• Working experience in interacting with business analysts and developers to analyze the user requirements, functional specifications and system specifications.
• Ability to work autonomously and also as part of a team under tight deadlines so as to meet any project expectations.

Technical Skills:

Professional Experience:

Confidential

Role: Sr. SoftwareEngineer

Responsibilities:

• Designed the ETL jobs using IBM Infosphere DataStage 8.5 to Extract, Transform and load the data into staging, ODS and EDW.
• Designed and developed the ETL jobs using Parallel Edition which distributed the incoming data concurrently across all the processors, to achieve the best performance.
• Designed parallel jobs using stages such as Join, Merge, Lookup, Remove Duplicates, Copy, Filter, Funnel, Dataset, Lookup, Pivot, and Sort, Surrogate key Generator, Change Data Capture CDC , Modify, Row Generator and Aggregator.
• Responsible for generation of DDL statements, which are executed, for database creation.
• Responsible for preparing Physical/logical data models.
• Responsible for data analysis, requirements gathering, report analysis, source-to-target mapping, frequency analysis, process flow diagrams, and documentation.
• Handled Performance Tuning of Jobs to ensure faster Data Loads.
• Designed sequence jobs using the activities such as Job Activity, Nested Condition, Notification Activity, Sequencer Activity, Terminator Activity and Execute Command.
• Performed the Integration and System testing on the ETL jobs.
• Responsible for preparing ad hoc jobs.
• Translated business rules and functionality requirements into ETL derivations.
• Scheduled jobs using Autosys scheduler utility based on the requirements and monitored the production processes closely for any possible errors.
• Migrated projects from development to QA to Production environments.
• Assisted operation support team for transactional data loads in developing SQL UNIX scripts.
• Imported the required Metadata from heterogeneous sources at the process level.
• Created Job Parameters and Environmentvariables to run the same job for different sources and targets.
• Used Multi-job-compiler during deployment of projects.
• Created Batches DS job controls and Sequences to control set of jobs.
• Used the Director to schedule running the job, testing and debugging its components, and monitoring.
• Collaborated with BO team to design Crystal reporting and reports for enterprise reporting applications.
• Created Shared Containers for Re-using the Business functionality.
• Worked with Developers to troubleshootand resolve issues in job logic as well as performance.

Environment:

IBM WebSphere DataStage 8.5 Administrator, Designer, Director , IBM Information Analyzer 8.1.1a, Microsoft SQL 2005/2008, IBM DB2 9.1, AIX6.0, Oracle 11g, Toad 9.5, Java, MS-Access, shell scripts, PUTTY, WinSCP, ERwin R8.1, Mercury Quality Center, MKS, Control m.

Confidential

Role:Senior Software Engineer/ Senior DataStage Developer

Responsibilities:

• Extensively used DataStage for extracting, transforming and loading databases from sources including Oracle,DB2 and Flat files.
• Collaborated with EDW team in, High Level design documents for extract, transform, validate and load ETL process data dictionaries, Metadata descriptions, file layouts and flow diagrams.
• Collaborated with EDW team in, Low Level design document for mapping the files from source to target and implementing business logic.
• Generation of Surrogate Keys for the dimensions and fact tables for indexing and faster access of data in Data Warehouse.
• Tuned transformations and jobs for Performance Enhancement.
• Extracted data from flat files and then transformed according to the requirement and Loaded into target tables using various stages like sequential file, Look up, Aggregator, Transformer, Join, Remove Duplicates, Change capture data, Sort, Column generators, Funnel and Oracle Enterprise.
• Created Batches DS job controls and Sequences to control set of jobs.
• Extensively used DataStage Change Data Capture for DB2 and Oracle files and employed change capture stage in parallel jobs.
• Executed Pre and Post session commands on Source and Target database using Shell scripting.
• Collaborated in design testing using HP Quality Center.
• Utilized Parallelism through different partition methods to optimize performance in a large database environment.
• Executed jobs through sequencer for better performance and easy maintenance.
• Developed DS jobs to populate the data into staging and Data Mart.
• Performed the Unit testing for jobs developed to ensure that it meets the requirements.
• Developed UNIX shell scripts to automate file manipulation and data loading procedures.
• Scheduled the jobs using Control M.
• Responsible for daily verification that all scripts, downloads, and file copies were executed as planned, troubleshooting any steps that failed, and providing both immediate and long-term problem resolution.
• Provided technical assistance and support to IT analysts and business community.
• Involved in code migration and packaging using MKS tool.

Environment:

IBM WebSphereDataStage and QulalityStage 8.0.1a Administrator, Designer, Director , IBM Information Analyzer8.0.1a, Oracle 11g, Toad 9.5, Java, MS Access, SAP BW, SAP MDM, AS/400, shell scripts, PUTTY, WinSCP, ERWIN 4.0, HP Quality Center, ontrl M, IBM MKS.

Confidential

Role: Software Engineer

Responsibilities:

• Prepared Tech specs to design the Jobs according to the requirement Specification.
• Extracting the Source Files, Oracle tables to Data Stage Environment.
• Design of the Data Stage Jobs according to the User requirement.
• Building, Testing the Data Stage Jobs.
• Tuned transformations and jobs for Performance Enhancement.
• Extracted data from flat files and then transformed according to the requirement and Loaded into target tables using various stages like sequential file, Look up, Aggregator, Transformer, Join, Remove Duplicates, Change capture data, Sort, Column generators, Funnel and Oracle Enterprise.
• Created Batches DS job controls and Sequences to control set of jobs.
• Executed Pre and Post session commands on Source and Target database using Shell scripting.
• Extensively used DataStage Change Data Capture for DB2 and Oracle files and employed change capture stage in parallel jobs.
• Collaborated in design testing using HP Quality Center.
• Utilized Parallelism through different partition methods to optimize performance in a large database environment.
• Developed DS jobs to populate the data into staging and Data Mart.
• Executed jobs through sequencer for better performance and easy maintenance.
• Performed the Unit testing for jobs developed to ensure that it meets the requirements.
• Scheduled the jobs using Control M.
• Responsible for daily verification that all scripts, downloads, and file copies were executed as planned, troubleshooting any steps that failed, and providing both immediate and technical long-term problem resolution.
• Involved in Unit Testing, System Integration Testing.
• Uploaded Test Cases in QC.

Environment:

IBM WebSphere DataStage Enterprise Edition 7.5.2, DataStage Server Edition 7.5, ProfileStage 7.5, IBM DB2, Teradata, Toad 8.0, Microsoft SQL 2005, IBM 2094 - System z9, AIX,WinSCP FTP , Putty, Windows 2003 , Mercury Center.

Confidential

Role:Software Engineer/Trainee Software Engineer

Responsibilities:

• Worked on DataStageDesigner, Manager, Administrator and Director.
• Worked with the Business analysts and the DBAs for requirements gathering, analysis, testing, and metrics and project coordination.
• Involved in extracting the data from different data sources like Oracle and flat files.
• Involved in creating and maintaining Sequencer and Batch jobs.
• Creating ETL Job flow design.
• Used ETL to load data into the Oracle warehouse.
• Created various standard/reusable jobs in DataStage using various active and passive stageslike Sort, Lookup, Filter, Join, Transformer, aggregator, Change Capture Data, Sequential file, DataSets.
• Involved in development of Job Sequencing using the Sequencer.
• Performing unit testing and integration.
• Used Remove Duplicates stage to remove the duplicates in the data.
• Taking the regular backups of the jobs using Data Stage Export/Import utility.
• Used designer and director to schedules and monitor jobs and to collect the performance statistics.
• Extensively worked with database objects including tables, views, indexes, schemas, PL/SQL packages, stored procedures, functions, and triggers.
• Creating local and shared containers to facilitate ease and reuse of jobs.
• Implemented the underlying logic for Slowly Changing Dimensions.
• Executed Pre and Post session commands on Source and Target database using Shell scripting.
• Worked with Developers to troubleshootand resolve issues in job logic as well as performance.
• Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.

Environment:

DataStage Enterprise Edition 7.5.2/7.1 Parallel Extender, ProfileStage, MetaStage, DB2 UDB 8.0, Oracle 10g, Sybase, AIX, PL/SQL, Business Objects 6.5, OLAP, ERwin5.5, SQL plus, SQL Loader, Sun Solaris 8.0.

Confidential

Role:Software Engineer/Trainee Software Engineer

Responsibilities:

• Worked on InformaticaDesigner, Manager, Administrator and Director.
• Worked with the Business analysts and the DBAs for requirements gathering, analysis, testing, and metrics and project coordination.
• Involved in extracting the data from different data sources like Oracle and flat files.
• Creating ETL Job flow design.
• Used ETL to load data into the Oracle warehouse.
• Performing unit testing and integration.
• Extensively worked with database objects including tables, views, indexes, schemas, PL/SQL packages, stored procedures, functions, and triggers.
• Executed Pre and Post session commands on Source and Target database using Shell scripting.
• Worked with Developers to troubleshootand resolve issues in mapping logic as well as performance.
• Documented ETL test plans, test cases, test scripts, and validations based on design specifications for unit testing, system testing, functional testing, prepared test data for testing, error handling and analysis.

Environment:

Informatica,Oracle 10g, DB2, AIX, PL/SQL, Cognos, ERwin5.5, True Comp,Control m.