SUMMARY:

• Responsible for designing the data integration for the Enterprise Data Warehouse solutions which includes new development, enhancements and production support in both the operational reporting and BI/Analytic reporting areas.
• Scrutinize functional requirements, specifications and source to target mapping documents, identifying underspecified requirements and other design challenges.
• Worked on DataStage tools like Designer, Director and Administrator.
• Demonstrates in depth understanding of advanced parallel job development (parallel architecture, configuration files, stages and connectors, environment variables, parameters & routines) using best practices methodologies.
• Deep Knowledge of writing SQL Queries for Data analysis, Data quality, Data mapping specification, Data Profiling, Data Migration, Data Mining querying/Programming Skill and creating Data Dictionaries.
• Superior SQL Skills and ability to write and interpret complex SQL statements and also mentor developers on SQL Optimization.
• Extensive knowledge in tuning T - SQL (DDL and DML) Queries to improve the database performance and availability. Strong ETL & OLAP experience, coupled with hands-on expertise with various ETL tools such as Confidential Datastage, Informatica and reporting / visualization tool Tableau.
• Perform exploratory source data analysis, including ad - hoc SQL queries, to proactively find and expose data quality problems.
• Assimilate and understand the application architecture and develop ETL components that properly integrate with it. Design & develop the Data Integration framework.
• Develop code that promotes reusability, maintainability and good, scalable performance.
• Support application development through system testing and user acceptance testing, bridging the gap between business rules and technical implementation when necessary,
• Experience using advanced performance monitoring/debugging techniques using data set management tools, environmental variables and job monitoring is required.
• Strong Skills in Relational Database including database design & expert advanced SQL writing.
• Experience and very comfortable working in a fast - paced Agile development methodology in a data warehouse environment.

TECHNICAL SKILLS:

ETL Tools: Confidential Websphere DataStage 8.1/8.5/8.7/9.1/11.3 Teradata Bteq, Fast load, Mload,, Talend Open Studio 5.5, Ascential DataStage 7.5.2 (Designer, Director, Administrator, Manager),Informatica 6.1 / 8Design Tools: Erwin 9.3, MS - Visio 2007

OLAP Tools: Tableau, Cognos

Databases /: File systemTeradata 14/V2R6/V2R5, Oracle 12c/11g/10g/9i, SQL Server 2000/2005/2008, DB2,: MySQL

Languages: C, C++, Java, UNIX Shell Scripting SQL, PL/SQL

Version Control: VSS, PVCS

Other Tools: Teradata View Point, Teradata Sql Assistant, XML files, Icescrum, JIRA, SUCCEED, Control - M, Autosys, GitHub, TOAD, SQL Developer, Microsoft Office

PROFESSIONAL EXPERIENCE:

Confidential, Montvale, NJ

ETL DataStage/Talend Developer Data Analyst

Responsibilities:

• Used Agile Methodology for all phases of project.
• Analyzed the existing ETL process and came up with an ETL design document that listed the jobs to load, the logic to load and the frequency of load of all the tables.
• Consolidated data from multiple sources into central data warehouse environment using Talend as an ETL and as database.
• Worked on ETL migration from DataStage to Talend Open Studio 5.5 projects, handled various issues while code migration.
• Created Talend jobs to load data into various MySQL and PostgreSQL tables.
• Designing the ETL jobs using DataStage tool to load data from multiple source system to Teradata Database and Parallel jobs to load the data into the Target Schema.
• Testing the Jobs and preparing the Unit Test Cases & helped Business for User Acceptance test.
• Converted complex job designs to different job segments and executed through job sequencer for better performance and easy maintenance.
• Extensively worked on Data Acquisition and Data Integration of the source data.
• Design Technical specifications and Mapping documents with Transformation rules.
• Defined environment variables and tuned parameters for fine - tuning of ETL jobs.
• Prepared wrapper scripts for database connectivity and executing queries in parallel job execution.
• Used the ETL DataStage Director to schedule, running the solution, testing and debugging its components & monitor the resulting executable versions.
• Involved in Production deployment of ETL components - jobs, wrapper scripts, database changes through standard CCMDB and succeed request.
• Reading XML data, parsing XML data and writing into XML file using XML input and XML output stages.
• Writing XML data into both Database and also into MQ connector.
• Fixed issues and implemented requested changed during warranty support period.
• Worked with the Application Development team to implement data strategies, build data flows and develop conceptual data models.
• Created logical and physical data models using best practices to ensure high data quality and reduced redundancy.
• Performed reverse engineering of physical data models from databases and SQL scripts.
• Data dictionary documentation for entire tables present in SWY and Unica Campaign database.

Environment: Confidential Info Sphere Information Server DataStage, PostgreSQL, MySQL, Teradata, Oracle, UNIX Shell Scripting, Windows XP, SAP Power Designer, Tableau, MicroStrategy, SUCCEED, Confidential Unica - Campaign Management tool

ETL - DataStage Developer / Data Analyst

Responsibilities:

• Interacted with the users extensively and gathered the requirements, and analysed the needs of the end users.
• Designed and developed exception handling and data cleansing / standardization procedures.
• Prepared the technical documents for ETLs & preparing the Unit Test Cases.
• Performed User Acceptance test & analysing the Data and Defect fixing.
• Prepared the Technical Design documentation for every DataStage module completed.
• Compared the results from the existing process and the DataStage process by JCLs, File Aid. Optimizing DataStage jobs performance.
• Defined and document ETL process flow, restart ability and scheduling capabilities.
• Created/ customized wrapper scripts in UNIX.
• Developed and managed the BI dependency plan, job scheduling and cycle management it includes Control - M Jobs.
• Responsible development, testing & implementation of this project

Environment: DataStage 8.7, Shell Scripting, Retek6.6, ORACLE 10g, Oracle Financials - Account Payable module, Pl/SQL Control - M, CHAMP (A Change Mgt. Tools)

ETl DataStage Developer / Data Analyst

ETL Responsibilities:

• Identified business needs, evaluated business and technical alternatives, recommended solutions and participated in their implementation.
• Preparation of functional and technical documents.
• Used DataStage Designer to create the table definitions for the Databases and flat files, import the table definitions into the repository, import and export the jobs, release and package the jobs.
• Developed ETL processes to extract the source data and load it into the data mart after cleansing, transforming and integrating.
• Involved in comparing source legacy data, the transformation to XML, and the target production of policy statements.
• Created source to target mapping and job design documents.
• Used Unix wrapper Script to automate DataStage jobs.
• Developed job sequences to execute a set of jobs with restart ability, check points and implemented proper failure actions.
• Management of the Metadata import/export process using istool and XML based product capabilities.
• Used DataStage Director and its run - time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad-hoc or scheduled basis).
• Worked on troubleshooting, performance tuning, performance monitoring and enhancement of DataStage jobs
• Wrote several complex SQL queries to extensively test the ETL process.
• Worked with ETL admin, UNIX admin, DBA etc. while code migration from lower environment to upper environment.
• Performed unit testing and system integration testing in Dev, QA and UAT environments.
• Worked with control - M team for setting up production job cycles for with proper dependencies.
• Provided warranty production support and performed enhancement on existing project.

Additional responsibility:

• Co - ordination with Acxiom vendor.
• Various development of code using shell script to encrypt and transfer the files to Acxiom Server.
• Audit process development for existing data transfer process using shell script.

Environment: MicroStrategy 8.2, DataStage 8.7, XML Data, Netezza, ORACLE 10g, Control - M, CHAMP (A Change Mgt. Tools)

DataStage / Data Analyst

Responsibilities:

• Developed ETL technical architecture.
• Involved in Data Analysis, Conceptual Design and Physical Design.
• Defined and implemented the required business transformation rules and logic (ETL development).
• Prepared DDL scripts for the DB objects.
• Created/ customized wrapper scripts in UNIX.
• Designed and developed exception handling and data cleansing / standardization procedures.
• Identified and managed data quality issues.
• Optimized DataStage jobs performance.
• Defined a suitable architecture for data integration from multiple, data sources.
• Defined and document ETL process flow, restart ability and scheduling capabilities.
• Defined Table Partitioning, Index to improve performance.
• Estimated system capacity to meet near and long–term processing requirements.
• Developed and managed the BI dependency plan, job scheduling and cycle management it includes Control–M Jobs.
• User training and documentation.

Environment: ORACLE 10g, DB2, Control–M, Erwin, HPSD

DataStage Architect/Data Analyst

Responsibilities:

• Collected the requirements from Business and developed the logical and physical specifications.
• Involved in the entire life cycle like - design, developing, testing, UAT, deployment and warranty support.
• Performed reverse engineering of physical data models from databases and SQL scripts.
• Used DataStage Designer to develop Parallel Jobs (Orchestrate environment) for Extracting, Cleansing, Transforming, Integrating and Loading data into Oracle database.
• Created Various Parallel Jobs Utilizing Different Partitioning techniques running on Multiple nodes.
• Used debugging stages like Peek, head and tail for developing and testing the jobs.
• Join stage, Modify stage, Funnel stage, Lookup stage, Transformer stage, Merge stages are used for validating and transforming the data.
• Designing and developing exception handling and data cleansing / standardization procedures.
• Created Parallel Shared Containers for Re–usability of common jobs.
• Used Before/After Job–Subroutines in Job Properties. Defined Constraints and Stage Variables for implementing the business logic.
• Developed Shell Scripts for automation, for file validation and for data loading procedures.
• Performed tuning of DataStage jobs to improve performance.
• Used Data Stage Manager for Importing and exporting jobs.
• DataStage Director is used to validate, monitor, schedule and execute the jobs.
• Performed End – End Testing and documented all the Changes.
• Estimate system capacity to meet near and long–term processing requirements.
• Develop and manage the BI dependency plan, job scheduling and cycle management it includes creating Run–sheet Historical load of 1200+ Billion of records into Target tables.
• Ensure execution of archival and restore strategy.
• User training and documentation.

Environment: Confidential Websphere DataStage 8.1/7.5, Oracle 10G/9i, Erwin, Business Objects XIR2, Toad, PL/SQL, Windows 2000, Linux, Runsheet

PL/SQL Developer

Responsibilities:

• Identified sensitive data elements that need to be obfuscated.
• Responsible for developing and testing Oracle Stored Procedures, Functions and Packages.
• Involved in tuning queries in Oracle SQL and PL/SQL.
• Responsible for multiple database code releases.
• Involved in Production Release and warranty Support.
• Involved in fine tuning, trouble shooting, bug fixing, defect analysis and enhancement of the multiple admin systems DataStage jobs.

Environment: Oracle 9i, Windows XP, UNIX