Team Lead Project Resume
New Jersey, NA
SUMMARY
- Extensive experience in Information Technology with special emphasis on Design and Development of Data Warehouse ETL applications in banking domain for high volume Data Warehousing projects using ETL methodologies using AbInitio as loading tool and Hive as database.
- Experience in all the phases of Data Warehouse life cycle involving Requirement Gathering, Analysis & Design, Development and Testing to build Data Warehouse.
- Extensive programming skills in ETL tool - AbInitio, Oracle, Unix Shell scripting and ETL Process Automation.
- Worked extensively on Continuous Flows, Batch graphs, conditional components and Conduct-IT Plans.
- Responsible for defining the complete data warehouse architecture (i.e. DW, ETL process, Data Marts) and classify the key business drivers for the data warehouse initiative.
- Collaborating with business users to define the key business requirements and translate them into process/technical solutions.
- Experience with AbInitio Co-Operating System, application tuning, and debugging strategies.
- Good Knowledge on AWS RedShift.
- Facilitates the adoption of the ETL best practices within the organization, including Data integration and evolution of development methodology.
- Used Metadata Importer for importing Metadata from an EME Technical Repository and other databases (Oracle, Teradata, DB2 etc.).
- Solid experience in Ralph Kimball/Inmon Methodologies, Logical/Physical Modeling, Dimensional modeling, Star Schema, FACT tables and Dimension tables.
- Used phases and checkpoints in the graphs to avoid the deadlocks, improve the performance and recover the graphs from the last successful checkpoint.
- Responsible for defining the testing procedures, test plans, error handling strategy and performance tuning for mappings, Jobs and interfaces.
- Experience in providing production support to various AbInitio ETL jobs and developing various UNIX shell wrappers to run AbInitio and Data base jobs.
- Developed various UNIX shell scripts to run AbInitio and Data base jobs. Good experience working with very large databases and Performance tuning.
- Worked on Big Data Hadoop framework using Hadoop HDFS, Hive for large scale structured and unstructured data processing, loading & Data Analytics and very much comfortable to execute POC/projects if situation demands.
- Worked with Teradata team to pull the data from the Enterprise warehouse to generate the end user reports.
- Excellent problem solving, debugging, performance tuning skills.
TECHNICAL SKILLS
ETL Tools: AbInitio, Informatica
Big Data: Hive
Programming: Unix shell scripting, SQL, PL/SQL
RDBMS: Oracle, Teradata
Development Tools: Toad, SQL Developer
PROFESSIONAL EXPERIENCE
Team Lead Project
Confidential
Environment: -AbInitio GDE-3.2.1.2, Co>op:3.1.5, Metadata Hub, Oracle Database 11g, Unix Shell Scripting
Responsibilities:
- Responsible for defining the complete data warehouse architecture (i.e. ETL process, Data Marts) and classify the key business drivers for the data warehouse initiative.
- Collaborating with business users to define the key business requirements and translate them into process/technical solutions.
- Implemented various levels of parameter definition like project parameters and graph parameters instead of start and end scripts.
- Loading Metadata Hub customizations.
- Importing the EME Datasets and EME Graph Imports for building the Data Lineage.
- Importing the EME Datasets and Data Profiler results from EME to Technical Repository to show up the results in the Metadata portal.
- Generating Metadata Reports and auditing.
- Implemented Transform Components such as Aggregate, Dedup Sorted, Filter by Expression, Join, Normalize, Reformat, Rollup and Scan Components and created appropriate XFRs and DMLs.
- Involved in Unix Korn shell wrapper scripts to accept parameters and scheduled the processes using Crontab, Job Scheduler and Database Load Interface.
- Implemented the Hadoop-Hive database instead of Oracle. Was involved in configuring Hive with AbInitio.
- Responsible for defining the testing procedures, test plans, error handling strategy and performance tuning for mappings, Jobs and interfaces.
- Performing code reviews for ETL mappings from a performance & Error handling perspective.
- Setting up Scheduling mechanism and appropriate tool selections based on project requirements.
- Handled Deployments and Migration of the Code to Prod/Test regions.
Team Lead Project
Confidential, New Jersey, NA
Responsibilities:
- Prepared Design Document as per the HLD, MDD provided.
- Interacted with Business team to troubleshoot the queries in requirements.
- Built graphs by using various Dataset and Program components.
- Developing Common/Generic Graphs to minimize the Number of Independent Jobs running on PROD Box.
- Developed wrapper Scripts wherever necessary.
- Created AutoSys job stream to schedule jobs by creating box jobs and jil templates.
- Performed Unit Testing and migrated the code to UAT and Production environment.
- Interacted with Business team and partner systems during UAT period.
- Worked with Business Analysts to define testing requirements to satisfy the business objectives.
- Responsible for creating complete test cases, test plans, test data, and reporting status ensuring accurate coverage of requirements and business processes.
- Performed Integration, End-to-End, system testing.
- Involving in Functional Testing & Regression Testing
- Involving in writing complex SQL queries for data validation from Source to Target.
- Working on Tollgates and STE reviews for Approval before migrating the Code.
Team Lead Project
Confidential, New Jersey, NA
Environment: - AbInitio GDE - 3.2.1.2, Co>op: 3.1.5, Oracle Database 11g, Unix Shell Scripting
Responsibilities:
- Developed shell scripts to automate file manipulation and data loading.
- Used Transform Components Aggregator, Join, Reformat, Rollup and Scan Components to implement the business logic.
- Implemented various levels of parameter definition like project parameters and graph.
- Collaborating with business users to define the key business requirements and translate them into process/technical solutions
- Involved in writing wrapper scripts to run the graphs, to load into Data Warehouse and to verify the counts while loading.
- Created Auto Sys job stream to schedule jobs by creating box jobs and jil templates.
- Assisted in developing various reports using PL/SQL Stored Procedures.
- Performing code reviews for ETL mappings from a performance & Error handling perspective.
Senior Consultant Project
Confidential, New Jersey, NA
Environment: - AbInitio GDE - 3.1.5, Co>op: 3.1.5, Oracle Database 11g, Unix Shell Scripting
Responsibilities:
- Prepared Design Document as per the MDD provided
- Interacted with Business team to troubleshoot the queries in requirements
- Built graphs by using various Dataset and Program components
- Developing Common/Generic Graphs to minimize the Number of Independent Jobs running on PROD Box
- Developed wrapper Scripts wherever necessary
- Working on Tollgates and STE reviews for Approval before migrating the Code
- Performed Unit Testing and migrated the code to UAT and Production environment
- Interacted with Business team during UAT period
Senior Consultant Project
Confidential, New Jersey, NA
Environment: - AbInitio GDE - 2.14, Co>op: 2.15, Oracle Database 11g, Unix Shell Scripting
Responsibilities:
- Worked with Business Analysts to define testing requirements to satisfy the business objectives.
- Responsible for creating complete test cases, test plans, test data, and reporting status ensuring accurate coverage of requirements and business processes.
- Performed Integration, End-to-End, system testing.
- Used to run the test cases for the end to end process in that data warehouse
- Analyzing requirements and creating and executing test cases
- Working on Tollgates and STE reviews for Approval before migrating the Code
- Involving in Functional Testing & Regression Testing
- Involving in writing complex SQL queries to verify data from Source to Target
- Performed data validation testing writing SQL queries.
- Used Quality Center for creating and documenting Test Plans and Test Cases and register the expected results.
Senior Consultant Project
Confidential, New Jersey, NA
Environment: - AbInitio GDE - 2.14, Co>op: 2.15, Oracle Database 11g, Unix Shell Scripting
Responsibilities:
- Worked with Business Analysts to define testing requirements to satisfy the business objectives.
- Responsible for creating complete test cases, test plans, test data, and reporting status ensuring accurate coverage of requirements and business processes.
- Performed Integration, End-to-End, system testing.
- Used to run the test cases for the end to end process in that data warehouse
- Analyzing requirements and creating and executing test cases
- Working on Tollgates and STE reviews for Approval before migrating the Code
- Involving in Functional Testing & Regression Testing
- Involving in writing complex SQL queries to verify data from Source to Target
- Performed data validation testing writing SQL queries.
- Used Quality Center for creating and documenting Test Plans and Test Cases and register the expected results.
