Etl And Greenplum Developer/technical Lead Resume
4.00/5 (Submit Your Rating)
OBJECTIVE
- To pursue a challenging career as a Data Warehousing Specialist and to contribute in the design, development and maintenance of high quality Decision Support Systems, that can deliver data and reports in an “easy & efficient” way to understand the Client Business requirements. A good team player with excellent skill and communication to work in a team and individual environment
SUMMARY
- Over 7 years of experience in development of ETL Procedures and data warehouse with expertise on Greenplum, Microsoft SQL Server, Sybase and Informatica 8.11/8.6.1/9.1.
- Currently working as Technical Lead in Confidential and working as Data warehousing Specialist at client site DTCC (The Depository Trust and Clearing Corporation, Jersey City, NJ ) for Greenplum implementation of the Enterprise risk Management System(ERM).
- Leading a 12 member ETL Team for the ERM Data warehouse implementation.
- Worked as Technical Analyst at Confidential Chennai leading a team of 5 members for the Greenplum implementation of the Global Trade Repository(GTR).
- Worked as Informatica developer in Confidential for the Enterprise Data Warehouse for Confidential
- Worked as ETL lead at Confidential to build the ETL platform for the Fraud Detection Management system for Confidential
- Worked as Senior ETL developer for the Centre of excellence at Confidential servicing multiple clients for Informatica, Greenplum and Microsoft SQL server implementation.
- Worked as Technical analyst at Confidential for development of Fees due Reporting for the Confidential
- Working on implementing DWH solution on GreenPlum database (MPP architecture) hosted on VM’s for Confidential Inc, one of leading organization in virtualization.
- Development of mappings, sessions and workflows for relational, application and flat file sources and targets.
- Extensive use of various ETL transformations like Router, Filter, Joiner, Aggregator, Lookup, Update Strategy, Sequence Generator, Sorter and Stored procedure.
- Worked on ETL designs and data modelling using Erwin data modeler.
- Performance tuning for mapping and executing/scheduling workflows using workflow manager and workflow monitor.
- Strong experience in writing SQL, PL SQL, Postgre SQL procedures, functions and packages.
- Prepared the test case for the mapping testing and prepared the naming tag document.
- Development of Job Information Language Scripts (JIL) in Autosys for Scheduling Jobs.
- Innovative in Approach, Enjoy learning new methods and ideas and putting them into daily practice.
- Development of Unix wrapper and shell scripts to assist the scheduling of jobs
- Development of YAML( Control files) for extraction of data from files using GPload utility of the Greenplum appliance.
TECHNICAL SKILLS
Database: GreenPlum, Microsoft SQL Server,Sybase
Languages: SQL, PL/SQL, Postgresql
ETL Tools: Informatica 8.x,9.x
Database Tools: Toad, Embercadero, PGadmin III, Rapid SQL
Operating Systems: Windows, Unix
PROFESSIONAL EXPERIENCE
Confidential
ETL and GreenPlum developer/Technical Lead
Responsibilities:
- Involved in migration of data from Sybase to Green Plum.
- Work with customers in gathering business requirements for data migration needs.
- Work across multiple functional projects to understand data usage and implications for data migration.
- Assist in designing, planning and managing the data migration process.
- Work with subject matter experts and project team to identify, define, collate, document and communicate the data migration requirements.
- Test ETL and reports of others for quality assurance, and migrating releases into testing and production environments.
- Provides conceptual guidance to other senior and high - level technical experts.
- Prepare data migration plans including migration risk, milestones, quality and business sign-off details.
- Manage assigned risks and monitor potential impacts as part of the data migration plan.
- Develop best practice, processes, and standards for effectively carrying out data migration activities.
- Perform source system data analysis in order to manage source to target data mapping.
- Support the UB Data Warehouse batch cycle and any required changes to the schedule.
- Contribute to peer code reviews for all ETL changes.
- Perform data migration audit, reconciliation and exception reporting.
- Actively involved in production support. Implemented fixes/solutions to issues/tickets raised by user community.
- Prepare Mapping Document, Technical Specification Document.
- As a Lead, provide assistance or training to lower level staff.
- Managing 12 members in the team and coordinating their work and resolving technical issues raised.
- Used JIRA to handle process and project management.
Confidential
Data Architect/ETL Lead
Responsibilities:
- Creation of multiple functions, external tables, GPLOAD YAML files and procedures in postgresql.
- Unix scripting for Autosys Job scheduling, Creating of postgresql scripts, functions and DDLs.
- Creation of Informatica Mappings, Sessions and Workflows .
- Handling report mapping and consistency to the Technical Specification.
- Creation of GP reporting queries.
- Development of GP objects.
- Creation of BRD, High level document, Low level technical design and mapping document.
- Data Management Tasks
- Performance tuning tasks.
- Involved in migration of data from ORACLE and SYBASE to Green Plum.
- Work with customers in gathering business requirements for data migration needs.
- Work across multiple functional projects to understand data usage and implications for data migration.
- Assist in designing, planning and managing the data migration process.
- Work with subject matter experts and project team to identify, define, collate, document and communicate the data migration requirements.
- Prepare test cases for the Testing teams on different possible failure scenarios.
- Prepare data migration plans including migration risk, milestones, quality and business sign-off details.
- Manage assigned risks and monitor potential impacts as part of the data migration plan.
- Develop best practice, processes, and standards for effectively carrying out data migration activities.
- Perform source system data analysis in order to manage source to target data mapping.
- Support the UB Data Warehouse batch cycle and any required changes to the schedule.
- Perform data migration audit, reconciliation and exception reporting.
- Actively involved in production support. Implemented fixes/solutions to issues/tickets raised by user community.
- As a Lead, Manage, provide assistance or training to lower level staff.
- Managing 5 members in the team and coordinating their work and resolving technical issues raised.
- Used JIRA to handle process and project management.
Confidential
ETL Lead
Responsibilities:
- Worked as a Lead in Understanding the business requirement specifications provided by the client and translate them into ETL design specification, and create mappings, sessions and workflows.
- Performed extensive research in drill down of postgresql query in Greenplum using PGADMIN 3.
- Performed extensive data analysis along with subject matter experts and identified source data and implemented data cleansing strategy using Informatica Analyst.
- Gathered the requirement/s through MDR tool (Metadata Repository).
- Involved in Estimation of the project.
- Follow up with the business users (for UAT), architects (for design) and any other stakeholders necessary
- Risk Management (Analyze the risk and have Mitigation plan).
- Planning daily activities to meet the Project timelines and Quality Management.
- Involved in debugging the UNIX scripts according to the requirement.
- Weekly Status Reporting to the Client.
- Daily status tracking of the project.
- Developed mappings between source and target tables.
- Conducting code review sessions.
- Involved in Unit testing and integration testing.
- Preparing the LLD and carrying out impact analysis.
- Actively involved in production support. Implemented fixes/solutions to issues/tickets raised by user community.
- Prepare RCA for the Non-Compliance raised by the Quality facilitator.
- Monitoring the resource performance and come up with the training plan for the team members.
- Task Assignment to the offshore team and responsible for updating daily status to the offshore team.
- Provide in depth presentations to Business users on the end design and data model.
Confidential
Greenplum Developer/Lead ETL developer
Responsibilities:
- Understand the business requirement specifications provided by the client and translate them into ETL design specification, and create mappings, sessions and workflows.
- Involved in Data Extraction from Oracle, Flat files, SQL Server files using Informatica.
- Primary Coder of Postgresql functions in Greenplum and scripting for job scheduling in UNIX
- Developed various function and mappings to load data from various sources (SQL Server, flat files, oracle) using different transformations like source qualifier, joiner, Aggregator, Lookup, Router, Update Strategy, filter and Expression to store the data in different target tables.
- As a lead member of ETL Team, responsible for analyzing, designing and developing ETL strategies and processes, writing ETL specifications for Greenplum developers, ETL and Informatica development, testing and mentoring.
- Involved in debugging the UNIX scripts according to the requirement.
- Involved in performance tuning of the Greenplum Code for faster performance required for reporting.
- Thorough understanding of the Greenplum architecture and Data management.
- Developed mappings between source and target tables.
- Conducting code review sessions.
- Involved in Unit testing and integration testing.
- Preparing the LLD and carrying out impact analysis.
- Regular Communicating with the onsite team to get the requirements.
Confidential
Greenplum Developer
Responsibilities:
- Worked on the source extracts as required for business on the source system.
- Worked on the shell scripts to extract the data from the source system and load them accordingly.
- Worked extensively on the analysis of the data and transforming according to the business logic.
- Worked extensively on the postgresql language on the Greenplum server.
- Extensive experience in the ETL methodologies and implementation of SCD 1 and SCD 2 in the postgresql functions and Informatica mappings.
- Involved in developing functions and mappings according to the business requirements received from the Strategic Business analysis team.
- Worked extensively on Greenplum to analyze the data.
- As a Developer of ETL Team, responsible for analyzing, designing and developing ETL strategies and processes, ETL postgresql and Informatica development, testing and mentoring.
- Participated in technical walkthroughs/ code reviews of other team member’s components, test plans and results and help them with gaps.
- Extensively worked on tuning of postgresql code, defect analysis and debugging.
- Creation of Mapping Document and BRD review.