Etl And Big Data Testing Lead Resume
SUMMARY
- 9 years of IT professional experience in analysis, design, development and testing of enterprise grade applications.
- 8 years of strong SQL scripting and ETL workflow testing experience in both RDBMS and Big Data environment.
- Worked on ETL data validation developed using Informatica /SSIS/ Pentaho Data Integration (PDI) ETL environments
- Strong data validation experience in Hadoop ecosystem, such as Cloudera distribution, Apache Oozie workflow, Hive and Impala.
- Developed and executed detailed ETL related functional, performance, integration and regression test cases, and documentation
- Experienced in an Agile environment and team focusing on sprint by sprint deliveries.
- Worked with end users to formulate and document business requirements.
- Strong knowledge on ETL and BI processes
- Worked on Data Analytics and BFS domains.
- Exposure of working closely with Customers, Stake Holders and Client Partners.
- Working knowledge of Defect management process, Risk Framework and Mitigation, and Enterprise Testing standards
- Strong problem solving and technical skills coupled with clear decision making.
TECHNICAL SKILLS
Databases: MS Sql, Oracle 11g, Netezza
ETL and BI Tools: SSIS, SSRS, Pentaho Data Integration (PDI), Informatica
Manual Testing: Functionality testing, GUI testing, Integration testing, Regression testing, system testing, Bugzilla
Platforms: Linux, Windows
Scripting Languages: Unix shell scripting
Big Data Ecosystems: Cloudera cloud data platform, HDFS, Hive, Impala, Pentaho Data Integration(PDI), Oozie
PROFESSIONAL EXPERIENCE
Confidential
ETL and Big data Testing Lead
Responsibilities:
- Understand the analytical methodologies to generate test cases to validate the results from each statistical methodologies
- Worked with Hortonworks Distribution and Cloudera Distribution.
- Performed data analytical testing for the BI systems
- Created analytical SQL scripts to validate data between Netezza and Hive.
- Validation of data transformations and perform End - to-End data validation for ETL & BI systems
- Analyze and understand the ETL workflows developed with Oozie in HDFS cloud system
- Generate UNIX shell scripts to manipulate test data and move data from different environment to meet the testing requirements.
- Experienced in Agile Methodology and expertise in JIRA software
- Design, develop, and test processes for extracting data from legacy systems, production databases, Hadoop, and Open Source platforms
- Team size: 6
Technologies: Oracle 11g, Netezza, Cloudera, Hive, Apache Spark, Tibco, Shell Script.
Confidential
ETL Tester, Big data Functional Tester
Responsibilities:
- Framed the basic design of Disaster Recovery system based on customer inputs
- Designed the different approaches for HBase Replication due to their data complexity; and implemented the most suitable approach
- Addressed the testing concern of synchronizing the current Production system with DR, in terms of reference & operation metadata
- Integrated DR system well with other attached systems (Process orchestration engine and ETL jobs)
- Tested Control Failover, to swap between the clusters
- Created ETL test cases to validate data between upstream and downstream systems using PDI and Hive Queries (HQL).
- Took the ownership of Unit Testing, SIT and ITSM Test Plan documents for UAT
- Has been involved in client reviews for test plans and deployment plans
- Team Size: 2
Technologies: Shell Script, HBase, Hive, Pentaho Data Integration (PDI).
Confidential
ETL Tester
Responsibilities:
- Provided test case inputs and assisted with production validations
- Performed ETL testing using Informatica (Power Center/ Power Mart) (Designer, Workflow Manager, Workflow Monitor and Server Manager)
- Strong in ETL data validation developed using Informatica / SSIS ETL environments
- Exposure to DB tools: Toad/ PL SQL developer/SQL Plus
- Strong in BI report validation developed using SSRS BI
- Designed and developed ETL test cases, scenarios, and scripts to ensure quality Data warehouse / BI applications
- Experienced on ETL automation tool - QuerySurge
- Developed process flows and documentation
- Team Size: 5
Technologies: MSBI, INFORMATICA
