Etl /big Data Tester Resume
Foster City, CA
PROFESSIONAL SUMMARY:
- Over 6+ years of excellent IT experience in requirement gathering, data analysis, design, development, Testing and Implementation of Data Warehouses using ETL & Business Intelligence solutions, UNIX, OLAP for multiple domain.
- Experienced in different types of Methodology (Waterfall, Agile wif Scrum).
- Expertise in understanding Business/Functional/technical requirements and compliance rules.
- Experienced in writing test plan, creating test scenario, writing and executing teh test cases and test script.
- Complete exposure to all stages of SDLC process wif strong skills in writing various test plans, developing, maintaining test cases and test scenarios.
- Excellent Understanding in relational Data modelling, Dimensional data modelling, logical/Physical Design, ER Diagrams, analysing data sources.
- Experience in testing complex reports generated by Cognos, Business Objects including dashboards, summary reports, master detailed, drill down and score cards.
- Expertise in Data Analysis, Understanding Dimensional Data Modelling, Data Extraction, Transformation& Loading (ETL), Cubes and End User Reports.
- Experienced in testing Big Data Technologies - Hadoop ecosystem/HDFS/ Map-Reduce Framework, Flume, Hbase, Sqoop, Pig, Oozie, Kafka and HIVE data warehousing tool.
- Good Understanding on Star Schema Modelling, Snow-Flake Modelling, FACT and Dimension Tables, Physical and Logical Data Modelling.
- Extensive experience in using SQL, PL/SQL Procedures/Functions, Triggers and Packages for testing purposes.
- Strong in Hadoop, Bigdata, NoSQL, SQL Server, Teradata and Oracle. Experience in using SSIS, Abinitio and Informatica tools for validating ETL workflows.
- Experience in using SSRS, SSAS and Cognos tools for Reports and Analytics validation. Experience in validating SCD type 1 and SCD type 2 tables.
- Experience in validating Static and Incremental loads. Experience in Big data testing in Hadoop environment using Hive query language.
- Developed SSIS test environment for UAT testing and used all SSIS components while testing teh graphs and ran teh jobs on background. Tested teh ETL SSIS packages and other ETL Processes (Data Warehouse Testing).
- Worked on EDI testing wif teh Members 834 Enrolment inbound/outbound, claim 837 inbound or claim adjudication, response to claim 835 outbound, 276 status inquiry277response, 270 eligibility/271 benefits.
- Created ETL test data for all ETL mapping rules to test teh functionality of teh SSIS packages
- Experienced in functional, integration, regression, compatibility, security, back end, acceptance testing (UAT), and GUI Testing.
- Advanced user in using Test management tools like HP Quality Center/Test Director, JIRA.
- Prepared/Mock up test data in different environments for different testing needs.
- Ability to quickly adapt to different project environments, work in teams and accomplish difficult tasks independently wifin time frame.
- A good team player wif excellent written and verbal communication skills wif strong problem-solving skills.
- Worked on Teradata for Data warehouse analytical purpose.
- Experienced in using IDQ tool for profiling, applying rules and develop mappings to move data from source to target systems.
- Involving in Cloud migration projects and testing teh data on AWS cloud servers.
TECHNICAL SKILLS:
ETL ToolsInformatica : Power Center9,8.5.1, Abinitio, SSIS, Data Stage
BIG Data/Hadoop Tools/BI: Hadoop, HBase, Hive Pig, Sqoop, Zookeeper, Spark, HFDS, Kafka, Java, HUE, Map Reduce, Flume, IBM Cognos v9, MicroStrategy 8.0, SSRS
Data Modelling: Erwin, Microsoft Visio, Rational Rose (UML), ER Studio
Operating Systems: Windows, UNIX
Databases: Oracle 11g/10g/9i/8i, SQL Server 2008/2005, DB2, Microsoft SQL server management studio, Teradata V2R5, TOAD DB2, PostgreSQL, AWS Redshift
Testing Tools: Rational ClearQuest, Test Director, JIRA, HP ALM & Quality Center 9.0/9.2/10.0, SOAP Web services
Scheduler tool: Autosys, Control M
Languages: XML, SQL, PL/SQL
PROFESSIONAL SUMMARY:
Confidential, Foster City CA
ETL /Big data Tester
Responsibilities:
- Involved in Regression, Functional, Integration, System Testing and User Acceptance Testing.
- Participated in analysis of Business and functional requirements.
- Working on complete Agile environments wif teh daily scrum meetings of sprints.
- Interacted wif Business users to determine User requirements and goals.
- Strong knowledge of SOAPUI (API) testing
- Tested of complex mappings using slowly change dimension (SCD) Type me, Type II and Type III involving transformations such as expression, joiner, aggregator, lookup, update strategy, and filter.
- Tested several data validation packages developed in Data Stage environment.
- Entered new bugs and maintained teh current status of those bugs.
- Modified previously existing test cases that were driven by teh manual testing.
- Responsible for communicating Defect Status Reports to business in project meetings.
- Participated and Organized weekly meetings and walkthroughs to improve teh testing efforts.
- Strong ability in developing advanced SQL queries to extract, manipulate, and/or calculate information to fulfil data and reporting requirements including identifying teh tables and columns from which data is extracted.
- Prepared and executed test cases data validation using Hive SQL queries. Developed strategies to validate incremental data loads.
- Interacted wif End user community to understand teh business requirements and in identifying data sources.
- Experienced working wif Customer Information Data Mart for business reporting thru MDM and Data.
- Used Autosys job scheduler for automating teh monthly regular run of DW cycle in both production and UAT environments.
- Extensively used Data Stage client tools. Teh objective is to extract data stored in Oracle database, flat files to load finally into a single data warehouse repository, which is in Oracle
- Prepared and executed test cases for Business Scenarios Validation.
- Written Hive queries for data analysis to meet teh business requirements. Validated Hive Managed and External table types.
- Created and Verified Web services API requests, SOAPUI Protocols.
- Creating Hive tables for testing purpose and working on them using Hive QL. Validated data imported to Hadoop or HDFS environment from RDBMS.
- Validated importing of data from various data sources, performed transformations using Hive loaded data into HDFS and Extracted teh data from Teradata into HDFS using Sqoop.
- Metadata graphs from legacy source system to target database fields and involved in creating SSIS packages.
- Experience wif Autosys job scheduler including jil scripting, virtual machines and custom calendars
- Promoted Unix/ application releases from development to QA and to UAT environments
- Responsible for creating teh Requirements Traceability Matrix.
- Developed Test Strategy, Test plans and Test scenarios using MS Word and MS Excel.
- Developed Test Cases and Test Scripts for System and UAT Testing.
- Performed Positive and Negative Testing for many scenarios and applications.
- Testing teh source and target databases for conformance to specifications.
- Involved in teh error checking and testing of teh ETL procedures and programs Data Stage session log
- Conducted regression testing on teh application under test and Debugging teh SQL-Statements and stored procedures.
- Tested teh Oracle SQL testing programs and tested teh Oracle Applications and Portals like Executive Dashboard, lookup built on Oracle.
- Conducted review sessions on test case and regression test scripts in Quality Center.
- Used Inner and Outer Joins in order to retrieve and validate teh Various Transaction Details from multiple tables.
- Run SQL queries testing and data transfer to teh Mainframe for claims process. Performed rigorous manual testing such Functional Testing, Smoke testing, Integration.
- Interacted wif End user community to understand teh business requirements and in identifying data sources
- Verified and maintained Data Quality, Integrity, data completeness, ETL rules, business logic.
- Extensively used SQL queries to check storage and accuracy of data in database tables.
- Performed all aspects of verification, validation including functional, structural, regression, load and system testing.
- Tested whether teh reports developed in Cognos are as per company standards.
- Tested different detail, summary reports and on demand reports using Report Studio.
- Reported bugs and tracked defects using Quality Center 10.
- Worked wif business team to test teh reports developed in Cognos.
- Personalized Cognos Connection for specified display options for testing regional options and personal
Environment: Hadoop, HBase, Hive Pig, Sqoop, Zookeeper, SOAP UI, Spark, HFDS, MDM, Kafka, Java, HUE, manual testing, Map Reduce, Flume, Autosys, SSIS, Oracle 11g&10g, TOAD DB2, Data Stage, UNIX, Cognos 8.0 Series, XML, Test Matrix, Control-M, HP ALM
Confidential, San Ramon, CA
ETL/QA Tester
Responsibilities:
- Reviewed Use Case Requirement, Functional Design Documents and Technical Specification documents and Developed Test Cases after analysing teh BRD.
- Test expert at various levels/stages - Unit Testing, Integration Testing, Regression Testing, Functional testing, system testing, Smoke & UAT testing. Worked as a Team lead for members team.
- Creating Hive tables for testing purpose and working on them using Hive QL. Validated importing of data from various data sources, performed transformations using Hive loaded data into HDFS and Extracted teh data from Teradata into HDFS using Sqoop.
- Writing Test Hive queries to test development algorithms in Hadoop cluster.
- Used Postman & SOAPUI for rest service testing.
- Worked wif non-transactional data entities for multiple feeds of data using MDM
- Worked wif ETL for understanding Data Stage graphs for group dimensions and facts.
- Writing HBase queries, Unix commands to retrieve and compare data between hive and hbase
- Validate input data streams deposited on HDFS storage.
- Extensively used AUTOSY to schedule teh jobs and run teh scheduled jobs at specific time.
- Validate Hive table schema, transformation rules aggregations of Hive algorithms
- Validate BI Reports against Hive table aggregations and transformation rules
- Develop automated test scripts for regression of existing functionality, bug isolation and new functionality.
- Interacted wif End user community to understand teh business requirements and in identifying data sources.
- Different Data Stage components especially are used TEMPeffectively to develop and maintain teh database
- Used Autosys to do teh shakeout whenever a new build is received.
- Created automated script for REST-API testing using Rest Assured framework.
- Performed rigorous manual testing such Functional Testing, Smoke testing, Integration.
- Execution of cluster batch jobs & Hadoop workflows to generate test data in Hive & Hbase tables
- Experience in testing Data Marts, Data Warehouse/ETL Applications developed in Informatica using Oracle, DB2, Teradata and UNIX.
- Expert in EDI and HIPAA testing privacy wif multiple transaction exposure such as new Members 834 Enrolment inbound/outbound, claim 837 inbound or claim adjudication, response to claim 835 outbound, 276 status inquiry277response, 270 eligibility/271 benefits.
- Expertise in different types of testing such as black box, sanity, smoke, positive, negative, integration, configuration, and regression testing as well as UAT Testing.
- Strong Knowledge of HIPAA and their regulation. Knowledge of Medicare and Medicaid.
- Knowledge in HIPAA Implementation. Have been involved in a variety of HIPAA related projects. Medical Claims experience in Process Documentation, Analysis and Implementation processes of Medical Claims Industry from teh Provider/Payer side.
- Extraction, Transaction and Loading was done using different Components and different expressions using Data Stage to create test data
- Performed Smoke Testing, End-to-End Functionality Testing, Adhoc Testing, Regression Testing, Integration Testing and User Acceptance Testing (UAT).
- Assisted in teh design of EDI solutions and represented Enterprise EDI team wif regards to EDI/XML industry standards.
- Validated teh data thru various stages of data movement from staging to Data Mart to Data Warehouse tables.
- Modified previously existing test cases that were driven by teh manual testing.
- Testing of EDI X12 840, 837 and 835 Transaction sets for claims processing.
- Validated teh data imported and exported into HDFS and Hive using Sqoop.
- Experience working wif Unix, Hadoop, hive, HDFS and shell scripting for bigdata testing.
- Expertise in Bug tracking Tools like FTP, Test Director, HP Quality Centre and Rational Clear Quest.
- Reviewed teh Requirements for testability, conducted walkthroughs wif developers.
Environment: SSIS Packages, JIRA, Liston, Biztalk, Microsoft SQL Server Management Studio 17, manual testing, SOAP, MDM, Oracle 11g&10g, IBM Data Stage, Autosys, UNIX, HP ALM, 834 & 837 EDI files, HDFS, Sqoop, Test/defect Matrix, Reporting.
Confidential, NC
ETL /QA Tester
Responsibilities:
- Involved in reviewing/analysing Business Requirement Documents/Functional specifications/use cases.
- Worked wif Business Analysts, developers while reviewing teh Business Requirement Documents and when there are enhancements in teh applications.
- Developed Test Cases for Deployment Verification, ETL Data Validation, Cube Testing and Report testing.
- Tested teh ETL process for both before data validation and after data validation process. Tested teh messages published by ETL tool and data loaded into various databases
- Peer reviewed test cases developed by QA team members and advice/point/discuss possible complex scenarios and make sure requirements are completely covered.
- Supported and provided test cases for UAT, staging and production Participated in review meetings and attended sessions to understand various business concepts.
- Created Traceability Matrix to ensure that all requirements are covered in test cases.
- Develop Risk-based Test Strategy whenever required, to save time and to determine which test activities to carry out and created complexity matrices.
- Involved in developing Unix Korn Shell wrappers to run various Ab Initio Scripts
- Involved in UAT process before rolling out to production when required. Participated in debugging prod issues along wif support team.
- Worked in Agile methodology during application development and participated in daily scrum meetings.
- Developed user defined functions, created objects where required and used descriptive programming to automate.
- Metadata graphs from legacy source system to target database fields and involved in creating Ab Initio DMLs.
- Tested SSIS packages and used SSIS as an ETL tool to load teh final loads.
- Tested several data validation packages developed in SSIS environment.
- Tested packages for extracting, cleansing, transforming, integrating, and loading data using SSIS ETL Tool.
- Analysed business requirements, system requirements, data mapping requirement specifications, and responsible for documenting Test cases, Test Scripts in Quality Center 9.2
- Extensively tested teh Business Objects report by running teh SQL queries on teh database by reviewing teh report requirement documentation.
- Developed and Executed SQL statements in Toad to retrieve data and to validate data.
- Tested data migration to ensure that integrity of data was not compromised.
- Validated teh data thru various stages of data movement from staging to Data Mart to Data Warehouse tables.
- Responsible for documentation of test results, test matrix, and participated in daily/weekly QA meetings.
- Conducted down test and up test for release builds pushed to UAT and to Production.
Environment: Ab Initio, Oracle 10g,MS SQL,HP Quality Center 9.2,TOAD, Business Objects, MS Excel, MS Project, Control-M, Cognos and IBM Clear Quest.
Confidential, CA SF
ETL Tester
Responsibilities:
- Analysed teh Business requirements and developed Test cases based on functional requirements, general requirements and system specifications.
- Prepared test data for positive and negative test scenarios for Functional Testing as documented in teh test plan.
- Exclusively involved in writing test cases, test scripts, test plans and execution of test cases reporting and documenting teh test results using Quality Center.
- Worked as ETL Tester responsible for teh requirements / ETL Analysis, ETL Testing and designing of teh flow and teh logic for teh Data warehouse project.
- Experienced in writing complex SQL queries for extracting data from multiple tables.
- Tested to verify that all data were synchronized after teh data is troubleshoot and used SQL to verify/validate my test cases.
- Testing teh ETL data movement from Oracle Data mart to Teradata Data mart on an Incremental and full load basis.
- Participated in Production rollouts and provided end-to-end support and post-implementation support to teh customer community resolving production related issues.
- Wrote SQL queries to validate source data versus data in teh data warehouse including identification of duplicate records.
- Tested whether teh reports developed in Business Objects and Crystal Report is as per company standards.
- Tested Ad-hoc reports, drill down and drill through reports using Business Objects.
- Tested different detail, summary reports and on demand reports.
- Involved in pre and post session migration planning for optimizing data load performance.
- Interfaced wif teh Portfolio Management and Global Asset Management Groups to define reporting requirements and project plan for intranet applications for Fixed Income and Equities.
Environment: Informatica PowerCenter8.6, MS SQL 2000, Oracle 9i, SQL, PL/SQL, Windows XP and 2000, Business Objects, Crystal Reports, Quality Center.