Hadoop Big Data Engineer Resume
Raleigh, NC
SUMMARY:
- Worked as a Mainframe Tester/Lead (10 Years) , Hadoop Big Data/ETL Test Engineer, AS400 Tester, QA Lead and Test coordinator with 11 Years of Experience.
- Across all projects actively involved in all phases of STLC right from understanding of requirements, preparing Test Plan, Test Scenarios and cases, Defects Tracking, UAT Support and up to providing post Implementation Support.
- As a Team Lead managed team size ranging from 5 to 10 people both onsite/offshore.
- Worked in change control management using Change man and Endevor
- Experienced in handling COBOL/DB2/CICS/VSAM/JCL Requirements
- Experienced in Banking/Financial, Health care, PBM and Insurance
- Experienced with Mainframe/AS400 and the following Big - Data technologies in Hadoop Ecosystem - HDFS, Map Reduce, PIG (Pig Latin), HIVE (Hive QL), HBASE (NoSQL), Hadoop 2.0, YARN Architecture, Impala, Oozie/Tidal and Sqoop.
- Comfortable with AS400 Control Language Environment
- Experienced in working UNIX/Linux environment
- Mainframe DB2/RDBMS Responsibilities
- Having a good knowledge of SQL concepts and Implementation of the same
- Proficient with Union, Joins and Sub queries to develop medium to complex queries
- Experienced to use DDL, DML and DCL statements of SQL
- Comfortable to use aggregation functions of SQL
- Proficient in using all Mainframe related tools and IBM utilities
- Mainframe Automation Tools developed using CLIST and REXX
- Critical jobs statistics tool, ACS tracker tool, GDG Tool, DD Name Vs File name and developed back end JCL’s and COBOL programs.
- All the back end modules involve Database interaction like creating the table, Inserting the data and retrieving the data.
- REXX tool to get the Attributes of the existing GDG base
- REXX tool to create the Test GDG base with new naming conventions
- REXX tool to create JCL1TIME to build production GDG base with new naming conventions
- REXX tool to create the NDM cards
- PDSMAN tool to search multiple libraries with multiple criteria in a specified pattern of members
- PDSMAN tool to SCAN and REPLACE a particular string
- As a Test co coordinator
- Responsible for Testing Estimation,
- Organized DEV to QA Handoff meeting to get understanding of QA team with the actual changes planned for a release
- Conducted Test plan walkthrough with the QA and Business team
- Set up Test Results walkthrough with the business team for getting the approvals
- Organized weekly status meetings to identify the risks and status of the project
- Escalating the risks to management and Identifying the mitigation plans with the management team
- Connecting the different groups of people based on the dependencies of the project and Following up with testers.
- As Defect coordinator below metrics has been collected
- Classifying the Defect data by Release wise based on the criticality (Critical, High, Medium and Low)
- Defects summary by Release and Status (Open, Closed, Duplicate, Reopen, Rejected, Postponed, Retest, Cancelled) and Calculating the Defect Rejection Ratio
- Defects summary by project wise and showing the % Critical and % High Defects
- Average Turnaround time took to change the defect from one status to other (From New to Open or Open to Fixed)
- Defect Life cycle ( Like In each cycle how many defects are falling), this shows like how may defects from invalid to valid
- Calculate the percentage of wrong rejects and valid rejects
- Calculate the percentage of wrong reopens and valid reopens
- Comfortable with Selenium Web Driver with below Activities using JAVA
- Comfortable with Java programming and HTML
- Comfortable with Selenium IDE tool
- Used Selenium Web Driver for automation, comfortable with handling multiple browsers, various objects like Text Box, List Box, Links, Images, Tables, Labels.
- Expert in identifying the locators using firebug tool
- Comfortable with the coding of xpath, screen capture, handling alerts, scrolling logics, multiple windows
- Comfortable with Selenium parameterization to test with multiple sets of data
- Comfortable with test frame works like JUnit and TestNG
- Comfortable with creating TestNG Framework using annotations
- Jenkins has been used for scheduling the jobs
- ETL Informatica:
- Involved in the validation of work flows and mappings in Informatica tool
- UNIX Shell scripting:
- Developed shell script to retrieve the counts of tables from various zones in the data lake and to compare to make sure that there is no data loss
- Developed shell script to compare tables data between source and transform zone in the data lake to ensure the accuracy of the data
- Developed shell script to automate test case writing to some extent
TECHNICAL SKILLS:
- ETL Informatica
- Hadoop Big Data technologies HDFS
- Map Reduce
- PIG
- HIVE
- HBASE
- Oozie/Tidal
- Sqoop and QuerySurge tool
- Unix/Linux and Scripting
- AS400
- JCL
- COBOL
- CICS
- DB2
- SQL VSAM
- TSO
- Table base
- IMS
- REXX
- CLIST
- TSO/ISPF
- DYL280
- SAS
- Easytrieve
- MQ Series
- Assembler and Oracle
- Core Java
- JDBC
- Hibernate
- JUnit test and Web Services (SoapUI)
- Selenium IDE
- Selenium Web Driver
- SQL
- Oracle
- Squirrel
- Toad
- QMF
- Spufi
- Change man and Endevor
- Xpeditor and Intertest
- File-master
- File-Aid
- Platinum
- PDSMAN
- JCLPREP
- JSCAN
- SPUFI
- QMF
- FTP
- NDM
- JES
- IOF
- VDR (View Direct)
- SAR
- SART
- RUMBA and SDSF
- OPC
- CNTL-M
- ZEKE/ZEBB and CA-7
- IBM Rational Clear quest tool
- HP Open view and Info man
- HP Quality Center/ALM tool
- JIRA
- Remedy and PPM
- OS/390
- Z/OS and Novell
- Knowledge in PL/I
- MS Office Applications like MS Word
- MS Excel
- PowerPoint and VISIO.
PROFESSIONAL EXPERIENCE:
Confidential, Raleigh, NC
Hadoop Big Data Engineer
Responsibilities:
- Understood the data from various source systems and their business importance
- Interacted with Data architect, ETL, Hadoop Administration and Metadata teams
- Attended daily agile meetings to provide the present status of work and road blocks
- Utilized Jira for creating the user stores, tasks and to track the progress of the same
- Utilize qTest for tracking the testing activities
- Worked in Hortonwoks Distribution
- Developed shell scripts to automate the test case preparation and test results validation across multiple zones in the Hadoop data lake
- Involved in the validation of ETL mappings and work flows and their schedules
- Prepared test plan based on the scope and business requirements
- Proficient with below Hive Activities
- Verified and made sure the files are landed into the landing zone from various sources
- Developed medium to complex HiveQL queries to complete the validation
- Compared the data between different to zones to make sure the data is transformed as expected and no loss in the data
- Validated fields definition as per the given mapping sheet
- Validated Hive tables properties like compression, file type and delimiters
- Validated Hive Schemas to make sure they are in sync with the given mapping sheet
- Verified the scheduler for the jobs implementation, pre and post requisites
Environment: Horton works Distribution, SQL, ETL Informatica tool, Unix/Linux, Shell scripting, HDFS, Map Reduce, HIVE, HIVE QL, Teradata, Ambari UI, Tidal, JIRA and qTest
Confidential, Raleigh, NC
Senior Mainframe QA
Responsibilities:
- Comfortable with Test planning, Test Case Preparation, Execution, Defect Reporting, test closure report and Release Verifications
- Sending daily status report, communicating risks and resolving conflicts
- Worked on major federal projects and Book of work items
- Comfortable with Data validation
- Acted as a Approver for QA tasks
- Comfortable with Trade booking system
Environment: MVS, Mainframe, JCL, COBOL, HPS, DB2, SQL, Squirrel, Power Builder, QTP/UFT and HP Quality Center/ALM Tool
Confidential, Richardson, TX
Senior Mainframe QA Lead
Responsibilities:
- Acted as a QA Lead and coordinated the Certification Activities with other 3 team members
- Validate Claims Data received from different systems for correctness
- Good understanding of the Rxclaim system, QL and Recap system
- Comfortable with all basic concepts like Claims Submission, Plan Edits, Pricing, Patient Pay (Copay/Co Insurance), Pharmacy network, Member Eligibility, Adjustments, Prior authorization, Step therapy, Accumulations of deductible, OOP, Refills and Benefit profile settings.
- Hands on experience in generating reports like PDE, CET and 1013 financials for balancing purpose
- Coordinated with development team with all process related issues
- Provided the timely updates on processing, Issues and Road blocks
- Comfortable in using HP Quality center 10 to log the defects and following up on the same
- Helped the team on retesting of the defects
- Prepared and provided various metrics to management
- Involved in the planning and estimation of the migration
- Came up with the timelines of activities and mile stones
- Prepared a strategy document defining the test strategy and success criteria of the wave
- Coordinated with various other teams and made sure that received the all necessary data and inputs to kick off the miscompares report generation process
- Involved in the analysis activities
- Verification of Member eligibility data and benefits set up
- Validation of Price and Patient Pay schedules
- Verification of the schedules like Deductible, out of pocket and Maximum allowed benefit
- Processing the claims and validating the claims as per the setup, like claims to be rejected with the particular reason or paid with particular schedules
- Tracking of all differences
- Validating the dual plans where members have both Medicare and Medicaid benefits
- Conducted daily defect call to discuss about the issues logged in to QC and updated the comments as per the inputs from benefits team
- Conducted a daily status call including external teams to discuss about the road blocks, schedules and health of the project
- Collected the metrics on defects, data to be tested and also plot the trend on various releases
- Provided the post implementation support for the issue raised in the production
- Reported the status and metrics to IT Director
- Came up with presentations on basics of PBM and presented to the team
Environment: AS400, PDM, RxClaim, QL, RECAP, AmeRx, SQL, Mainframe, MVS, JCL, COBOL and HP Quality Center/ALM Tool
Confidential, Richardson, TX
QA Lead
Responsibilities:
- Acted as a QA Lead and coordinated Functional and UAT activities for multiple projects with Offshore resources and also involved Adjudication supporting activities
- Worked on common testing activities like preparing test plan documents, writing test cases and tracking defects
- Interacted with Client leads / business Analysts on requirements clarification
- Executed UAT and Functional test cases
- Conducted Test case and Test Results walk through with Client Leads and Business Team to get the sing off on the same
- Provided daily and weekly status reports to leads Includes the reasons and actions taken for all the blocking issues, Classification of test cases based on the status like Pass, Fail, Blocked, Non testable, Not applicable etc. test cases and Defect details
- Escalated issues on time if there are any road blocks in achieving the targets/milestones
- Comfortable in using HP Quality center for all testing activities like loading the requirements, creating test cases, test sets, mapping the requirements and test cases and defect tracking.
- Setting up the data in AS400 environment and sending for other interface teams
- Provided the Implementation support
- Comfortable with common activities like Member creation, claim submission ( Both D.0 and 5.1 Versions), Plan Edits, Creating different schedules like Patient pay, Pharmacy
- Experienced on processing different types of Adjustments (R&R and RAS)
- Single point of contact for Client Leads and Confidential Offshore resources
- Review of offshore deliverable before sharing with Client leads
- Prepared documentation for the new processes learned
- Acted as a Defect co coordinator and collected the various metrics related to Defects
Environment:AS400, PDM, RxClaim, MVS, Mainframe, JCL, COBOL, SQL, QTP and HP Quality Center
Confidential, Hartford, CT
QA Lead
Responsibilities:
- Acted as a Mainframe QA lead and coordinating with 3 offshore resources
- Comfortable with all STLC activities
- Used Test case Point Testing estimation technique for estimations
- Understanding of Business requirements given by different carriers
- Understanding the SRS Technical Environment
- Coordinated with Development and BA team on clarification of the requirements
- Prepared test plan and presenting the same to team
- Test cases has been developed for the defined test requirements in QC
- Hands on experience in preparing both positive and negative test scenarios
- Executed the test cases in test lab and recording the results into QC
- Setting up the Jobs in TSO Environment and Fixing the errors
- Comfortable in fixing JCL Errors, VSAM File errors and DB2 issues
- Endevor has been used for the change control management
- Comfortable with all Endevor Activities like moving the code across different stages, creating the packages, resetting the packages and casting.
- Spufi has been used for executing the SQL Queries and for identifying the test data
- File-Aid has been used to analyze the File Data to by mapping the files to copy books, and also used many other features of file Aid like comparing the files, creating the files
- Follow up with the developers for all project related issues and defects
- Provided support to UAT team during UAT window
- Provided Regression test scenarios and helped in understanding the same
- Involved in the Post Implementation support
- Preparing weekly status reports to track the status of testing
- Participated in meetings with project manager and business people
- Validation of files before delivering to the insurance carriers
- Prepared Knowledge transition documents on the projects worked
Environment:AS400, CL, RPG, SYNON, MVS, TSO/ISPF, SDSF, COBOL, JCL, DB2, EasyTrieve, Oracle PL/SQL, Toad, PVCS, HP Quality center 10.0, PPM, Remedy, CICS, SQL, SPUFI, VSAM, Z/OS, MS Office, File-Aid, REXX, DB2 TMS, Expeditor, Share point, PGP Encryption and Endevor.
Confidential, Wilkes Barre, PA
Mainframe QA Lead
Responsibilities:
- Understanding of Business requirements specified in BSD
- Understanding the Technical Systems design of various repayment plans using in FFELP and FDLP Loans
- Prepared traceability requirement matrix and connecting business requirements with test requirements and test scenarios
- Attended BSD and TSD walkthroughs
- Writing test cases for the defined test requirements in QC
- Hands on experience in preparing both positive and negative test scenarios
- Presenting test cases to Team for getting the final Approval before starting of actual testing
- Executing the test cases in test lab (Mainframe Jobs in TSO) and recording the results into QC
- application tool and Mainframe Utilities
- Setting up Jobs, Procs in test environment and executing the same
- Hands on experience in fixing the abends, errors
- Follow up with the developers for all project related issues and defects
- Provided support to UAT team during UAT window
- Provided Regression test scenarios and helped in understanding the same
- Preparing weekly status reports to track the status of testing
- Participated in meetings with project manager and business people
- Validation of elements in Endevor before moving to production
- Sending the user notification with the details of function going in to live
- Provided post implementation validation and re tested the issues identified after code fix
- Prepared Knowledge transition documents on the projects worked
Environment: CICS, COBOL, JCL, DB2, SQL, SPUFI, VSAM, MVS, Z/OS, MS Office, TSO/ISPF, SDSF, File-Master, Quality Center 9.2, REXX, DB2 File-Aid, Intertest, TMS, Expeditor Pride and Endevor.
Confidential, Kansas city, MO
QA Tester
Responsibilities:
- Understanding of statement of need, Functional specifications and Technical specifications
- Identifying Test requirements and updating the same into Quality Center
- Writing test cases for the defined test requirements
- Hands on experience in preparing both positive and negative test scenarios
- Executing the test cases in test lab (Mainframe Jobs in TSO) and updating the results into QC
- Follow up with the developers for all project related issues and defects
- Endevor has been used as a change control tool for code promotions
- Presenting test cases to QA lead for getting the final Approval before starting of actual testing
- Preparing weekly status reports to track the status of testing
- Participated in meetings with project manager and business people
Environment: CICS, COBOL, JCL, DB2, SQL, SPUFI, CA-7, VSAM, MVS, Z/OS, MS Office, VDR, TSO/ISPF, SDSF, File-Aid, Quality Center 9.2, REXX, DB2 File-Aid, Expeditor and Endevor.
Confidential, Richardson, Texas
Test Coordinator
Responsibilities:
- Acted as a Test Coordinator
- Involved in the end to end of testing phase for Provider, IMM and Pricing systems.
- Establishing connectivity between sub systems, Web Interfaces and MQ-Mainframe
- Setting up new test environment and Remediating elements as per new testing strategies
- Participated in all Business meetings and identified the test strategies based on the requirements
- Maintained requirements traceability matrix and conducted necessary reviews to ensure test cases appropriately translate and map to requirements
- Handled all END to END Activities of Endevor for the entire team
- Developed test strategies, test plans, test cases and test data
- Developed SQL scripts as per the requirements
- Involved in the reviews and execution of test plan, test cases and prepared test results
- Hands on experience in preparing JCL’s, Procs, override methods, using parm parameters and preparing COBOL/DB2 or COBOL/CICS programs.
- Comfortable in using IDCAMS for all VSAM activities Delete/Define, Repro.
- Experienced in manual/automated test execution(ZEKE/ZEBB Scheduler)
- Performed System testing, Regression testing and Parallel testing
- Experience in testing online screens, Web screens by providing the proper input
- Prepared and circulated Error reports, issue logs, Query logs to the team.
- Presentation of test results to the team in the presence of QA Lead
- Assigning the defects to the concerned developers and following up on the same, IBM Rational Clear quest is used as defect tracking tool.
- Worked on root cause analysis of defects and environmental issues and provided the permanent fix to prevent them in the next cycles
- Documented all new changes proposed to the system with respect to each release
- Proficient in using SAS data step, macros, and various procedures
- Tracking and reporting to Test Lead and Project Manager the progress of the project
- Experienced in using Endevor, HP open view and all IBM utilities, Sort techniques.
- Developed REXX tools for verifications and formatting reports
- Development activities
- Experienced in developing new JCL’s, Procedures and using overrides
- Developed REXX tools where ever possible for carrying out the analysis, To Format the Scanned results and To Extract the Programs names from the Procs
- Developed REXX tool to classify the all datasets in to PDS, GDG, PS and VSAM
- Involved in the work estimates of the project, Documentation of application, Specifications.
- Coordination with Endevor team to delete the unwanted elements or To Archive them.
- Coordination with CICS team for the removal of CICS Transactions, Programs, Maps and File entries from PCT, PPT and FCT respectively.
- Preparation and Presentation of the weekly Status reports to the management
- Involved in all the Project meetings to discuss the status of Project, Any issues and concerns.
- Acted as Developer and Project coordinator for 3 systems Provider, IMM and Pricing
- Involved in the Impact analysis of all systems to identify the incorrect files and suggested the new names as per the new naming conventions.
- Responsible to convert all Procs with new Names, Creation of GDG, One time copy jobs and Implementation.
- HP Open view is used for configuration management
- Responsible to conduct walkthrough’s in the presence of stake holders before moving the changes to production and getting the approval from Management (RFC)
- Proficient in all Endevor activities like sign-out, moving the elements from one stage to another stage, creation of packages and JCL1TIME creation.
- Prepared check lists for all changes going in to production, weekly summary reports.
- Tools Developed and Induction Manuals prepared
- REXX tool to get the Attributes of the existing GDG base
- REXX tool to create the Test GDG base with new naming conventions
- REXX tool to create JCL1TIME to build production GDG base with new naming conventions
- REXX tool to create the NDM cards
- PDSMAN tool to search multiple libraries with multiple criteria in a specified pattern of members
- PDSMAN tool to SCAN and REPLACE a particular string
Environment: MVS, CICS, COBOL, JCL, DB2, SQL, QMF, ZEKE,ZEBB, VSAM, Z/OS, MS Office, VDR, TSO/ISPF, File-Master, Sync Sort, Quality Center, REXX, SAR, Novell, Librarian, PDSMAN, HP Open view, VDR and Endevor.
Confidential, Irving, Texas
Test Coordinator, Tester
Responsibilities:
- Involved in all phases of SDLC and Acted as a Developer, Testing Coordinator, Team lead (Offshore Coordination) and QA Lead (Mainframe and Distributed Environment) .
- Involved in Production support on a rotation basis
- As a Team lead, activities include, providing the technical support to the team, Supervising, Directing the work and managing, Interaction with the clients and SE Customers, Escalating the issues and providing the timely status, preparing the weekly status reports.
- Change man has been used for promoting the codes
- Quality center is used for the Specifying the testing requirements, Planning tests, Running tests, Defect tracking, Logging Defects, Tracing changes and Analyzing the Testing process.
- Tools developed using CLIST and REXX
- Critical jobs statistics tool, ACS tracker tool, GDG Tool, DD Name Vs File name and developed back end JCL’s and COBOL programs.
- All the back end modules involve Database interaction like creating the table, Inserting the data and retrieving the data.
- QA Analyst responsibilities
- Supported multiple testing environments concurrently IBS, FDR/BASE, FDR/SEARS, both minor and major releases
- Key point of contact to end users and developers
- Experienced in handling the Exxon, Shell and Bank card accounts and splitting them across multiple test regions on rumba system
- Responsible for configuration management, involves Verification of jobs, procs, cards, modules, copy books in development libraries for the correctness. Verification of Tag’s, Change man package, parent and implementation details.
- Involved in the stage, promote and recompiles of the components.
- Responsible to manage UAT (OPC Scheduler activities like Monitoring batch schedules, fixing the abends, escalations, adding new jobs, handling holds), Regression and Parallel testing on rumba system
- Acted as a Defect preventive prime
- Responsible for Regression testing and Parallel Testing
- Developed and implemented the Compare Process, regression SCRUB process
- Involved in the preparation of regression design document, analysis of miscompares and responsible to circulate the same to developers to fix the issues.
- Performance tuning
- Developed a COBOL module for compare process which saved lot of CPU time and provided good amount of CPU time savings
- Used Strobe tool to identify the time consuming statements in JCL/COBOL/DB2 and provided the solutions to save the CPU time
- Involved in Development activities which include
- Hands on Experience in dealing the DB2 Enhancements and Experienced in DB2 activities like Creating DCLGEN, Error Handling, Pre-compile, Bind process, Cursor coding, Stored procedures and Null handling.
- Good experience in Developing and Testing the Complex queries using SQL and QMF Report writing and using Database utilities like Run stat and Load
- Experienced in writing the data extraction programs from production files, using DYL280,COBOL
- Involved in the disaster recovery project (Shadow Migration)
- Participating in the BRD meetings, Work estimates, Impact analysis, Design documentation, Coding, unit testing, Implementation and Support
- Acted as a Table base coordinator for all Major releases
- Experienced in JCL changes, Creating new Procs, Using Symbolic parameters, Overrides, Parm, GDG and IBM Utilities
- Responsible for preparing weekly Reports and Defect tracking.
Environment: CICS, COBOL, JCL, DB2, SQL, QMF, PL/I, DYL280, Table base, VSAM, MVS, Z/OS, Unix, MS Office, TSO/ISPF, Expeditor, VISIO, Platinum, File-Aid, Sync Sort, MQ series, Ice tool, REXX, Clist, Ellipse, SAR, CA-ADS, change man, Quality center, LPAR’s, OPC, RUMBA, Assembler, SMART TS, SAS and Intertest.