Lead Hadoop Tester Resume
Middletown, NJ
PROFESSIONAL EXPERIENCE
- Big Data Testing with 8+ years of IT Experience and total of 14 years of experience in Telecom domain in different phases of Software Development Life Cycle using waterfall/Agile methodology.
- 2+ years of experience with Hadoop, HDFS, MapReduce and Hadoop Ecosystem including Pig & Hive.
- Excellent understanding of Hadoop architecture and various components like HDFS, MapReduce, Yarn, Pig, Hive, Oozie, Flume, Sqoop, Zoo Keeper
- Experience in analyzing BigData using HiveQL, Pig Latin and custom Map Reduce programs in Java and Python(numpy, scipy, pandas, Pydoop) and Extending Hive and Pig core functionality by writing custom UDFs.
- Experienced in Testcase design and Execution of Java/J2EE technologies based web applications, Distributed N - Tier applications through SOAP/REST Web services, SQL Testing and flat file interface testing
- Proficient in test automation using Selenium Tools, Rational Functional Tester and Performance Testing using Rational Performance Tester
- Strong Experience in Automating Web Application using Selenium WebDriver with Java/Python, JUnit, and TestNG and good Experience in Automation test framework like Data Driven Framework, Keyword Driven Framework and Hybrid Testing Framework.
- Experienced in Performing data driven testing, Cross browser testing using Selenium
- Good Experience in Java Programming, Python Programming/Scripting, Junit, TestNG, Unittest, UNIX Shell Scripting and Perl Scripting
- Experience in writing huge SQL Queries and experienced in DDL, DML and Transaction queries in RDBMS like Oracle and MySQL
- Experienced in Automation of SOAP/RESTful Webservices testing using SoapUI and flat file interface testing using UNIX Shell Scripting
- Very Strong Experience in Writing Unix Shell Scripts and Scheduling the jobs using crontab
- Proficiency in programming with different IDE’s like Eclipse, Pycharm and DB tools like TOAD, SQL Developer.
- Experience in JUnit, TestNG, Unittest frameworks for performing testing and automation activities
- Exposed in software configuration management tools like SVN, Clearcase and Defect tracking tools like Quality Center(QC), Clear Quest(CQ) and Requisite Pro and tools like Maven and Jenkins
- Experienced in User Acceptance Testing (UAT), End to End Testing (E2E), Production Deployment and Production Support.
- Mentoring of team members and guiding them on technical challenges and Managed team as a lead from US to India in onsite offshore model
- Excellent Analytical and Communication Skills and self-motivated, quick learner, smart worker and a very good team player.
TECHNICAL SKILLS
Web Technologies: SOAP/Rest Webservices, WSDL, CSS, HTML, JSP
BigData: Hadoop, HDFS, MapReduce, Hive, Sqoop, Pig, HBase and Flume.
Languages: Java, Python (numpy, scipy, pandas) and SQL
Operating Systems: UNIX, Linux, Windows
Scripting UNIX: Shell Scripting, Python Pig Latin and Perl Scripting
Database: Oracle, MySQL, HBase, SQLite
Web/Application: Servers Apache Tomcat
Version Control Tools: SVN, SCME, Clearcase, Maven, Jenkins
Other Tools: Eclipse, PyCharm, Toad, SoapUI, Quality Center (QC), Requisite Pro
Methodologies: Agile, Waterfall
Automation Frameworks: TestNG, Junit, Unittest, MRUnit
Platform: Windows, Linux, Solaris, AIX, HPUX
Telecom/Protocols: SS#7, CAS, V5.2, SDH, PDH, CAMEL, WINA
PROFESSIONAL EXPERIENCE
Confidential, Middletown, NJ
Lead Hadoop Tester
Environment: Linux, Java, Python, Hadoop2.0/BigData, Oracle 11g, SQL, Toad, SVN, Maven, Rally, Eclipse
Responsibilities
- Evaluated business requirements and prepared detailed specifications that follow project guidelines required to develop written programs.
- Installed and configured Hadoop and its ecosystem (MapReduce, HDFS, Hive, Pig, Scoop, Flume and Oozie.) in Linux Distributions like Ubuntu/Cloudera
- Creating Hive tables and writing Hive Queries on Data Sets
- Loading data from data collector coming from various Network Elements on to Hive tables
- Ingested XML/JSON files by using XMLSerde/JSONSerde into Hive Internal/External tables and extracted data from Hive tables using Hive Queries (HQL)
- Ingesting Inventory, CDR(CSV) and performance data files into Hadoop by PigLatin Scripts using PigStorage Loader and extracted Call Success Report, Failure Report, Network Utilization Report, etc…
- Exported the analyzed Reports to the relational databases using Sqoop for visualization and to generate reports for the BI team
- Writing Sqoop queries for loading data from databases like ORACLE, and MYSQL into HDFS and transferring the analyzed Reports from HDFS on to RDBMS for further processing and Reporting
- Designed and written multiple Map Reduce jobs, developed UDF functions for Hive/pig in Java/Python for complex data analysis.
- Configured Flume to transport web server logs into HDFS. Also writing MR jobs to parse the CDR/Performance data in desired schema and used Sqoop to save data in Oracle.
- Experience in working with NoSQL database like HBase.
- Worked on various file formats Avro, SerDe, Parquet, JSON and Text
- Used Oozie workflow scheduling system to automate the data loading into Hadoop Distributed File System. Processing the loaded data using Hive /Pig and Transfer the data onto RDBMS using Sqoop
- Create/Modify shell scripts for scheduling various data cleansing scripts which invokes PigLatin Scripts and Hive Queries
- Developed Junit/TestNG tests for testing MapReduce and also performed testing using small sample data
- Reporting operational problems by following standards and procedures using a Defect reporting tool Quality Center (QC).
Confidential, Middletown NJ
Lead Automation Engineer
Environment: UNIX, Java, Selenium WebDriver, HTML, Oracle 11g, SQL, Toad, Webservices, SoapUI, SVN, Quality Center, Rally
Responsibilities
- Requirements review and Writing Test Plans, Test Scenarios, Test cases and Automation Test Scripts.
- Performing different types of testing including Functional Testing, Regression Testing, User Acceptance testing on Application GUI, Database Testing, flat file interface testing using shell scripting and Webservices Testing
- Extensively automated regression and functional test suites using Selenium (IDE/WebDriver), JAVA/Python, and Frameworks like Junit and TetsNG using Page Object Model (POM) Concept
- Implemented Page Object Model/Page Factory Concept from scratch to represent all the Application web pages using Selenium/Java and also performed preparation of automation test framework
- Developed Keyword Driven, Data Driven and Hybrid automation frameworks to retrieve test actions, test data from Excel files and SQL Databases
- Extensively performed Oracle Database testing using Selenium, JDBC concept and SQL queries
- Used Maven, Selenium Grid to execute Selenium automation suites on different platform, browser combinations in parallel and reported defects/results to the team and Management
- Experienced in testing of SOAP/REST Web services interface using SoapUI
- Configured Maven for automation projects and developed Maven project object model (POM) and integrated with Jenkins for providing continuous integration and continuous delivery of Test Automation Scripts for testing the Application software continuously
- Performing backend white box testing(Java/JSP/Shell/Perl), SQL testing, SSH Flat file interface testing, MV Replication interface testing
- Performed automation of Defect Report Generation from Quality Center and format in Excel Sheet and send to the team through email using Excel Macros
- Involved in Root Cause Analysis of Production defects, Production Installation Support
- Generating Test Metrics, automation reports, Defects tracking in Quality Center, testcase to Requirements traceability matrix for management reporting.
- Leading, Mentoring and Coordination of teams in an Onsite-Offshore model, Attending Daily Scrum as part of Agile model for discussing the project status
Confidential, Middletown NJ
Lead System Engineer
Environment: Java, Unix, JSP, HTML, Oracle 11g, SQL, Toad, Webservices, SoapUI, Clearcase, ClearQuest, Rational Performance Tester, Rational Functional Tester
Responsibilities
- Requirements review and writing Test Plans, Test Scenarios, Test cases and Test Scripts.
- Performing different types of testing including Functional Testing, Regression Testing, Performance Testing of GUI Testing, Database Testing and User Acceptance testing
- Automation of regression and functional test suites using Rational Functional Tester in Java and also developed Data Driven framework to retrieve test data from spreadsheet and from SQL Databases
- Built various automation suites in RFT to support various test environments and provided weekly reports on automation executions and coverage
- Demonstrated a strong understanding of client needs by working with project manager and business analyst to define Business, Non-Functional, and Functional Requirements
- Performed various Performance tests using Rational Performance Tester(RPT) in different environments
- Understanding customer requirements and arriving Confidential the performance thresholds like throughput, CPU utilization, Memory utilization, Network utilization, Disk usage, Response times, Maximum Number of Users, Duration of testing to be performed, amount of load to be applied to the system, etc.
- Involved in test bed setup, data creation, identify key scenarios, creating load scripts and tools using Unix Shell Scripting and Rational Performance Tester and Report Template Generation for Performance Testing
- Performing Load, Stress, Soak, Spike tests and Monitor the tests using the monitoring scripts and also monitored Garbage Collection(GC) using UNIX Shell Scripting
- Generate Performance metrics for throughput, CPU utilization, Memory utilization, Network utilization, Disk usage, Response times, number of users, total transactions, monitoring the heap, garbage collection, etc.
- Consolidate, Analyze and Share the test results and fine tune the System and test again to see if there is an improvement or decrease in performance
- Involved in production Bug Verification and Production Installation Support and UAT Support
- Reporting and Tracking the System test Defects in Quality Center/Clear Quest
- Generating Test Metrics, testcase to Requirements traceability matrix for management reporting.
- Contributed to implementation of test strategy, review of test cases, and delivery of test estimates for various project phases
- Manage a team of 15 testers and worked as a lead in Mentoring and guiding the team in performing System testing, Regression testing and Performance Testing
- Day to Day Meeting with the testing team to track the System testing/Regression Testing/Performance Testing progress
Confidential
Senior Product Engineer
Environment: SCO UNIX, Shell Scripting, Perl Scripting, Oracle 9i, SQL, Sqlplus, SQL Developer, Clearcase, Quality Center, Quality Test Professional
Responsibilities
- Understanding of client needs by working with System Engineers, and business analyst to define Business, Non-Functional, and Functional Requirements of Comverse Real Time Billing System(RTBS)
- Prepared Test plan and test cases for functional and regression testing for Comverse Real Time Billing System(RTBS)
- Facilitated QA Test Plan/Cases reviews meetings attended by members of Product, Development and Senior Management.
- Integration and testing of RTBS, Testing of GSM and CDMA Protocols - CAMEL, IS826,IS-41
- Involved in automation testing using Quality Test Professional(QTP) by creating test scripts and executing on weekly basis
- Automation of test cases using Shell Scripting and Perl scripting
- Bugs Reporting, verification and tracking using Quality Center
- Test Environment Setup (OS/Score Installation and Database Installation required for RTBS)
- Coordinating with US Counterparts for both Test execution and Test Environment Setup
- Performing Basic Confidence Testing on new software build and automation of BCT testcases using QTP and shell scripting
Confidential
Senior Engineer
Environment: UNIX, Oracle 9i
Responsibilities
- Monitoring and Maintenance of NLD Network Switch
- Provisioning of NLD network Switches
- Traffic Data collection and analysis for improving ASR and CCR
- Switch monitoring for Alarms and CDR Collection and Verification
- Automating Command file generation for Link provisioning, Code Provisioning using shell scripting
- Call Tracing and Analysis of call failure reasons using Agilent SS#7 Analyzer for improving GOS
- Automation of Reports generation using VB Programming/Excel Macros and Shell scripting
- Automation of CDR Collection Analysis and Reporting from all the NLD Switches
Engineer
Environment: UNIX, Oracle
Responsibilities
- Integration and Testing of C-DOT Digital Switching System and EWSD Switches
- Integration and Testing of Transmission Equipment’s
- Involved in testing of telecom Signaling protocols SS#7, V5.2, CAS and Transmission Protocols like STM1, STM4…
- Involved in Testing of Trunk lines like SS#7, CAS and Subscriber lines like PSTN and also involved in Access N/W testing
- Involved in User Acceptance Testing, Load Testing and Soak Testing of EWSD, CDOT Switches and transmission products like STM1, STM4/16, etc.
- Automation of Command file generation and nightly execution of the Command files using shell scripting
- Installation of Switches and its accessories Confidential Client site and providing Customer support
- Prototype Development and performing various testing of new Switches, Transmission Equipment’s, Access Networks and getting Approval from Technology provider
- Preparation of Compliance Reports for Customer Requirements
- Installation and Provisioning of subscribers lines and Maintenance of Switches
- Mentoring of team members and guiding them on technical challenges