We provide IT Staff Augmentation Services!

Hadoop Consultant Resume

CA

SUMMARY:

  • Over 9+ years of professional IT experience this includes 3 plus years of experience in Big Data ecosystem &Administration.
  • Excellent Experience in Hadoop architecture and various components such as HDFS, YARN and MapReduce programming paradigm.
  • Involved in upgrading all the Hadoop components such as HDFS, MapReduce, Yarn, Impala, Hive, Pig, Sqoop, Flume, Oozie, HBase, Spark etc to the latest versions.
  • Extensive knowledge of all stages of the Software Development Life Cycle (SDLC) and QA Life Cycle (STLC).
  • Extremely familiar with Quality Assurance and Quality Control procedures and methodologies.
  • Extensive experience with Financial, Healthcare applications and analysis of its business, technical, and functional requirements.
  • Experience in Integration, Regression, Database, GUI, Connectivity and User Acceptance Testing (UAT).
  • Experienced in testing Client/Server, Multi - Tier, BigData and Web based applications as well as Cloud Applications.
  • Proficient in manual testing as well as in automated testing using tools such as Quality Center and Load Runner.
  • Good exposure in Web based Applications testing.
  • Experience in using Big data tools like Spark, Oozie workflows, Spark SQL
  • Proficient in using Bug tracking and Test management tool Quality Center.
  • Knowledge in C++, JAVA, SQL, Oracle, XML, UNIX Shell Scripting, Relational Database Management Systems, Cassandra, Python, MongoDB
  • Knowledge on Amazon Web Services (AWS) and Google cloud Platform.
  • Experience in Black Box Testing, End-End Testing and White Box Testing.
  • Extensive experience in execution of software quality assurance methodologies on cross platform applications.
  • Good exposure to software development methodologies and AGILE and Waterfall.
  • A self-starter, team player and have ability to learn new concepts quickly.

TECHNICAL SKILLS:

Testing Tools: Quality Center 8.5, 9.0, 9.2, Test Director, Load Runner, Quick Test Pro, Jira, Selenium, VSTS 2010, JMeter,TestNG

Databases: MS SQL Server 6.5/7.0, MS Access 2.0/7.0, Oracle 8i/9i, SQL server 2000/2005

GUI Tools: Visual Basic 6.0/5.0, Java/J2EE, JSP, SSRS, ETL, Selenium IDE

Languages: SQL, PL/SQL, Visual Basic, MS SQL Server, C/C++.

Scripting Languages: Python, Scala, UNIX Shell Scripting

Operating Systems: Windows NT/98/95/3.11/XP/2000, UNIX.

Web Technologies: ASP, HTML, DHTML, and XML, ASP.NET, C#.

Big Data Tools: Spark, Scala, Hue, Zeppelin, Alation, Open Stack Swift Object Store, Cassandra, HIVE, Spark-Sql, Grafana, Cloudera Manager

PROFESSIONAL SUMMARY:

Confidential, CA

HADOOP Consultant

  • Worked on setting up cluster for various services such as Hadoop, Spark, HBase, Kafka etc
  • Installation, configuration and Administration of HDP 2.x Hadoop cluster
  • Run the benchmark tools to test the cluster performance
  • Configure the Hadoop properties based on the benchmark result
  • Tuning the cluster based on the benchmark results
  • Monitoring System Metrics and logs for any problems
  • Installation and configuration of Hadoop ecosystem components like HBase, Hive, Pig, Sqoop, Spark, Zookeeper etc. as per requirement.
  • Provided support to users for diagnosing, reproducing and fixing Hadoop related issues.
  • Worked on HDP environments and took ownership of problem isolation and resolution, and whenever case arises do the bug reporting.
  • Ensure that critical user issues are addressed quickly and effectively.
  • Apply troubleshooting techniques to provide solutions to our user’s individual needs.
  • Troubleshoot, diagnose and potentially escalate user inquiries during their engineering and operations efforts.
  • Monitored clusters and services using Grafana
  • Investigate product related issues both for individual customers and for common trends that may arise.
  • Setting up new Hadoop users with HDFS maintenance and support. Keeping a track of Hadoop Cluster connectivity and security.
  • Involved in Change management process.
  • Involved in cleaning the nodes, edge nodes and master nodes for memory issues
  • Set up the alerts on the cluster for memory issues, health status, Disk latency

Technology: Cloudera Manaer,CDH 5.10, Hadoop, Yarn, Spark, Kafka, Hive, Pig, Sqoop, Ambari,Kerberos, Oracle, Java 8.0, Log4J, GIT, JIRA, Service-Now,Grafana

Confidential, CA

HADOOP Consultant

  • Implemented multiple CDH5& HDP Hadoop clusters on Redhat Enterprise Linux.
  • Responsible for building scalable distributed data solutions using Hadoop
  • Resource management of Hadoop Cluster in configuring the cluster with optimal parameter.
  • Performing day to day activities such as upgrades, applying patches, adding/removing nodes from the cluster for maintenance and capacity needs.
  • Responsible for monitoring the Hadoop cluster using Nagios.
  • Involved in upgrading all the Hadoop components such as HDFS, MapReduce, Yarn, Impala, Hive, Pig, Sqoop, Flume, Oozie, HBase, Spark etc to the latest versions.
  • Worked on implementing NOSQL database Cassandra cluster.
  • Worked on setting up of Hadoopecosystem&Kafka Cluster on AWS EC2 Instances.
  • Performed benchmarking of Kafka cluster to measure the performance and resource considerations and tuning the cluster for optimal performance.
  • Worked with tuning and configuring various parameters to maintain High Availability and consistency targets of the cluster.
  • Experience in enabling security to Kafka cluster using Kerberos authentication.
  • Implemented Apache Centri in Access Control and Authorizations.
  • Extensively worked on managing Kafka logs for traceability and debugging.
  • Worked on designing, implementing and managing Secure Authentication mechanism to Hadoop Cluster with Kerberos.
  • Working on Centri in enabling metadata management, governance and audit.
  • Performed backup of metadata at regular intervals and other maintenance activities such as balancing the cluster, and HDFS health check.
  • Responsible for maintaining the clusters in different environments.
  • Involved in upgradation process of the Hadoop cluster from CDH4 to CDH5.
  • Installed and configured Flume, Oozie on the Hadoop cluster.
  • Managing, defining and scheduling Jobs on a Hadoop cluster.
  • Worked on installing cluster, commissioning & decommissioning of datanode, namenode recovery, capacity planning, and slots configuration.
  • Worked with different file formats such as Text, Sequence files, Avro, ORC and Parquet.
  • Installed and configured Spark on Yarn.
  • Implemented indexing for logs from Oozie to Elastic Search.
  • Analysis on integrating Kibana with Elastic Search.
  • Monitoring the log flow from LM Proxy to Elastic Search-Head
  • Responsible to manage data coming from different sources.
  • Experienced on loading and transforming of large sets of structured, semi structured and unstructured data.
  • Experience in managing and reviewing Hadoop log files.
  • Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
  • Supported in setting up QA environment and updating configurations for implementing scripts.

Technology: Cloudera Manager, Ambari, Hadoop, Spark, Kafka, Storm, Hive, Pig, Sqoop, MapReduce, Kerberos, Ranger, Kibana, Talend, Oracle, Teradata, SAS, Tableau, Java 7.0, Log4J, Junit, SVN, JIRA.

Confidential, CA

Java/Automation Engineer

Responsibilities:

  • Managed a team of five QA's and assigned different tasks on the projects.
  • Co-ordinated with Development teams and Stakeholders in completing the deadlines of the project.
  • Analyzed the business requirements and System specifications to understand the process.
  • Involved in testing of Web services using JMeter.
  • Involved in reporting defects using JIRA.
  • Ensured team is focusing on automation along with manual testing.
  • Continuous Integration Jobs through Jenkins have been set up for automatic build as well deploy of the code.
  • Experience with GIT a versioning and integration tool for check out and check in of files.
  • Automation testing of the applications using BlueFin (Framework built on Selenium and Java).
  • Participated in project updates, meetings, defect review meetings and defect report meetings with Managers, Team Leads, and Developers.
  • Coordinating testing of software defects, enhancements, and upgrades with other application teams.
  • Analyzed JBOSS server error logs for different roles using SecureCRT, Putty.
  • Ability to multitask and work under pressure in a fast-paced environment
  • Strong interpersonal and analytical skills.
  • Performed testing on cloud applications to check the functionality of API’s.
  • Performed multi browser testing of the projects.
  • Conducted Regression testing on various releases of the application.
  • Performed Functionality, Security, Integration, Regression and Usability Testing.
  • Performed Load and Performance test using JMeter for all the web services.
  • Fetched data from HDFS file using PIG commands to verify the data with that of database.
  • Knowledge about KAFKA and ActiveMQ tools.

Environment: Java1.6, JBOSS, SQL Tools 1.5, Jenkins, GIT, SecureCRT, Windows 7.0, Jira 4.4, Selenium Web Driver, Maven, TestNG,DynaTrace.

Confidential, CA

Java/Automation Engineer

Responsibilities:

  • Managed a team of three quality engineers and worked closely with different development teams
  • Coordinated activities which enforce quality improvements and resolving conflicts among team members.
  • Co-ordinated with Development teams and StakeHolders in completing the deadlines of the project.
  • Analyzed the business requirements and System specifications to understand the process.
  • Involved in writing the Test Cases depending on the business requirement documents.
  • Involved in testing of Web services using SOAP UI.
  • Involved in reporting defects using JIRA.
  • Developed code coverage reports for the Java applications using JBOSS, JAVA and EMMA code coverage tool.
  • Experience with Perforce a versioning and integration tool for check out and check in of files.
  • Automation testing of the applications using QTP scripts.
  • Participated in project updates, meetings, defect review meetings and defect report meetings with Managers, Team Leads, and Developers.
  • Coordinating testing of software defects, enhancements, and upgrades with other application teams.
  • Worked with Rabbit tool for build and deployments of the code.
  • Analyzed JBOSS server error logs for different roles using Poderosa.
  • Ability to multitask and work under pressure in a fast-paced environment
  • Strong interpersonal and analytical skills
  • Performed multi browser testing of the projects.
  • Involved in testing the mobile applications.
  • Conducted Regression testing on various releases of the application.
  • Worked on VMWare cloud instances to test the functionality.
  • Performed Functionality, Security, Integration, Regression and Usability Testing.
  • Converted all P1, P2 and P3 test cases from QTP scripts to MAUI Automation Framework (an Confidential framework).
  • Worked on STAF Automation Framework using Selenium Web Driver, API Driver in converting P1, P2 and P3 test cases in Java.
  • Developed code in Java to execute SOAP requests and responses using XML and CSV files.
  • Implemented Data Providers for executing the regression test cases without using Database.

Environment: Java1.6, JBOSS, SQL Tools 1.5, Rabbit 2.0, Perforce Visual Client, Poderosa, Windows 7.0, Jira 4.4,Selenium Web Driver, API Driver, Cloud Applications.

Confidential, CA

Sr.QA Analyst

Responsibilities:

  • Analyzed the business requirements and System specifications to understand the process.
  • Involved in writing the Test Cases depending on the business requirement documents.
  • Used Visual Studio 2010 Ultimate for writing the test cases.
  • Performed manual testing in Agile Methodology.
  • Involved in executing the test cases in VSTS 2010.
  • Extensively involved in performing the backend testing of the application by writing and executing various SQL Queries to perform validity of the data.
  • Wrote SQL queries using Joins and sub queries to check the integrity of the data.
  • Involved in Creating and maintaining defects using Lab Management
  • Involved in reporting defects.
  • Developed scenarios for Load Test based on the user activity.
  • Involved in performance test using VSTS 2010 ULTIMATE.
  • Stress and Performance testing done on the websites by creating Virtual users for different user loads and times.
  • Done testing on different servers to check the daily jobs executed to transfer the data from one table to another.
  • Extensively involved in performing the backend testing of the application to develop and execute various SQL Queries, using SQL Server2005 to perform validity of the data.
  • Expertise in writing SQL queries using SQL functions, Joins, subqueries etc.
  • Understanding of database design and data structures (Oracle and SQL Server)
  • SQL development for data verification / validation.
  • Attended standup meetings as well as developer’s meetings to fix the bugs.
  • Participated in project updates, meetings, defect review meetings and defect report meetings with Managers, Team Leads, Developers and Business Stakeholders.
  • Coordinating testing of software defects, enhancements, and upgrades with users and other application teams.
  • Developed the test cases to test user interface and functionality of the application.
  • Done multi browser testing of the projects.
  • Involved in testing the mobile applications.
  • Conducted Regression testing on various releases of the application.
  • Performed Functionality, Security, Integration, Regression and Usability Testing.
  • Provide status reports to appropriate groups concerning test issues and progress.
  • Reaching the deadlines according to the requirements in Agile Methodology.
  • Training to the end users regarding the applications.

Environment: Microsoft Visual Studio 2010, SQL SERVER 2005, C#, ASP.NET, Windows 7.0

Confidential, WESTCHESTER, IL

Sr.QA Analyst

Responsibilities:

  • Analyzed the business requirements and System specifications to understand the process.
  • Involved in writing the Test Cases depending on the business requirement documents.
  • Used Visual Studio 2008 and 2010 for writing the test cases.
  • Performed manual testing in Agile Methodology.
  • Involved in executing the test cases in VSTS 2010.
  • Extensively involved in performing the backend testing of the application by writing and executing various SQL Queries to perform validity of the data.
  • Wrote SQL queries using Joins and sub queries to check the integrity of the data.
  • Involved in Creating and maintaining defects using Quality Center.
  • Involved in reporting defects using Quality Center.
  • Developed scenarios in Load Runner.
  • Involved in performance test using VSTS 2010 ULTIMATE.
  • Stress and Performance testing done on the websites by creating Virtual users and generated the reports.
  • Done testing on different servers to check the daily jobs executed to transfer the data from one table to another.
  • Extensively involved in performing the backend testing of the application to develop and execute various SQL Queries, using SQL Server2005 to perform validity of the data.
  • Understanding of database design and data structures (Oracle and SQL Server)
  • SQL development for data verification / validation.
  • Attended standup meetings as well as developer’s meetings to fix the bugs.
  • Participated in project updates, meetings, defect review meetings and defect report meetings with Managers, Team Leads, Developers and Business Stakeholders.
  • Coordinating testing of software defects, enhancements, and upgrades with users and other application teams.
  • Developed the test cases to test user interface and functionality of the application.
  • Tested the projects on IPhone, IPAD.
  • Done multi browser testing of the projects.
  • Involved in testing the mobile applications.
  • Conducted Regression testing on various releases of the application.
  • Performed Functionality, Security, Integration, Regression and Usability Testing.
  • Provide status reports to appropriate groups concerning test issues and progress.
  • Reaching the deadlines according to the requirements in Agile Methodology.

Environment: Microsoft Visual Studio 2010, SQL SERVER 2005, C#, ASP.NET, SNAG - IT, Windows 7.0

Confidential, CA

Sr.QA Tester

Responsibilities:

  • Analyzed the business requirements and System specifications to understand the process.
  • Involved in writing the Test Cases depending on the business requirement documents.
  • Used Quality center for writing the test cases.
  • Performed manual testing using Quality center.
  • Involved in executing the test cases in Quality center.
  • Extensively involved in performing the backend testing of the application to develop and execute various SQL Queries, using TOAD to perform validity of the data.
  • Wrote SQL queries to check the integrity of the data.
  • Involved in Creating and maintaining defects using Quality Center.
  • Involved in reporting defects using Quality Center.
  • Developed scenarios in Load Runner.
  • Involved in using Load Runner for Stress and Performance testing by creating Virtual users.
  • Run various jobs in UNIX using UNIX commands.
  • Wrote UNIX commands like FTP, GZIP, and GUNZIP for file transfers.
  • Involved in working with files in UNIX.
  • Prepared weekly defect reports and weekly test metrics.
  • Attended team meetings as well as developer’s meetings.
  • Participated in project updates meetings, defect review meetings and defect report meetings.
  • Coordinating testing of software defects, enhancements, and upgrades with users and other application teams.
  • Performed Functionality, Security, Integration, Regression and Usability Testing.
  • Provide status reports to appropriate groups concerning test issues and progress.

Environment: Quality Center, Load Runner, Oracle 9i TOAD SQL, PL/SQL, HTML, Java, UNIX.

Confidential, Kentucky

Sr.QA Tester

Responsibilities:

  • Involved in preparing test plans based on Business Requirements Documents (BRD).
  • Developed the test cases to test user interface and functionality of the application.
  • Tests were planned and managed using Quality Center and performed Manual Testing.
  • Performed Functional, Integration, System, Regression testing..
  • Tracked and reported bugs using Quality Center.
  • Performed database validation by executing SQL queries Interacted with Developers as needed to isolate the main cause of defects and performed SQL backend testing.
  • Conducted Regression testing on various releases of the application.

Environment: Quality Center9.2, .NET Framework, ASP.NET, VB.NET, VBScript, JavaScript, HTML, Shell Scripting, XML, SQL Server 2000, UNIX.

Hire Now