We provide IT Staff Augmentation Services!

Hadoop Admin Resume

4.00/5 (Submit Your Rating)

SUMMARY:

  • Overall 13 years of IT experience and from past 2 years working on Hadoop Administration & Big Data Technologies.
  • Experience with complete Software Design Lifecycle including design, development, testing and implementation of moderate to advanced complex systems.
  • Hands on experience in installation, configuration, supporting and managing Hadoop Clusters using Horton works, Cloudera.
  • Hadoop Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
  • Design Big Data solutions for traditional enterprise businesses.
  • Used Network Monitoring Daemons like Nagios, ganglia.
  • Backup configuration and Recovery from a NameNode failure.
  • Excellent command in creating Backups & Recovery and Disaster recovery procedures and Implementing BACKUP and RECOVERY strategies for off - line and on-line Backups.
  • Involved in bench marking Hadoop cluster file systems with various batch jobs and workloads.
  • Making Hadoop cluster ready for development team working on POCs.
  • Experience in minor and major upgrades of Hadoop and Hadoop eco system
  • Experience monitoring and troubleshooting issues with Linux memory, CPU, OS, storage and network
  • Hands on experience in analyzing Log files for Hadoop and eco system services and finding root cause.
  • Experience on Commissioning, Decommissioning, Balancing, and Managing Nodes and tuning server for optimal performance of the cluster.
  • As an admin involved in Cluster maintenance, trouble shooting, Monitoring and followed proper backup& Recovery strategies.
  • Good Experience in setting up the Linux environments, Password less SSH, Creating file systems, disabling firewalls, swappiness, Selinux and installing Java.
  • Good Experience in Planning, Installing and Configuring Hadoop Cluster in Cloudera and Confidential Distributions.
  • Installing and configuring Hadoop eco system like pig, hive.
  • Hands on experience in Installing, Configuring and managing the Hue and HCatalog.
  • Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.
  • Experience in importing and exporting the logs using Flume from outside sources using different flume agents.
  • Optimizing performance of Hbase/Hive/Pig jobs.
  • Hands on experience in Zookeeper and ZKFC in managing and configuring in NameNode failure scenarios
  • Experience in deploying Hadoop 2.0(YARN).
  • Effective problem solving skills and outstanding interpersonal skills.
  • Ability to work independently as well as within a team environment.
  • Driven to meet deadlines. Ability to learn and use new technologies quickly.
  • Excellent communication, presentation and interpersonal skills.

EXPERIENCE:

Confidential

Hadoop Admin

Responsibilities:

  • Responsible for Cluster maintenance, Monitoring, commissioning and decommissioning Data nodes, Troubleshooting, Manage and review data backups, Manage & review log files.
  • Changing the configurations based on the requirements of the users for the better performance of the jobs
  • Automated deployments by writing Ansible playbooks
  • Tuning Hadoop cluster for multi-tenancy and optimal resource utilization, performance and high availability
  • Troubleshooting Hadoop/Yarn/MapReduce
  • Experience tuning and troubleshooting MapReduce and general YARN jobs for optimal performance, both on the Command Line as well as via provided UI's.
  • Providing High Availability NameNodes using Quorum Journal Managers and Zookeeper Failover Controllers Extensive knowledge of various configurations parameters available in mapred-size.xml and yarn-site.xml and locations of various log files Usage of JobHistoryServer (and newer App Timeline Server) UI & API to monitor cluster usage and overall job health,forensics etc
  • Implemented Dominant Resource Calculator and capacity scheduler queues to enhance the performance of the cluster
  • Experience with Hive, HiveServer2, and the Hive Metastore, tuning and optimizing. Knowledge of Hive SQL and SQL syntax and usage (selects, inserts, joins). Bonus points for experience with Tez, and newer file formats such as ORC (Optimized Row Columnar) and why they may be superior to Text, Sequence and RC formats, but also what are some tradeoffs
  • Using Ambari administering large Hadoop clusters (> 100 to > 1000's of physical nodes) Ambari REST API for automating common tasks along with the monitoring of the over all cluster health.
  • Oozie knowledge and experience developing, deploying Oozie workflows, including coordinator flows and Oozie actions such as the HiveAction
  • Deploying and maintaining a zookeeper ensemble within and without Hadoop
  • Experience using Sqoop to transfer data into and out of HDFS & RDBMS
  • Experience tuning & maintaining HBase
  • Adding and removing Data Nodes and Services using Ambari

Confidential

Hadoop Admin

Responsibilities:

  • Worked as an admin in Confidential Hadoop distribution for 4 clusters ranges from POC to PROD.
  • Responsible for Cluster maintenance, Monitoring, commissioning and decommissioning Data nodes, Troubleshooting, Manage and review data backups, Manage & review log files.
  • Day to day responsibilities includes solving developer issues, providing access to new users and providing instant solutions to reduce the impact and documenting the same and preventing future issues.
  • Experienced on adding/installation of new components and removal of them through Ambari.
  • Monitoring systems and services through Ambari dashboard to make the clusters available for the business.
  • Architecture design and implementation of deployment, configuration management, backup, and disaster recovery systems and procedures.
  • Hand on experience on cluster up gradation and patch upgrade without any data loss and with proper backup plans.
  • Changing the configurations based on the requirements of the users for the better performance of the jobs.
  • Experienced in Ambari-alerts configuration for various components and managing the alerts.
  • Provided security and authentication with ranger where ranger admin provides administration and user sync adds the new users to the cluster.
  • Good troubleshooting skills on Hue, which provides GUI for developers/business users for day to day activities.
  • Developed MapReduce programs to cleanse the data in HDFS obtained from heterogeneous data sources to make it suitable for ingestion into Hive schema for analysis.
  • Implemented complex MapReduce programs to perform joins on the Map side using distributed cache
  • Implemented NameNode HA in all environment to provide high availability of clusters.
  • Capacity scheduler implementation in all environments to provide balancing on resources allocation.
  • Create queues and allocated the clusters resources to provide the priority for jobs.
  • Experienced in Setting up the project and volume setups for the new projects.
  • Implementing the SFTP for the projects to transfer data from External servers to servers.
  • Experienced in managing and reviewing log files.
  • Working experience on maintaining MySQL databases creation and setting up the users and maintain the backup of cluster metadata databases with cron jobs.
  • Setting up MySQL master and slave replications and helping business applications to maintain their data in MySQL Servers.
  • Helping the users in production deployments throughout the process.
  • Experienced in production support which involves solving the user incidents varies from sev1 to sev5.
  • Managed and reviewed Log files as a part of administration for troubleshooting purposes. Communicate and escalate issues appropriately.
  • As an admin followed standard Back up policies to make sure the high availability of cluster.
  • Involved in Analyzing system failures, identifying root causes, and recommended course of actions.
  • Documented the systems processes and procedures for future references.
  • Worked with systems engineering team to plan and deploy new environments and expand existing clusters.
  • Monitored multiple clusters environments using AMBRI Alerts, Metrics and Nagios.

Environment: Hadoop, Hdfs, MapReduce, Hive, Pig, Flume, Oozie, Sqoop, Eclipse, Confidential, Ambari. Ansible

Confidential

TFS and QC Admin

Responsibilities:

  • Developing and executing software test plans in order to identify software problems and their causes.
  • Organizing, documenting, maintaining and executing automated test scripts and
  • Performing unit test and system test activities as required.
  • Exporting Test cases from Quality Center to MTM using MTM migrator Tool and maintaining them
  • Designed & Enhance QTP Hybrid Driven Framework for the regression testing using modular approach undertaken with using User defined function library, shared object repository, Static data file, Calendar sheet (Master Datasheet), dynamic datasheet and user define result sheet etc.
  • Designed and developed automation test scripts using Quick test Professional and managed testing activities using Mercury Quality Center.
  • Design and Implementation of the Automation framework, formulating the driver script and the requisites
  • Designed Functions Library, Functions, Subroutine's, Common functions, Utilities functions, and Regular Expressions and Environmental variables using QTP in VB scripts.
  • Executed automated test scripts, analyzed the results and reported bugs in Quality center.
  • Modified and Executed automated and manual test scripts for different modules using QTP.
  • Followed a Hybrid framework to adopt key word driven, data-driven and script modularity methods.
  • Created repeatable user defined functions and stored them as function libraries (.vbs files)
  • Development in Agile environment and following SCRUM methodology
  • Doing the formal validation per the FDA regulations
  • Testing the EncoreAnywhere website per the FDA regulations for Transferring Rx to the device and back to the website
  • Verifying the integration of the data card utilities with EncoreAnywhere
  • Validating the Rx generated on the website using the EDIU tool
  • Generation and review of the test plans and procedures, including automation assessment
  • Independent analysis of technical details and definition of feature test strategy, provide estimates for efforts
  • QA for a distributed enterprise web server application ideally familiar with documentation practices of a regulated industry.
  • Collaboration with the development team to ensure appropriate coverage

Environment: QTP 11.0, Visual Studio 2010, Coded UI, TFS, MTM, Sql server 2008 and Quality Center

Confidential

QA Lead/Scrum Master

Responsibilities:

  • Reviewing the work that’s completed and not completed in Sprint Review Meetings
  • Making continuous process improvements via Sprint Retrospective
  • Prepare the Sprint Backlog that details the time it will take to do that work, with the entire team
  • Analyzing and writing test cases from user stories
  • Globalization testing done for different time zones and various languages
  • Regression testing throughout the 3 week sprint
  • Compatibility testing on different platforms and various browsers
  • Automating manual test cases and maintaining the scripts using SoapUI
  • Verifying Soap responses XML by making soap calls using WSDL files
  • Enhancing the automation test cases using Groovy scripts by grabbing runtime values from the soap responses
  • Performing Acceptance testing for the shippable units making sure to ship a quality product

Environment: SoapUI3.6.1, Version One, SharePoint2010, SQL Server2008, Oracle10g, Java, .NET, AccuRev4.8, DevTrack

Confidential

QA Lead

Responsibilities:

  • Organizing, documenting, maintaining and executing automated test scripts using Test partner
  • Perform unit test and system test activities as required.
  • Analyzed business requirements, functional specifications and system requirements.
  • Generating and implementing templates for Test Plan, Test Cases, Test Scripts, Business Analysis, Test Defect Log, Test Case Checklist etc.
  • Involved in analyzing and writing test plan in accordance with business requirements
  • Responsible for identifying the functional test cases for Regression Testing, batch testing and automated these scripts
  • System Testing, Installation testing on the release candidate (version planned for release)
  • Electronic claims processing via ZirMed’s Claims Management solution
  • Managing software builds and updating internal test systems
  • Building update programs, including database scripts, for execution Confidential customer sites
  • Writing Tech Notes for each Version of the Installation
  • Verifying and updating the DB scripts involved in each release
  • Writing installation instructions using Install shield (involves updating class paths, updating the files)
  • Installing new systems Confidential customer locations (via remote connection)
  • Documenting and troubleshooting installation configurations and settings
  • Maintaining written procedures for all configuration activities
  • Submitting source code to escrow

Environment: Test partner 6.2, Serena Team Track, PVCVS Tracker, SQL Server 2000/2005/2008 , SQL server management Studio, Eclipse, Java, .NET, Install shield 11.5

Confidential, Pittsburgh, PA

QA Project Lead

Responsibilities:

  • Analyzing Requirements for HCA by actively participating in the deep dive sessions
  • Preparing Test Strategy document per the analysis by leading the Offshore Team
  • Ensure all the deliverables are per the schedule
  • Prepared Project Plan using Microsoft Project Plan
  • Preparing Quality Acceptance Level for the product discussing with client
  • Coordinating with offshore for Test cases and Knowledge Transfer of the Product
  • Preparing Test Cases for new Requirements and updating existing with enhancements
  • Involved in review of Functional and Technical requirement documents to understand the functionalities of the project.
  • Interacting with Business users, stakeholders, Subject Matter Experts and Business Analysts to understand requirements and defined the scope of the project.
  • Created and managed project templates, use case templates, requirement types and tractability matrix.
  • Scheduled meetings with developers, system analyst and testers to collaborate resource allocation and project completion.
  • Conducted meetings with Management, SME, users and other stakeholders for open and pending issues.
  • Test Effort Estimation, Identification and Allocation of Resources and Coordination with the team and Management.
  • Creation & Evaluation of Test plan (Test methodology, Test Strategy), Testing (Matrix) and Conduct Project review meetings with the Test team.
  • Preparation of Readiness reports and QA related documents for each release.
  • Execution of test cases/Defect Logging/ review & verification in Quality Center 9.2
  • Responsible for Smoke test automation for the new builds using Q TP 9.2
  • Developed functions using VBScript for Automation using Quick Test Pro
  • Preparing Anomaly reports from Quality Center and timely reporting to client
  • Developing Business Scenarios to help Clients Execute the User Acceptance Testing
  • Coordinating testing efforts with the Clients UAT Testing team and Knowledge Transfer to help them perform the Business User Acceptance Testing

Environment: Quality Center9.2, QTP9.2, Appscan, IBM Process Server, Message Broker, Xengine, Edifecs, Java, Toad9.0.1, PL/SQL Developer, Oracle9i, Apache2.0.59,Windows Vista and 2008.

Confidential

QA Analyst

Responsibilities:

  • Analyzed business requirements, functional specifications and system requirements.
  • Preparing Test Cases for new Requirements and updating existing with enhancements
  • Importing Test Cases from MS word and Excel to Test Director using Add-ins
  • Responsible for Smoke test automation for the new builds using Quick Test Professional
  • Verifying the functionality using Black Box Techniques on various scenarios (Platforms)
  • Installing/Uninstalling and upgrading the product on different hardware platforms and software configurations for the new builds
  • Verifying the data and behavior of the product for Pre-Upgrade and Post-Upgrade Scenarios
  • Responsible for identifying the functional test cases for Regression Testing and automated these scripts using Quick Test Pro
  • Developed functions using VBScript for Automation using Quick Test Pro
  • Verifying HIPAA rules and regulations applicable for the product
  • Performed web service testing on Apache Tomcat server, which utilizes SOAP calls to applications servers.
  • Database Testing done on SQLServer2005/2000 and Oracle and MS-Access
  • Logging and tracking Defects in Clear Quest, verifying the qa ready CQ items and closing
  • Validating Log Files logging into Linux Machines
  • Backend Testing done on Red Hat Linux 3.0 using Oracle 10g and Oracle 9i
  • Co-ordination with peers for executing the interdependent test Scenarios

Environment: QTP, Quality Center, Clear Quest, .NET 2005, Web Sphere, Jetty, JRun, J2EE, Crystal Reports, Oracle, TOAD, SQLServer 2000, Windows.

Confidential

QA Analyst

Responsibilities:

  • Analyzed business requirements, functional specifications and system requirements.
  • Preparing Test Cases for new Requirements and updating existing with enhancements
  • Importing Test Cases from MS word and Excel to Quality Center 9.0 using Add-ins
  • Moving QTP 9.0 Scripts to QC 9.0 and associate the appropriate Repositories
  • Upgrading QTP 9.0 Scripts to QTP9.2
  • Responsible for Smoke test automation for the new builds using Quick Test Professional 9.0
  • Verifying the functionality using Black Box Techniques on various scenarios (Platforms)
  • Installing/Uninstalling and upgrading the product on different hardware platforms and software configurations for the new builds
  • Verifying the data and behavior of the product for Pre-Upgrade and Post-Upgrade Scenarios
  • Responsible for identifying the functional test cases for Regression Testing and automated these scripts using Quick Test Pro
  • Developed functions using VBScript for Automation using Quick Test Pro
  • Monitor and Resolve the Escalations and Define the Communication Plan.
  • Regular Interaction with Development team and Business Analyst.
  • Verification of Order Flow & TMS transactions in UNIX/Mainframe Environments.
  • Verification of Fix messages in logs from Exchange generated during execution.
  • Verification of all Order Types, Order conditions/TIF, Price Format supported by Exchange.
  • Verification of New Functionality & Regression for Global Merge (QA /UAT environment - executed every drop)
  • Performed web service testing on Apache Tomcat server, which utilizes SOAP calls to applications servers.
  • Database Testing done on SQLServer2005/2000 and Oracle 10g/9i and MS-Access
  • Logging and tracking Defects in Clear Quest, verifying the qa ready CQ items and closing
  • Validating Log Files logging into Linux Machines
  • Backend Testing done on Red Hat Linux 3.0 using Oracle 10g and Oracle 9i
  • Co-ordination with peers for executing the interdependent test Scenarios

Environment: QTP, Quality Center, Clear Quest, .NET 2005, Web Sphere 5.1.x, Jetty5.1.3, JRun, J2EE, Crystal Reports 11,Oracle 9i, TOAD, SQLServer 2005/2000, MS-Access, Windows 2003/2000 Server/XP with SP2, Red Hat Linux3.0, IIS 6.0

Confidential

QA Analyst

Responsibilities:

  • Analyzed business requirements, functional specifications and system requirements.
  • Generating and implementing templates for Test Plan, Test Cases, Test Scripts, Business Analysis, Test Defect Log, Test Case Checklist etc.
  • Involved in analyzing and writing test plan in accordance with business requirements
  • Responsible for identifying the functional test cases for Regression Testing and automated these scripts
  • Extensively used SQL Queries to perform Back End Testing also used TOAD.
  • Involved in preparing the Test scenario’s, Test cases for complete application Testing.
  • Performed data driven test for multiple scenarios with different data types.
  • Testing the Web Services using the bind variables and validating the values by querying the database
  • Prepared the Test Cases based on the functional specifications.
  • Interacted with developers and Business analysts for analyzing the requirements.
  • Extensive usage of Shell Script on Unix to Automate Certain Process to Start and Stop the Process on Unix
  • Used Test Director to report defects and test results.

Environment: Java, Swings, J2EE, oracle 9i, TOAD, Windows 2000Server/XP, Solaris 5.1a, UNIX shell scripts, IIS 5.0.

We'd love your feedback!