We provide IT Staff Augmentation Services!

Hadoop Admin Resume

2.00/5 (Submit Your Rating)

OBJECTIVE:

To achieve a position in corporate world as deemed suitable to my skills, abilities and to hone my skills by working in a dynamic environment leading to both personal and organizational growth.

PROFESSIONAL SUMMARY:

  • 4+ years of experience in Backup & Storage administration.
  • 1.8 months of experience in administration of Big Data Technologies & Hadoop.
  • Good knowledge on data warehousing and DBMS techniques.
  • Hadoop cluster planning and implementation.
  • Writing Oozie workflows and configuring Sqoop.
  • Build Hadoop cluster using MapR Technologies and as well as using Hortonworks.
  • Configuring, managing & tuning of HDFS with MapReduce (v1)/Yarn (v2) architecture with High - Availability.
  • Excellent understanding / knowledge of Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, NameNode, Data Node, Yarn, HBase, Hive, Sqoop, Pig, Zookeeper and MapReduce.
  • Adept at mapping client requirements, custom designing solutions & troubleshooting for complex software related issues.

TECHNICAL SKILLS:

Big data/Hadoop: HDFS, Map Reduce, YARN, HIVE, PIG, HBase, Sqoop, ZooKeeper, Spark, Oozie.

Backup Technologies: EMC Networker, Commvault, HPDP, Symantec Backup Exec.

Scripting Languages: Shell script.

Database: Oracle, MySQL.

Web Development Tools: HTML.

Distribution Management: MapR, Hortonworks, Apache Hadoop.

Operating Systems: RHEL (5,6,7), Ubuntu, Windows (2008,2012).

PROFESSIONAL EXPERIENCE:

Confidential

Hadoop Admin

Responsibilities:

  • Installed and configured multi-nodes fully distributed Hadoop cluster of large number of nodes.
  • Worked exclusively on Dev, Test and DR clusters with 950 nodes being the largest cluster.
  • Addressing and Troubleshooting issues on daily basis in MapR environment.
  • File system management and monitoring.
  • Provided Hadoop, OS, Hardware optimizations.
  • Installed and configured Hadoop ecosystem components like Map Reduce, Hive, Pig, Sqoop, HBase, Zookeeper and Oozie.
  • Involved in testing HDFS, Hive, Pig and Map Reduce access for the new users.
  • Cluster maintenance as well as creation and removal of nodes using MCS and CLI.
  • Worked on setting up high availability for major production cluster and designed automatic failover control using zookeeper and quorum journal nodes.
  • Implemented capacity scheduler to allocate fair amount of resources to small jobs.
  • Configured Oozie for workflow automation and coordination.
  • Implemented rack awareness topology on the Hadoop cluster.
  • Importing and exporting structured data from different relational databases into HDFS and Hive using Sqoop.
  • Configured Zookeeper to implement node coordination, in clustering support.
  • Rebalancing the HDFS on MapR configured Hadoop Cluster.
  • Allocating the name and space Quotas to the users in case of space problems.
  • Managing MapR cluster performance issues.
  • Backed up data on regular basis to a remote cluster using Mirroring technologies.
  • Regular Commissioning and Decommissioning of nodes depending upon the amount of data.
  • Maintaining Cluster in order to remain healthy and in optimal working condition.
  • Handle the upgrades and Patch updates.
  • Closely working with Development team on job failure issues.
  • Working with Linux on Disk failure issues.
  • Creating Maprusertickets and files as per the requirement for user access.
  • Creating HDFS directories as per the requirement and mapping it to project volumes.
  • Working with MapR support on critical issues.
  • Migrating admin and data nodes from RHEL6 to RHEL7 with help of OS team
  • Working experience with GIT HUB and Puppet

Environment: Hadoop 2.7, MapR 5.2, MapR 6.1, Spark1 & 2.2, Hive 2.1, Oozie 4.3.0, Pig 0.16, Hbase 1.7, RHEL 6&7.

Confidential

Consultant

Responsibilities:

  • Installation and maintenance of backup/recovery client and server software in Unix (Solaris, HP-UX, AIX), Linux and Windows (Windows 2003/2008/ 2008 R2) operating systems.
  • Configuring backup and recovery in VM machines, RMAN, MSSQL, NDMP and Exchange databases.
  • Configuring VADP proxy server and VM client machines.
  • Worked on Hadoop basic installation setup and Apache POC.
  • Worked on Job tracker, Task Tracker, testing traditional data migration to Hadoop using connector jars.
  • Configuring backup policies, media sets, disk volumes (AFTD) and tape libraries using NMC.
  • Managing Disk volumes and worked in DD.
  • Logging call with hardware and software vendor support personnel to efficiently resolve any issues with systems being maintained.
  • Management and Administration of 5 master servers and over more than 8000 host machines of various operating systems spread across 70+ customers in North America region.
  • Handled a dedicated customer for Commvault technology thereby with the same above backup & storage expertise.
  • Regular follow ups of the Problem tickets with timely updates, finding out the RCA (root cause analysis) and sorting the issue by fixing it and seeing that it’s not re-occurring.
  • At times of Risk observed in the issue frequently, raise a Change ticket immediately with a ECO (Emergency Change), getting it approved from the Business Unit heads and implementing the change to resolve the issue for a long fix.
  • If ECO implementation takes time, then update it in the Risk Register & intimate the business about the challenges against the Risk.

Confidential

Senior Analyst

Responsibilities:

  • Providing end to end support in EMC Networker backup and recovery
  • Professional experience in installing and maintaining EMC Networker backup and recovery software and upgrading to latest technologies.
  • Capacity planning based on the backup growth and implementing the plan based on the client requirement
  • Identify opportunities for improving systems in terms of Backup Time Optimizing, Minimize Errors that increase resilience.
  • Troubleshooting the backup failures of client machines at instant and thereby ensuring up to date backup data.
  • Creating problem management tickets for reoccurring failures and providing a permanent fix and root cause for the failure to the client.
  • Working on Problem management and Risk management, raising risk in critical situations and updating it in Risk register.
  • Preparing SOP for EMC Networker modules backup.
  • Planning, Implementing, and validating the on-going maintenance in backup and recovery.
  • Worked in both Windows and Linux based backup servers.
  • Performing DR drill periodically.

We'd love your feedback!