Hadoop Admin Resume
OBJECTIVE:
To achieve a position in corporate world as deemed suitable to my skills, abilities and to hone my skills by working in a dynamic environment leading to both personal and organizational growth.
PROFESSIONAL SUMMARY:
- 4+ years of experience in Backup & Storage administration.
- 1.8 months of experience in administration of Big Data Technologies & Hadoop.
- Good knowledge on data warehousing and DBMS techniques.
- Hadoop cluster planning and implementation.
- Writing Oozie workflows and configuring Sqoop.
- Build Hadoop cluster using MapR Technologies and as well as using Hortonworks.
- Configuring, managing & tuning of HDFS with MapReduce (v1)/Yarn (v2) architecture with High - Availability.
- Excellent understanding / knowledge of Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, NameNode, Data Node, Yarn, HBase, Hive, Sqoop, Pig, Zookeeper and MapReduce.
- Adept at mapping client requirements, custom designing solutions & troubleshooting for complex software related issues.
TECHNICAL SKILLS:
Big data/Hadoop: HDFS, Map Reduce, YARN, HIVE, PIG, HBase, Sqoop, ZooKeeper, Spark, Oozie.
Backup Technologies: EMC Networker, Commvault, HPDP, Symantec Backup Exec.
Scripting Languages: Shell script.
Database: Oracle, MySQL.
Web Development Tools: HTML.
Distribution Management: MapR, Hortonworks, Apache Hadoop.
Operating Systems: RHEL (5,6,7), Ubuntu, Windows (2008,2012).
PROFESSIONAL EXPERIENCE:
Confidential
Hadoop Admin
Responsibilities:
- Installed and configured multi-nodes fully distributed Hadoop cluster of large number of nodes.
- Worked exclusively on Dev, Test and DR clusters with 950 nodes being the largest cluster.
- Addressing and Troubleshooting issues on daily basis in MapR environment.
- File system management and monitoring.
- Provided Hadoop, OS, Hardware optimizations.
- Installed and configured Hadoop ecosystem components like Map Reduce, Hive, Pig, Sqoop, HBase, Zookeeper and Oozie.
- Involved in testing HDFS, Hive, Pig and Map Reduce access for the new users.
- Cluster maintenance as well as creation and removal of nodes using MCS and CLI.
- Worked on setting up high availability for major production cluster and designed automatic failover control using zookeeper and quorum journal nodes.
- Implemented capacity scheduler to allocate fair amount of resources to small jobs.
- Configured Oozie for workflow automation and coordination.
- Implemented rack awareness topology on the Hadoop cluster.
- Importing and exporting structured data from different relational databases into HDFS and Hive using Sqoop.
- Configured Zookeeper to implement node coordination, in clustering support.
- Rebalancing the HDFS on MapR configured Hadoop Cluster.
- Allocating the name and space Quotas to the users in case of space problems.
- Managing MapR cluster performance issues.
- Backed up data on regular basis to a remote cluster using Mirroring technologies.
- Regular Commissioning and Decommissioning of nodes depending upon the amount of data.
- Maintaining Cluster in order to remain healthy and in optimal working condition.
- Handle the upgrades and Patch updates.
- Closely working with Development team on job failure issues.
- Working with Linux on Disk failure issues.
- Creating Maprusertickets and files as per the requirement for user access.
- Creating HDFS directories as per the requirement and mapping it to project volumes.
- Working with MapR support on critical issues.
- Migrating admin and data nodes from RHEL6 to RHEL7 with help of OS team
- Working experience with GIT HUB and Puppet
Environment: Hadoop 2.7, MapR 5.2, MapR 6.1, Spark1 & 2.2, Hive 2.1, Oozie 4.3.0, Pig 0.16, Hbase 1.7, RHEL 6&7.
Confidential
Consultant
Responsibilities:
- Installation and maintenance of backup/recovery client and server software in Unix (Solaris, HP-UX, AIX), Linux and Windows (Windows 2003/2008/ 2008 R2) operating systems.
- Configuring backup and recovery in VM machines, RMAN, MSSQL, NDMP and Exchange databases.
- Configuring VADP proxy server and VM client machines.
- Worked on Hadoop basic installation setup and Apache POC.
- Worked on Job tracker, Task Tracker, testing traditional data migration to Hadoop using connector jars.
- Configuring backup policies, media sets, disk volumes (AFTD) and tape libraries using NMC.
- Managing Disk volumes and worked in DD.
- Logging call with hardware and software vendor support personnel to efficiently resolve any issues with systems being maintained.
- Management and Administration of 5 master servers and over more than 8000 host machines of various operating systems spread across 70+ customers in North America region.
- Handled a dedicated customer for Commvault technology thereby with the same above backup & storage expertise.
- Regular follow ups of the Problem tickets with timely updates, finding out the RCA (root cause analysis) and sorting the issue by fixing it and seeing that it’s not re-occurring.
- At times of Risk observed in the issue frequently, raise a Change ticket immediately with a ECO (Emergency Change), getting it approved from the Business Unit heads and implementing the change to resolve the issue for a long fix.
- If ECO implementation takes time, then update it in the Risk Register & intimate the business about the challenges against the Risk.
Confidential
Senior Analyst
Responsibilities:
- Providing end to end support in EMC Networker backup and recovery
- Professional experience in installing and maintaining EMC Networker backup and recovery software and upgrading to latest technologies.
- Capacity planning based on the backup growth and implementing the plan based on the client requirement
- Identify opportunities for improving systems in terms of Backup Time Optimizing, Minimize Errors that increase resilience.
- Troubleshooting the backup failures of client machines at instant and thereby ensuring up to date backup data.
- Creating problem management tickets for reoccurring failures and providing a permanent fix and root cause for the failure to the client.
- Working on Problem management and Risk management, raising risk in critical situations and updating it in Risk register.
- Preparing SOP for EMC Networker modules backup.
- Planning, Implementing, and validating the on-going maintenance in backup and recovery.
- Worked in both Windows and Linux based backup servers.
- Performing DR drill periodically.