We provide IT Staff Augmentation Services!

Hadoop Administrator Resume

2.00/5 (Submit Your Rating)

SUMMARY

  • 2 years experience in installation and configuration of Hadoop ecosystem like Hdfs, Hive, Impala, Yarn, Sqoop, Flume, Oozie and Kafka
  • Hands on experience in installation, configuration, supporting and managing Hadoop Clusters using Cloudera CDH 5 .
  • Hadoop Cluster capacity planning, performance tuning, cluster Monitoring, Troubleshooting.
  • Using cloudera manager to manage Hadoop eco system
  • Adding/removing new nodes to an existing hadoop cluster.
  • Backup configuration and Recovery from a NameNode failure.
  • Decommissioning and commissioning the Node on running hadoop cluster.
  • Installation of various Hadoop Ecosystems and Hadoop Daemons.
  • Installation and configuration of Sqoop and Flume.
  • Involved in bench marking using Teragen, Terasort & Teravalidate to determine cluster capacity
  • Experience monitoring and troubleshooting issues
  • Hands on experience in analyzing Log files for Hadoop and eco system services and finding root cause.
  • Experience on Commissioning, Decommissioning, Balancing, and Managing Nodes and tuning server for optimal performance of the cluster.
  • Installing and configuring hadoop eco system like sqoop, hive.
  • Knowledge on zookeeper.
  • Knowledge in Apache Sentry for hdfs files, impala and Hive Databases security.
  • Experience in importing and exporting the data using Sqoop from HDFS.
  • Optimizing performance of Hive
  • Scheduling all Hadoop, hive, sqoop jobs using Oozie.

PROFESSIONAL EXPERIENCE

Hadoop Administrator

Confidential

Responsibilities:

  • Responsible for implementation and support of the Enterprise Hadoop environment.
  • Involves designing, capacity arrangement, cluster set up, performance fine - tuning, monitoring, structure planning, scaling and administration. working closely with infrastructure, network, database, business intelligence and application teams to ensure business applications are highly available and performing within agreed on service levels.
  • Need to implement concepts of Hadoop eco system such as YARN, MapReduce, HDFS, HBase, Zookeeper, Pig and Hive.flume,sqoop Accountable for storage, performance tuning and volume management of Hadoop clusters and MapReduce routines.
  • Managing and analyzing Hadoop log files.
  • File system management and monitoring.
  • Develop and document best practices creating SOPs.
  • Responsible for the new and existing administration of Hadoop infrastructure.
  • Involved in start to end process of Hadoop cluster deployment .

Hadoop Administrator

Confidential

Responsibilities:

  • Involved in start to end process of Hadoop cluster deployment .
  • Responsible for Cluster maintenance, commissioning and decommissioning Data nodes, Cluster Monitoring, Troubleshooting, Manage and review data backups, Manage & review Hadoop log files.
  • Monitoring systems and services, architecture design and implementation of hadoop deployment, configuration management, backup, and disaster recovery systems and procedures.
  • Configured various property files with cloudera manager
  • Importing and exporting data into HDFS using Sqoop.
  • Experienced in define being job flows with Oozie.
  • Loading log data directly into HDFS using Flume.
  • Experienced in managing and reviewing Hadoop log files.
  • Installation of various Hadoop Ecosystems and Hadoop Daemons.
  • Installation and configuration of Sqoop and Flume
  • Managed and reviewed Hadoop Log files as a part of administration for troubleshooting purposes. Communicate and escalate issues appropriately.
  • Involved in Analyzing system failures, identifying root causes, and recommended course of actions.
  • Documented the systems processes and procedures for future references.
  • Worked with systems engineering team to plan and deploy new hadoop environments and expand existing hadoop clusters.
  • Monitored multiple hadoop clusters environments using Ganglia and Nagios. Monitored workload, job performance and capacity planning using Cloudera Manager.
  • Installed and configured Flume, Hive, Sqoop and Oozie on the hadoop cluster.
  • Involved in Installing and configuring Kerberos for the authentication of users and hadoop daemons.

Head, Application Service Support

Confidential

Responsibilities:

  • In charge of creation and maintaining the App Support Knowledge base
  • Use of SQL to query, maintain and update the company database
  • Quickly and effectively solve customer technical issues
  • Training of new employees
  • Support of in-house programs, such as MLH and ADC.
  • Use of SQL to create Stored Procedures that send hourly emails about issues in the system
  • In charge of supporting the intact financial systems
  • In charge of the creation of a suite of in house tools that are utilized by our business teams.
  • Resolved and escalated Issues by communicating and working closely with internal business partners. Improved service level score from 89% to 98% within 2 years.

We'd love your feedback!