Hadoop Administrator Resume

SUMMARY:

Overall 2 plus years of professional IT experience which includes proven experience in HadoopAdministration using Hortonworks(HDP) Distributions.
Experienced in installation, configuration, supporting and monitoring 50+nodeHadoopcluster using Hortonworks Ambari distributions.
Have experience in installing. configuring and administratingHadoopcluster for majorHadoopdistribution like HDP 2.2.0 and HDP 2.3
Experience in upgrading HortonworksHadoopHDP2.2.0 and Mapreduce 2.0 with YARN in Multi Clustered Node environment. knowledge onHadoopHDFS architecture and MRv1, MRv2 (YARN) framework.
Created Hive tables and loaded the data into tables and query data using HQL.
Managing & review ofHadooplog files.
Experienced in providing security toHadoopcluster with Kerberos.
Experience in using Pig, Hive, Sqoop, and Zookeeper
MonitorHadoopcluster using tools like Nagios, Ganglia and Ambari.
Investigated on new technologies like Spark to catch up with industry developments.
Exposure to NOSQL databases like HBASE, Cassandra and traditional and non - traditional databases likes RDBMS

TECHNICAL SKILLS INCLUDE:

Programming Languages: Core Java, C/C++, Performance Tuning & Capacity Monitoring, Data Security, Backup & Recovery, Standby/Failover Administration

HadoopDistributions: Hortonworks Distribution.

Virtualization in: VMware, EC2, Amazon Web Services.

Databases: Oracle 9i/10g, SQL,HBase, Cassandra.

Big Data Ecosystems: Hadoop, YARN, MapReduce, HDFS, Hive, Pig, Sqoop, Flume, Zookeeper, Oozie, Hbase, kafka, Spark,. Database-Backed Web Solutions

Operating Systems: Windows variants, Linux Ubuntu, Centos.

EXPERIENCE:

Hadoop Administrator

Confidential

Responsibilities:

Installed, maintained 35 node Hortonworks HDP 2.2Hadoopcluster
MonitorHadoopcluster though Ambari, implemented capacity scheduler to share the resources of the cluster for the MapReduce jobs given by users.
Coordinated with technical teams for installation of Hadoop and third related applications on systems.
Manage and reviewHadooplog files, file system management and monitoringHadoopcluster capacity planning.
Expertise in support activities including installation, configuration and successful deployment of changes across all environments.
Hands on experience in working with ecosystem like Hive, Pig, Sqoop, MapReduce, YARN, flume zookeeper. Strong knowledge ofHadoopand hive's analytical functions.
Importing and exporting data in HDFS using Sqoop.

Hadoop Administrator

Confidential, IL

Responsibilities:

Installed, Configured and Maintained ApacheHadoopclusters for application development and Hadooptools like Pig, Zookeeper and Sqoop
Wrote Pig scripts to load and aggregate the data.
Worked on analyzingHadoopcluster using different big data analytic tools including Pig, Hbase database and Sqoop.
Extensively involved in Installation and configuration of Hortonworks distributionHadoopNameNode, StandBy NameNode, ResourceManagers, NodeManagers and DataNodes.
Worked on installing cluster, adding and removing of DataNodes
Load and transform large sets of structured, semi structured and unstructured data.
Implemented Fair schedulers on the Job tracker to share the resources of the Cluster for the Map Reduce jobs given by the users.
Installed and configured Hive.
Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml andhadoop-env.xml based upon the job requirement.
Troubleshoot Map/Reduce jobs.
Generate datasets and load toHadoopecosystem
Involved in creating Hive tables, loading with data and writing Hive queries which will invoke and run MapReduce jobs in the backend.
Cluster co-ordination services through ZooKeeper.
Used Hive and Pig to analyze data from HDFS.
Balanced cluster after adding/removing nodes or major data cleanup.
On-call support for 24/7 for troubleshooting production issues and documenting all the processes.

We provide IT Staff Augmentation Services!

We'd love your feedback!

Resume Categories

Client Services

Job Seekers

Visa Sponsorship