We provide IT Staff Augmentation Services!

Hadoop Administrator Resume

2.00/5 (Submit Your Rating)

Atlanta, GA

SUMMARY

  • 7+years of IT experience including Hadoop Administration
  • Proven expertise in Hadoop Projects Implementation and Configuring Systems.
  • Excellent Experience in Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, NameNode, Data Node and MapReduce.
  • Hands on experience in installing, configuring, and using Hadoop ecosystem components like MapReduce, Hive, Pig, Sqoop, HBase, ZooKeeper and Oozie
  • Understanding of Hadoop 2.X architecture, Yarn Framework, MapReduces, and HDFS Federation
  • Exposure to "Productionalizing" Hadoop applications (i.e. administration, configuration, management, monitoring, debugging, and performance tuning)
  • Expertise in High Availability Configurations for Mission Critical Applications
  • Experience in System Architecture and Infrastructure Planning
  • Install/Configure/Evaluate System Backup, and Monitoring Software
  • Cluster configuration and data transfer(distcp and hftp), inter and intra cluster data transfer.
  • Excellent analytical, problem solving, communication and interpersonal skills with ability to interact with individuals at all levels and work in a team as well as independently
  • Good understanding of network protocols, routing, switching equipment, Networking Operating Systems, Servers and overall different network architectures.
  • Have handled issues related to cluster start, node failures and several java specific errors on the system.
  • Experienced of Hadoop 1.x and Hadoop 2.X installation, configuration and Hadoop Clients online as well as using package implementation.
  • Capacity Planning SqoopHands of experience in various aspects of Database Systems as well as installing, configuring & maintaining the Hadoop clusters.
  • Adept in Hadoop cluster expansion and planning.
  • Have experience in architecture, design and development of Big Data platform including large clusters, Hadoop ecosystem projects and custom map - reduce user management, cluster management, Setup NOSQL databases, Security design and Implementation
  • Installing and configuring Hadoop ecosystem like Pig, Hive.
  • Hands on experience in Installing, Configuring and managing the Hue and HCatalog.
  • Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.
  • Experienced of Service Monitoring, Service and Log Management, Auditing and Alerts, Hadoop Platform Security, and Configuring Kerberos
  • Experience in importing and exporting the logs using Flume.
  • Optimizing performance of Hbase/Hive/Pig jobs.

TECHNICAL SKILLS

Linux/ Unix: RedHat, CentOS, Ubuntu

SQL: MySQL 4/5/6

Core Java: JDK 7/8

Hadoop: Cloudera, Apache

Storage: CIFS/NFS, LUN, RAID

BigData Ecosystem: Hadoop, MapReduce, HDFS, Sqoop, Hive, Pig, Hbase, Sqoop, Flume

Java: Core, JDBC

Tools: IDE:: JIRA, PuTTy, WinSCP, Apache Tomcat.

Database: HBase and Sql server

PROFESSIONAL EXPERIENCE

Confidential, Atlanta, GA

Hadoop Administrator

Responsibilities:

  • Install, Configure and maintain Single-node and Multi-node cluster Hadoop cluster.
  • Hands on Resource management and HDFS federation impletation.
  • Setup cluster environment for Highly Available systems.
  • Hadoop cluster configuration & deployment to integrate with systems hardware in the data center.
  • Troubleshooting, diagnosing, tuning, and solving Hadoop issues
  • Monitor a Hadoop cluster and execute routine administration procedures.
  • Managing hadoop Services like Namenode, Datanode, Jobtracker, Tasktracker etc.
  • Installed Apache Hadoop 2.5.2 and Apache Hadoop 2.3.0 on Linux Dev servers
  • Installed PIG, HIVE on multi-node cluster
  • Integrating PIG, Hive, Sqoop on Hadoop
  • Monthly Linux server maintainence, shutting down essential Hadoop namenode and data node.
  • Made Hadoop cluster secured by implementing Kerberos.
  • Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability.
  • Balancing Hadoop cluster using balancer utilities to spread data across the cluster equally.
  • Implemented data ingestion techniques like Pig and Hive on production environment.
  • Commissioning and decommissioning of Hadoop nodes.
  • Involved in Cluster Capacity planning alongwith expansion of the existing environment.
  • Regular health checkups of the system using Hadoop metrics - Scripted
  • Providing 24X7 support to Hadoop environment

Environment: CDH3 and CDH4, Apache Hadoop.

Confidential, Birmingham, AL

Linux Administrator

Responsibilities:

  • Configuration & managing Squid proxy server:Mac Address Based Filtering, ACL for Load Balancing on URL Request.
  • Collecting and analysis different type of hardware log from OS level
  • Scheduling Patch updates and regularly checking memory and disk utilization.
  • Experience in maintaining, building, installing and troubleshooting Linux and Windows Operating system
  • Package Management: RPM, YUM & TAR package administration.
  • Beginner of Linux server firewall configuration and setup- iptables rules implemented for nat and ssh.
  • Postfix server: IMAP and POP3 server configuration on dovecot, Postfix Aliases configuration and access control
  • Disk Management: Adding and partitioning a Disk, File systems modification and Disk space Management.
  • Logical Volume Management: Extend and reduce partition size using LVM.Convert the file system type from ext2 to ext3 and vice versa.Troubleshooting in LVM, Replacing HDD.
  • File server installation:FTP and SAMBA configuration, Management of Users and Groups for accessing the File Server.
  • Networking with TCP/IP, Troubleshooting Network Configuration.
  • Maintaining the user accounts in ADS
  • Responded to system issues as well as email and applications issues.
  • System Hardware Assembly Monitoring and Maintenance.
  • Followed ITIL process in order to make changes on Production environments.
  • Provided support to Subversion (SVN) related issues to developers
  • Configured yum repository server for installing packages from a centralized server.

Environment: RedHat, CentOS.

Confidential

Storage Administrator

Responsibilities:

  • Actively involved in performing day to day operational tasks like storage provisioning and monitoring the health of SAN.
  • Co-ordaining with vendor and Client for resolving all kind of technical and hardware related issues.
  • Actively worked on the block storage in VNX.
  • Hands on experience in Zoning (Soft Zoning)
  • Hands on experience in Host Registration, Creation of LUN, Meta LUN and Storage Groups using Navisphere Manager.
  • Worked on Storage Provisioning as per Client request to hosts by using Navisphere Manager.
  • Hands on experience in creating devices and Meta devices, LUN Mapping, LUN Masking in VNX.
  • Hands on experience in the brocade 48 k director class switch.
  • Worked on Storage Provisioning via allocating necessary storage to hosts by using Solution enabler for different type of allocation requests.
  • Decommissioning of the storage from the storage arrays.
  • Hands on the Creation of storage pool, RAID Groups, BINDLUN's and Create Storage Groups using unisphere manager in the VNX.
  • Good knowledge on snap view, mirror view Time Finder Mirror/Clone/snap and SRDF.
  • LUN creation, Mapping and Masking
  • Administering and monitoring the SAN Storage environment.
  • Performed Zoning at switches and LUN Masking at servers.
  • Performed Binding of LUNS onto the RAID Groups in the CLARION Boxes.
  • Performed creation of the Storage groups and allocation of LUNS to the hosts in the CLARION.
  • For CLARION and VNX boxes, Knowledge in server-based GUI interface called Navisphere and unisphere manage.

Environment: EMC CLARiiON, Celerra, VNX family.

We'd love your feedback!