Hadoop Administrator Resume
2.00/5 (Submit Your Rating)
Atlanta, GA
SUMMARY
- 7+years of IT experience including Hadoop Administration
- Proven expertise in Hadoop Projects Implementation and Configuring Systems.
- Excellent Experience in Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, NameNode, Data Node and MapReduce.
- Hands on experience in installing, configuring, and using Hadoop ecosystem components like MapReduce, Hive, Pig, Sqoop, HBase, ZooKeeper and Oozie
- Understanding of Hadoop 2.X architecture, Yarn Framework, MapReduces, and HDFS Federation
- Exposure to "Productionalizing" Hadoop applications (i.e. administration, configuration, management, monitoring, debugging, and performance tuning)
- Expertise in High Availability Configurations for Mission Critical Applications
- Experience in System Architecture and Infrastructure Planning
- Install/Configure/Evaluate System Backup, and Monitoring Software
- Cluster configuration and data transfer(distcp and hftp), inter and intra cluster data transfer.
- Excellent analytical, problem solving, communication and interpersonal skills with ability to interact with individuals at all levels and work in a team as well as independently
- Good understanding of network protocols, routing, switching equipment, Networking Operating Systems, Servers and overall different network architectures.
- Have handled issues related to cluster start, node failures and several java specific errors on the system.
- Experienced of Hadoop 1.x and Hadoop 2.X installation, configuration and Hadoop Clients online as well as using package implementation.
- Capacity Planning SqoopHands of experience in various aspects of Database Systems as well as installing, configuring & maintaining the Hadoop clusters.
- Adept in Hadoop cluster expansion and planning.
- Have experience in architecture, design and development of Big Data platform including large clusters, Hadoop ecosystem projects and custom map - reduce user management, cluster management, Setup NOSQL databases, Security design and Implementation
- Installing and configuring Hadoop ecosystem like Pig, Hive.
- Hands on experience in Installing, Configuring and managing the Hue and HCatalog.
- Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.
- Experienced of Service Monitoring, Service and Log Management, Auditing and Alerts, Hadoop Platform Security, and Configuring Kerberos
- Experience in importing and exporting the logs using Flume.
- Optimizing performance of Hbase/Hive/Pig jobs.
TECHNICAL SKILLS
Linux/ Unix: RedHat, CentOS, Ubuntu
SQL: MySQL 4/5/6
Core Java: JDK 7/8
Hadoop: Cloudera, Apache
Storage: CIFS/NFS, LUN, RAID
BigData Ecosystem: Hadoop, MapReduce, HDFS, Sqoop, Hive, Pig, Hbase, Sqoop, Flume
Java: Core, JDBC
Tools: IDE:: JIRA, PuTTy, WinSCP, Apache Tomcat.
Database: HBase and Sql server
PROFESSIONAL EXPERIENCE
Confidential, Atlanta, GA
Hadoop Administrator
Responsibilities:
- Install, Configure and maintain Single-node and Multi-node cluster Hadoop cluster.
- Hands on Resource management and HDFS federation impletation.
- Setup cluster environment for Highly Available systems.
- Hadoop cluster configuration & deployment to integrate with systems hardware in the data center.
- Troubleshooting, diagnosing, tuning, and solving Hadoop issues
- Monitor a Hadoop cluster and execute routine administration procedures.
- Managing hadoop Services like Namenode, Datanode, Jobtracker, Tasktracker etc.
- Installed Apache Hadoop 2.5.2 and Apache Hadoop 2.3.0 on Linux Dev servers
- Installed PIG, HIVE on multi-node cluster
- Integrating PIG, Hive, Sqoop on Hadoop
- Monthly Linux server maintainence, shutting down essential Hadoop namenode and data node.
- Made Hadoop cluster secured by implementing Kerberos.
- Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability.
- Balancing Hadoop cluster using balancer utilities to spread data across the cluster equally.
- Implemented data ingestion techniques like Pig and Hive on production environment.
- Commissioning and decommissioning of Hadoop nodes.
- Involved in Cluster Capacity planning alongwith expansion of the existing environment.
- Regular health checkups of the system using Hadoop metrics - Scripted
- Providing 24X7 support to Hadoop environment
Environment: CDH3 and CDH4, Apache Hadoop.
Confidential, Birmingham, AL
Linux Administrator
Responsibilities:
- Configuration & managing Squid proxy server:Mac Address Based Filtering, ACL for Load Balancing on URL Request.
- Collecting and analysis different type of hardware log from OS level
- Scheduling Patch updates and regularly checking memory and disk utilization.
- Experience in maintaining, building, installing and troubleshooting Linux and Windows Operating system
- Package Management: RPM, YUM & TAR package administration.
- Beginner of Linux server firewall configuration and setup- iptables rules implemented for nat and ssh.
- Postfix server: IMAP and POP3 server configuration on dovecot, Postfix Aliases configuration and access control
- Disk Management: Adding and partitioning a Disk, File systems modification and Disk space Management.
- Logical Volume Management: Extend and reduce partition size using LVM.Convert the file system type from ext2 to ext3 and vice versa.Troubleshooting in LVM, Replacing HDD.
- File server installation:FTP and SAMBA configuration, Management of Users and Groups for accessing the File Server.
- Networking with TCP/IP, Troubleshooting Network Configuration.
- Maintaining the user accounts in ADS
- Responded to system issues as well as email and applications issues.
- System Hardware Assembly Monitoring and Maintenance.
- Followed ITIL process in order to make changes on Production environments.
- Provided support to Subversion (SVN) related issues to developers
- Configured yum repository server for installing packages from a centralized server.
Environment: RedHat, CentOS.
Confidential
Storage Administrator
Responsibilities:
- Actively involved in performing day to day operational tasks like storage provisioning and monitoring the health of SAN.
- Co-ordaining with vendor and Client for resolving all kind of technical and hardware related issues.
- Actively worked on the block storage in VNX.
- Hands on experience in Zoning (Soft Zoning)
- Hands on experience in Host Registration, Creation of LUN, Meta LUN and Storage Groups using Navisphere Manager.
- Worked on Storage Provisioning as per Client request to hosts by using Navisphere Manager.
- Hands on experience in creating devices and Meta devices, LUN Mapping, LUN Masking in VNX.
- Hands on experience in the brocade 48 k director class switch.
- Worked on Storage Provisioning via allocating necessary storage to hosts by using Solution enabler for different type of allocation requests.
- Decommissioning of the storage from the storage arrays.
- Hands on the Creation of storage pool, RAID Groups, BINDLUN's and Create Storage Groups using unisphere manager in the VNX.
- Good knowledge on snap view, mirror view Time Finder Mirror/Clone/snap and SRDF.
- LUN creation, Mapping and Masking
- Administering and monitoring the SAN Storage environment.
- Performed Zoning at switches and LUN Masking at servers.
- Performed Binding of LUNS onto the RAID Groups in the CLARION Boxes.
- Performed creation of the Storage groups and allocation of LUNS to the hosts in the CLARION.
- For CLARION and VNX boxes, Knowledge in server-based GUI interface called Navisphere and unisphere manage.
Environment: EMC CLARiiON, Celerra, VNX family.
