We provide IT Staff Augmentation Services!

Hadoop Administrator Resume

5.00/5 (Submit Your Rating)

Bellevue, WA

SUMMARY

  • Over 9 years of IT experience including 4+ years of experience with Hadoop Administration and 4+ years of experience in Windows Azure.
  • Experience in Hadoop Administration (HDFS, MAP REDUCE, HIVE, PIG, SQOOP, FLUME AND OOZIE, HBASE, Spark, Strom) NoSQL Administration.
  • Hands on experience in installing, configuring, and using Hadoop ecosystem components like Map Reduce, Hive, Pig, Sqoop, HBase, Sparke, Strom, Zookeeper and Oozie.
  • Expertise in different Hadoop Distributions like Horton works Data Platform (HDP 2.1 - 2.2), Cloudera Distribution Hadoop (CDH 4, CDH 5).
  • Experience with Installed Hadoop patches, major and minor version upgrades of Hadoop Apache, Cloudera and Horton works distributions.
  • Experience monitoring workload, job performance and collected metrics for Hadoop cluster when required using Ganglia, Nagios and Cloudera Manager.
  • Experienced of Hadoop 1.x and Hadoop 2.X installation, configuration and Hadoop Clients online as well as using package implementation.
  • Capacity Planning SqoopHands of experience in various aspects of Database Systems as well as installing, configuring & maintaining the Hadoop clusters.
  • Have handled issues related to cluster start, node failures and several java specific errors on the system.
  • Experience on working with Puppet configuration tool to install Hadoop Services in various Hadoop clusters.
  • Experience in automating the schedule jobs using bash shell scripting and python scripting.
  • Have experience in architecture, design and development of Big Data platform including large clusters, Hadoop ecosystem projects and custom map-reduce user management, cluster management, Setup NOSQL databases, Security design and Implementation
  • Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.
  • Experienced of Service Monitoring, Service and Log Management, Auditing and Alerts, Hadoop Platform Security, and Configuring Kerberos
  • Worked on disaster management with Hadoop cluster.
  • Experience in Implementing High Availability of Name Node and Hadoop Cluster capacity planning
  • Experience in creating the new subscriptions in Azure and giving the necessary privileges as needed.
  • Experience in performing the deployments on Azure clusters using deployment engine and monitoring the health state.
  • Experience in creating/configuring the Storage account, Cloud Services and hosted services
  • Experience with Cloud based Project supporting IAAS, PAAS, SAAS
  • Experience in Installation, configuration of IBM Blade servers
  • Experience on LINUX commands and basic Shell Scripting.
  • Excellent interpersonal, communication, documentation and presentation skills.
  • Experience supporting systems with 24X7 availability and monitoring

TECHNICAL SKILLS

Big Data Technologies: Hadoop distributions (CDH4.7, 5.3 and HDP 2.1, 2.2), Ubuntu, CentOS, Azure CLI, Shell Scripts, Nagios, Ganglia monitoring, Kerberos, Shell scripting, Python Scripting, Hive, Pig, Scoop, Flume, HBase, Zookeeper, Oozie, YARN, Cloudera Manager, Ambary Console, Hue, AWS, EC2

Servers: Apache server

Scripting Lang: Shell Scripting, Python.

Languages: C, SQL, PSQL.

Operating System: Windows, Linux.

PROFESSIONAL EXPERIENCE

Confidential - Bellevue, WA

Hadoop Administrator

Responsibilities:

  • Experience in supporting multiple large scale development, QA and production Hadoop cluster environments.
  • Installed and configured HDP, Cloudera Manager, Hive, Pig, Sqoop and Oozie on the CDH4 cluster.
  • Installed Name node, Secondary name node, Yarn (Resource Manager, Node manager, Application master), Data node.
  • Monitored multiple Hadoop clusters environments using HDP. Monitored workload, job performance and collected metrics for Hadoop cluster when required.
  • Experience configuring spouts and bolts in various Apache Storm topologies and validating data in the bolts.
  • Maintaining and troubleshooting Hadoop core and ecosystem components (HDFS, Map/Reduce, Name node, Data node, Job tracker, Task tracker, Zookeeper, YARN, Oozie, Hive, Hue, Flume, HBase, and Fair Scheduler).
  • Worked on installing cluster, commissioning & decommissioning of Data Nodes, Name Node recovery, capacity planning, and slots configuration in Mapr Control System (MCS)
  • Adding new nodes to an existing cluster, recovering from a Name node failure
  • Performed an upgrade in development environment from HDP 2.1 to 2.2.
  • Collecting and aggregating large amounts of log data using Apache Flume and staging data in HDFS for further analysis.
  • Installation of various Hadoop Ecosystems and Hadoop Daemons and Maintaining and monitoring Hadoop clusters using Cloudera Manager
  • Recovering from node failures and troubleshooting common Hadoop cluster issues
  • Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
  • Have done load balancing on the Hadoop cluster and Fetched data from HDFS using Pig, Hive into HBase
  • Experience on working with Puppet configuration tool to install Hadoop Services in various Hadoop clusters.
  • Set up automated processes to archive/clean the unwanted data on the cluster, in particular on Name node and Secondary name node.
  • Configuring the replication factor and block size for HDFS in a Hadoop cluster
  • Checking HBase region consistency and table integrity problems and repairing a corrupted HBase table
  • Developed the Sqoop scripts in order to make the interaction between Hive and MySQL Database
  • Loaded data into the cluster from dynamically generated files using Flume and from relational database management systems using Sqoop
  • Provisioning, configuring, monitoring and maintaining HDFS, Yarn, HBase, Flume, Sqoop, Oozie, Pig, Hive
  • Used Oozie for job scheduling in Hadoop cluster
  • Creating the new subscriptions in Azure and giving the necessary privileges as needed.
  • Performing the deployments on Azure clusters using deployment engine and monitoring the health state.
  • Creating/configuring the Storage account, Cloud Services and hosted services

Environment: Hadoop distribution - HDP 2.1 & 2.2, Ubuntu 12.04 Long Term Support (LTS), Cent OS, Azure Portal, Azure CLI, Azure Power Shell, SSH (Secure Shell), Shell Scripts, HBase, Spark, Strom, Hive, Pig, Scoop, Flume, R Server, Kerberos, Python Scripting, Zookeeper, Oozie, YARN, Cloudera Manager, etc.

Confidential

Server Administrator

Responsibilities:

  • Configuring windows and Linux based Servers as per customer requirements. (Global Server Build)
  • Installation and Configuration of Windows Servers in Remote Environments through IMM, AMM and RSA
  • Creating and configuring Basic and Dynamic Disks (configuring RAID Disks).
  • Configuring security policies and group policies.
  • Creating user accounts and groups and setting appropriate permissions for secure system access remotely.
  • Remotely troubleshooting Server hardware issues and escalating to relevant team or vendor.
  • Installing the Tools and Software’s by using the Script called MAIT
  • Attending on calls with the clients for any technical information/updating.
  • Expertise in drive space related issue and solve server services related failures
  • Coordinating with different teams locally and globally for more effective troubleshooting of server related, network related and application related issues.
  • Troubleshoot and fine tune windows performance using built in tools.
  • Installing the TSM BA Client and Tivoli End Point.
  • Installing the Fusion, and checking the log files for health check of the server
  • Configuring NIC teaming /Binding for LAN and configuring advanced NIC configuration.
  • Installing security and critical patches of windows updates.
  • Installing Antivirus and updating antivirus definitions up to date.
  • Installing and configuring various application software’s.
  • Reviewing and testing the quality of the build servers and preparing health check reports.
  • User and group management on AD and Linux
  • Creating project directories and setting up proper permissions
  • Installed software on Linux Systems
  • Responsible for user account creation, group policies objects and password maintenance through Active Directory.
  • Perform VMware host upgrades and virtual machine maintenance/migrations when needed.
  • Report findings for all issue resolutions to management on a daily basis.
  • Ensure daily backups run efficiently by injecting and ejecting tapes from tape library.
  • LAN port enabling and disabling
  • Resolving DNS related issues (Proxy setting)
  • New hardware & software installation and configuration.
  • Enabled remote access by constructing and managing Cisco VPN Client
  • Solving network connectivity issues with network applications.
  • Adheration of Providing 24X7 support to entire environment

Environment: IBM Blade Servers, AMM, IMM, RSA, TSM, VERITAS NetBackup, LINUX, Windows.

Confidential

Systems Administrator

Responsibilities:

  • Installation and setup of Windows Server 2000, 2003, 2008 and Linux - CentOS, Ubuntu.
  • Designing, configuring and maintaining Active Directory Services on windows server 2003 Domain controllers.
  • Responsible for creating and managing users accounts, groups and security policies, assigning permissions rights, Accounts, Profiles and policies, maintaining of all user complaints
  • Install, configure and provide technical support for Windows Servers like Active Directory, DNS, DHCP, DFS, FTP and VPN.
  • Configuration and managing Remote Installation Service.
  • Data Protection and maintenance of healthy network using different Backups and Recovery strategies.
  • Implement, Configuring and troubleshoot DHCP, Create and manage DHCP scopes and super scopes and configure DHCP for DNS integration.
  • Restricting users by implementing Group Policies and working with different options of Software Restriction Policies.
  • Providing technical support on Microsoft platform (Windows 2000 & XP).
  • Handling and troubleshooting client issues.
  • Creating and managing GPO’S
  • Securing resources with shared folder and NTFS permissions.
  • Desktop user support to windows 98, Windows NT and windows 2000/XP, vista and windows7 users.
  • Installing the basic software and troubleshooting different types of different operating systems like Windows 98, Windows 2000 and Windows XP.
  • Installation of other software’s such as Red Hat Linux operating System, Exchange Server and Microsoft Outlook.
  • Installation, Configuration and Maintenance of the VMware servers and workstations.
  • Maintaining Software inventory, Licenses and ensuring closure of software requests. Also testing Software’s before rolling out to users.
  • Reconfiguring/setting up machines for new hires
  • Troubleshoot email-enabled devices.
  • Preparing & sending weekly and monthly reports.

Environment: Windows, Linux, TSM, VERITAS NetBackup, PowerShell

Confidential

System Administrator & Faculty Member

Responsibilities:

  • Installation, configuration and maintenance of Windows XP 2003 and 2008 Servers.
  • Server build, installing Operating system, migrating OS etc. Installing new software / file sets, packages and other third party applications when required by business.
  • Creating Users, Groups and working user security settings, home directories and password administering.
  • Maintaining a group of systems around 50+ in the Organization.
  • Taking the backup and Recovery Client systems & Server’s backup.
  • Assembling Computers, installing the software and troubleshooting in cord level.
  • Installation and configuration of Symantec Anti-virus.
  • Updating the Security Patches on all the systems in regular intervals.
  • Installation, configuration of Local and Network printers like HP Laser, Jet, and Epson.
  • Cabling the Network with Category 5 cables and running over the network
  • Troubleshooting of all kinds of Hardware, Software and Network problems.
  • Setting up the Hardware and Software environment according to newly arrival software.
  • Troubleshooting of all kinds of Hardware, Software and Network problem.
  • Training provided to several batches on regular intervals on Hardware Networking and MCSE.

We'd love your feedback!