We provide IT Staff Augmentation Services!

Sr Hadoop Administrator Resume

4.00/5 (Submit Your Rating)

Charlotte, NC

SUMMARY:

  • Over 16+ years of professional IT experience this includes experience in Big Data ecosystem & SAP Administration.
  • Excellent Experience in Hadoop architecture and various components such as HDFS, YARN and MapReduce programming paradigm.
  • Hands on experience in Installing, Configuring, Troubleshooting and Developing using Hadoop & ecosystem components like MapReduce, HDFS, Hive, Pig, Sqoop, Spark, Flume, Kafka, Storm & Elastic Search.
  • Experience in Hadoop Cluster monitoring the troubleshooting using tools such as Ganglia & Nagios.
  • Experienced in designing, implementing and managing Secure Authentication mechanism to Hadoop Cluster with Kerberos.
  • Experienced in Apache Centri in Access Control and Authorizations.
  • Experienced in working with Ranger in enabling metadata management, governance and audit.
  • Experience with AWS Cloud (EC2, S3 & EMR).
  • Experienced in installation, configuration, troubleshooting and maintenance of Kafka & Spark clusters.
  • Experience in setting up Kafka cluster on AWS EC2 Instances.
  • Experienced in installation, configuration and maintenance of Elastic Search cluster.
  • Worked on ingesting log data into Hadoop using Flume.
  • Experience in managing and reviewing Hadoop log files.
  • Extensive experience in writing Map Reduce, Hive, PIG Scripting.
  • Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice - versa.
  • Excellent understanding and knowledge of NOSQL databases like MongoDB, HBase, and Cassandra.
  • Implemented setting up standards and processes for Hadoop based application design and implementation.
  • Experience in managing Hadoop clusters using Cloudera Manager Tool (CDH4& CDH5) & Ambari.
  • Experience in Administering, Installation, configuration, troubleshooting, Security, Backup, Performance Monitoring and Fine-tuning of Redhat Linux.
  • Good UNIX/Linux knowledge including the ability to understand the interaction between applications, HW, and operating system and to provide recommendations and suggestions related to troubleshooting and performance improvement.
  • Create and implement shell and PL/SQL scripts to automate BAU tasks, configure scheduler jobs using CA tools.
  • Ability to adapt to evolving technology, strong sense of responsibility and accomplishment.

TECHNICAL SKILLS:

  • Hadoop, HDFS, Yarn, Kerberos, Centri, Ranger, Map Reduce, Spark, Shark, Hive, Pig, Sqoop, Flume, Kafka, Storm, Oozie, ZooKeeper.
  • HBase, Cassandra, MongoDB
  • Cloudera Manager, Ambari, Nagios, Zabbix.
  • JAVA, J2EE.
  • SAP Netweaver, SAP HANA, SAP Basis.
  • Oracle 8i, 9i, 10g, 11g,MS Sql Server, Teradata, Sybase, SAS, Informatica, Datastage.
  • Net backup, Oracle Grid, RMAN, BMC Patrol, Novell e-Directory, Novell streamline server, Novell workbench.
  • Eclipse, NetBeans.
  • Linux, IBM AIX 5.3, Solaris10, Windows

PROFESSIONAL EXPERIENCE:

Confidential,Charlotte,NC

SR HADOOP ADMINISTRATOR

Responsibilities:

  • Installation, configuration and Administration of CDH5.x Hadoop cluster
  • Run the benchmark tools to test the cluster performance
  • Configure the Hadoop properties based on the benchmark result
  • Tuning the cluster based on the benchmark results
  • Monitoring System Metrics and logs for any problems
  • Installation and configuration of Hadoop ecosystem components like HBase, Hive, Pig, Sqoop, Spark, Zookeeper etc. as per requirement.
  • Provided support to users for diagnosing, reproducing and fixing Hadoop related issues.
  • Work on CDH environments and took ownership of problem isolation and resolution, and whenever case arises do the bug reporting.
  • Ensure that critical user issues are addressed quickly and effectively.
  • Apply troubleshooting techniques to provide solutions to our user’s individual needs.
  • Troubleshoot, diagnose and potentially escalate user inquiries during their engineering and operations efforts.
  • Investigate product related issues both for individual customers and for common trends that may arise.
  • Setting up new Hadoop users with HDFS maintenance and support. Keeping a track of Hadoop Cluster connectivity and security.

Technology: Cloudera Manager, Hadoop, Yarn, Spark, Kafka, Hive, Pig, Sqoop, Kerberos, Centri, Oracle, Netezza, Tableau, Python, Java 8.0, Log4J, GIT, AWS, S3, EC2, JIRA.

Confidential,Charlotte, NC

HADOOP ADMINISTRATOR

Responsibilities:
  • Implemented multiple CDH5 Hadoop clusters on Redhat Enterprise Linux.
  • Responsible for building scalable distributed data solutions using Hadoop
  • Resource management of Hadoop Cluster in configuring the cluster with optimal parameter.
  • Performing day to day activities such as upgrades, applying patches, adding/removing nodes from the cluster for maintenance and capacity needs.
  • Responsible for monitoring the Hadoop cluster using Nagios.
  • Involved in upgrading all the Hadoop components such as HDFS, MapReduce, Yarn, Impala, Hive, Pig, Sqoop, Flume, Oozie, HBase, Spark etc to the latest versions.
  • Worked on implementing NOSQL database Cassandra cluster.
  • Worked on setting up of Hadoop ecosystem & Kafka Cluster on AWS EC2 Instances.
  • Performed benchmarking of Kafka cluster to measure the performance and resource considerations and tuning the cluster for optimal performance.
  • Worked with tuning and configuring various parameters to maintain High Availability and consistency targets of the cluster.
  • Experience in enabling security to Kafka cluster using Kerberos authentication.
  • Implemented Apache Centri in Access Control and Authorizations.
  • Extensively worked on managing Kafka logs for traceability and debugging.
  • Worked on designing, implementing and managing Secure Authentication mechanism to Hadoop Cluster with Kerberos.
  • Working on Centri in enabling metadata management, governance and audit.
  • Performed backup of metadata at regular intervals and other maintenance activities such as balancing the cluster, and HDFS health check.
  • Responsible for maintaining the clusters in different environments.
  • Involved in upgradation process of the Hadoop cluster from CDH4 to CDH5.
  • Installed and configured Flume, Oozie on the Hadoop cluster.
  • Managing, defining and scheduling Jobs on a Hadoop cluster.
  • Worked on installing cluster, commissioning & decommissioning of datanode, namenode recovery, capacity planning, and slots configuration.
  • Worked with different file formats such as Text, Sequence files, Avro, ORC and Parquette.
  • Installed and configured Spark on Yarn.
  • Implemented indexing for logs from Oozie to Elastic Search.
  • Analysis on integrating Kibana with Elastic Search.
  • Monitoring the log flow from LM Proxy to Elastic Search-Head
  • Responsible to manage data coming from different sources.
  • Experienced on loading and transforming of large sets of structured, semi structured and unstructured data.
  • Experience in managing and reviewing Hadoop log files.
  • Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
  • Supported in setting up QA environment and updating configurations for implementing scripts.

Technology: Cloudera Manager, Hadoop, Nagios, Zabbix, Spark, Kafka, Storm, Shark, Hive, Pig, Sqoop, MapReduce, Kerberos, Centri, Ranger, Salt, Kibana, Talend, Oracle, Teradata, SAS, Tableau, Java 7.0, Log4J, Junit, MRUnit, SVN, JIRA.

Confidential,BLOOMINGDALE, IL

Technical Team Lead

Responsibilities:
  • As SAP Technical Lead created technical implementation plan, upgrade approaches, technical issues tracking, technical documentations, project and process documentation, SAP testing (performance, Regression, DR, Backup / recovery, User connectivity, Environment Overview etc.) and work with SAP basis team for successful go lives
  • Coordinated PM’s, SAP Functional team, SAP Basis team & Production Support teams on all technical issues and resolutions.
  • Systems strategist and Architect for planning for current and future business needs.
  • Worked with leadership team and made significant contribution to Applications and Infrastructure goals.
  • Managed SAP basis turnkey projects from planning through the design and solution deployment with significant value of cost saving, quality and on time delivery.
  • Ensured best of the class technology standards to assure high quality and stable systems.
  • SAP Full life cycle projects: Led multiple SAP BASIS full life cycle implementation projects on multiple hardware and database versions.
  • SAP Technical Projects: Led multiple SAP project Upgrades, Support Packs and Kernel upgrade projects.
  • SAP Security: Led and managed Security Roles development by keeping and Segregation of Duties (SoD) guidelines, Supported unit and user testing.
  • SAP BASIS Administration: Led projects on operational integrity of SAP systems. Developed SAP standard policies and procedures for improving the operational integrity. Developed OS, SAP, and DB maintenance processes including work instruction sheets to help build consistent methodology, and to help with systems performance with reduced downtime
  • Support Strategies: Developed Help desk procedures, On-Call procedures, Escalation procedures and System maintenance windows. Implemented SLA’s, Incident and problem management and monitoring process for customer issue resolutions.
  • Change Management: Developed and led change and release management projects with clear procedure and controls to reduce system or application downtime and operational integrity.

Confidential, Chicago, IL

SYSTEM Specialist

Responsibilities:
  • Responsible for IS operations to ensure minimum downtime and timely delivery of quality technical and end-user support with 12 Netware Servers, 3 Windows NT servers and 500 nodes.
  • Team leader for automated test cases group. Job included Project planning, Scheduling tasks, Assigning resources and Weekly status reporting on Confidential family of products" in network environment - Banyan, Novell and Microsoft Lan Manager.

We'd love your feedback!