We provide IT Staff Augmentation Services!

Hadoop/kafka Administrator Resume

5.00/5 (Submit Your Rating)

Irving, TX

SUMMARY

  • me have 8 years of experience in IT field including 3+ years experience in Hadoop Administration in diverse industries which includes hands on experience in Big data ecosystem related technologies.
  • Extensive noledge and experience in Big Data with Map - Reduce, HDFS, Hive, Pig, Impala, Spark, Kafka, Zookeeper, Oozie, Sentry, HUE and Sqoop.
  • Experience with teh technologies like HTML, XML, Web Services, HTTP, SOAP, REST, SQL
  • Good noledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Resource Manager, Name Node, Data Node, and MapReduce(MRV1 and YARN) concepts.
  • Experience in performing various major and minorHadoopupgrades on large environments.
  • Experience with SecuringHadoopclusters using Kerberos.
  • Hands on experience in installation, configuration, management and development of big data solutions using Cloudera andHortonworks distributions.
  • Working experience on designing and implementing complete end to end Hadoop Infrastructure.
  • Good experience on Design, configure and manage teh backup and disaster recovery for Hadoop data.
  • In-depth noledge of modifications required in static IP (interfaces), hosts, setting up password-less SSH and Hadoop configuration for Cluster setup and maintenance.
  • Good noledge of Windows PowerShell scripting.
  • Experience with TIBCO Enterprise Service Bus (ESB) for designing and implementing communication.
  • Experience in working with various Databases and creating teh Store Procedures, SQL Queries, PL/SQL required for teh Integration.
  • Expertise in setting up TIBCO Infrastructure, Configuration, and Administration of multiple TIBCO Environments.
  • Have experience in AWS EC2 management console, S3 buckets, EBS, Glacier, VPC, ELB, IAM, Cloud Watch, System manager. Creating, launching and upscaling servers using AWS managent console.
  • Have basic noledge on AWS EMR, GIT, Python.
  • Managed Users and Groups using IAM.
  • Good Experience and understanding of Windows and AD administration, troubleshooting, configuration.
  • Have experience in creating and deploying SSL, CSR and CA certs.
  • Experienced using Sqoop to import data into HDFS from RDBMS and vice-versa.
  • Experience in understanding teh security requirements for Hadoop and integrating with Kerberos autantication infrastructure- KDC server setup, creating realm /domain.
  • Experience in Administering, Installation, configuration, troubleshooting, Security, Backup, Performance Monitoring and Fine-tuning of Redhat Linux and CentOS.
  • Have Experience in installing and configuring Rstudio, Jupyterhub, SAS Foundation Server, H2O.
  • Experience in upgrading kernel of teh servers.
  • Experience in supporting systems with 24X7 availability and monitoring.

TECHNICAL SKILLS

Big Data Technologies: HDFS, Hive, Map Reduce, Yarn, Kafka, Pig, Spark, HUE, Scoop, Flume, Zookeeper, Oozie, HBase, Hive Server2, Storm, CDH 5.3, CDH 5.4, CDH 5.12.1

Scripting Languages: Shell Scripting, Python, Powershell, Bash.

Databases: Oracle 11g, MySQL, Hbase, Cassandra, MongoDB

Networks: HTTP, HTTPS, FTP, UDP, TCP/TP, SNMP, SMTP

Monitoring Tools: Cloudera Manager, Solr, Ambari, Nagios, Ganglia

Application Servers: Apache Tomcat, Weblogic Server, Websphere, Windows 2012

Security: Kerberos

Analytic Tools: RStudio, Jupyterhub, SAS, H2O, Tableau

PROFESSIONAL EXPERIENCE

Confidential, Irving, TX

Hadoop/Kafka Administrator

Responsibilities:

  • Administering Hadoop Cloudera and Hortonworks production clusters with 500+ nodes
  • Supporting and managing 50+ Analytics, Operation and Kafka production clusters.
  • Monitoring Kafka cluster connectivity and security.
  • Setting up reports, alerts, ServiceNow integration, Netcool alerts for clusters.
  • Managing and reviewing Kafka log files.
  • Installing or adding Datanodes, Kafka Brokers, Zookeeper, HUE, HS2 server using Ambari.
  • Collaborating with application teams to install operating system and Kafka updates, security and Qualys patches, Firmware, Kernel, Java upgrades.
  • Working on incidents and change tickets.
  • Monitoring production clusters through Splunk.
  • Created Ranger policies.
  • Supporting of Kafka integrations, including topics, producers, consumers, Schema Registry, Kafka Control Center, KSQL, and streaming applications.
  • Monitor performance, identify bottlenecks and tune to optimize Kafka performance and throughput.
  • Takes care of teh day-to-day running of Kafka cluster Jobs.
  • Responsible for Cluster maintenance, commissioning and decommissioning Data nodes, Cluster Monitoring, Troubleshooting, Manage and review data backups, Manage & review Hadoop log files.
  • Working with IBM and Cloudera teams to debug and resolve teh cluster issues.

Environment: Cloudera Hadoop, Hortonworks, Servicenow, Sqoop, Hive, Oozie, SAS, Hive Server2(HS2), Spark, Kafka, HUE, Ranger, ZooKeeper, SQL, Ambari, Splunk, Map Reduce, Pig, Tableau

Confidential, Schaumburg, IL

Hadoop Administrator

Responsibilities:

  • Administering Hadoop Cloudera production cluster (CDH 5.10.2) with 120+ nodes.
  • Creating and Launching EC2 instances in AWS.
  • Used AWS S3 buckets to store files.
  • Scaling up teh servers in AWS.
  • Creating and Deploying CSR, SSLS certs.
  • Commissioning, Decommissioning, Balancing, and Managing Nodes and tuning server for optimal performance of teh cluster.
  • Kernel and OS patching of teh servers.
  • Created 30+ Hadoop nodes in production cluster to scale up teh cluster storage capacity and performance.
  • Managing Data in Hadoop.
  • Monitoring workload, job performance and capacity planning and debugged failed jobs using Cloudera Manager.
  • Installed and configured Hiveserver2, Hue Server, Spark 2 on teh Hadoop Cloudera cluster.
  • Installed and configured Applications like SAS Foundation, Rstudio, Tableau, H2O, Jupyterhub Server on Hadoop Cluster.
  • Have noledge of Windows 2008 and 2012 as well Operating System
  • Examining job fails and trouble shooting.
  • Adding and Removing users from SAS Metadata.
  • Working noledge of installing, configuring, tuning, maintaining and monitoring Windows 2008/2012 Enterprise server
  • Created group policies and permissions in active directory.
  • Installed multiple versions of R.
  • Upgraded RStudio and Tableau Servers.
  • Installed R and Jupyterhub pacakages.
  • Working on Sevicenow incident tickets.
  • Troubleshooting issues related to SAS Foundation, Rstudio, Tableau, H2o, Jupyterhub Server.

Environment: Cloudera Hadoop, Rstudio, H2O, Jupyterhub, Servicenow, Tableau, Windows 2012R2, Sqoop, Hive, Oozie, SAS, Hive Server2(HS2), Spark, Unix Shell Scripts, ZooKeeper, SQL, Map Reduce, Pig, Powershell, AWS S3, EC2, EBS, Glacier, AWS system manager.

Confidential, San Diego, CA

Tibco Developer/Administrator

Responsibilities:

  • Development of teh new enhancements.
  • Preparing teh test cases and performing unit testing for teh code changes implemented.
  • Prepared technical documents of teh enhancements
  • Created procedures according teh requirement
  • Participated in deployment activities
  • Hosted web services as per teh integration requirement
  • Designed various XML Schemas for various entities to support teh Common Data Model.Created teh mapping documents for teh interfaces identified.
  • Responsible for closely working with TIBCO EMS administrator to create queues, topics and bridges to meet teh project requirements. Performed all teh business workflow and published transformed data on teh EMS using BW.
  • Designed and developed Business Processes to integrate legacy applications using Business Works.
  • Performed load testing and performance analysis for Business Works engines.
  • Deployed EAR files and Adapters using TIBCO Administrator in various environments and created User + Roles for Autantication purposes.
  • Troubleshooting and tuning Tibco installations, Business works processes and other processes
  • Involved in logging, monitoring, and statistics facilities to TEMPeffectively view system activities and track system performance using TIBCO/EMS.
  • Developed Tibco Hawk Rule Bases for monitoring teh BW engines, TIBCO Adapters and Log files.
  • Worked in 24*7 Production Support Model.

Environment: Tibco Administrator, Tibco Business Works, Tibco EMS, Tibco Business Connect, SQL, Linux, Unix, Windows XP, Vista, 7, Intel x86 Dual Core

We'd love your feedback!