We provide IT Staff Augmentation Services!

Hadoop Administrator Resume

0/5 (Submit Your Rating)

Durham, NC

SUMMARY

  • Highly skilled Cloudera Certified Administrator for Apache Hadoop (CCA - 500) having strong abilities in administration of large data clusters in big data environments and is extremely analytical with excellent problem-solving skills. Over 9 years of IT experience with 3+ years of experience in Hadoop Big Data environment, Maintenance of various servers including weblogic, Hadoop cluster and administration.
  • Experience with complete Software Design Lifecycle including design, development, testing and implementation of moderate to advanced complex systems and projects.
  • Hands on experience in deploying, configuring, supporting and managing Hadoop Clusters of Cloudera in Linux platform and Amazon cloud.
  • Proficient working with Hadoop 1.x (HDFS and MapReduce) and Hadoop 2.x (HDFS, MapReduce, YARN) architectures.
  • Manage to troubleshoot system issues and quickly identify solutions to eliminate impact to business customers.
  • Hands on experience in installing, configuring, and using Hadoop ecosystem components like HIVE, Impala, Zookeeper, Sqoop, HUE, Spark on Cloudera & MapR Hadoop Distribution.
  • Managing the health of Cluster, resolving performance related issues, coordinating with various parties for Infrastructure support.
  • Manage to implement the Name Node High Availability (HA), Resource Manager High Availability (HA) for Hadoop clusters and designing automatic failover control using Zookeeper and Quorum Journal Nodes.
  • Hands on experience in Implementing Hadoop security solutions such as Kerberos for securing Hadoop clusters and Data.
  • Hands on experience in administering Linux systems to deploy Hadoop clusters and monitor using Nagios, Ganglia, Ambari, Cloudera Manager and Zookeeper.
  • Hands on experience in analyzing Log files for Hadoop and eco system services and finding root cause.
  • Manage to work on Python scripting and Pandas, Numpy, Scipy, Scikit-Learn, Matplotlib, web Scrapping, BeautifulSoup.

TECHNICAL SKILLS

Big Data: Manage Big Data components/frameworks such as Apache Hadoop, CDH5.x, YARN, ZooKeeper, MapReduce, Pig, Hive, Hadoop Distributed File System (HDFS) and other Hadoop Eco System components.

Middleware: webMethods, Oracle Weblogic Server, Oracle SOA Suite 11g& 12C, BPEL, OSB, B2B, AIA

Cloud: Oracle Cloud, Amazon Cloud(AWS)

Scripting: Python, Shell Scripting

Monitoring tools: Cloudera Manager 5.0.6, Apache Ambari, Ganglia

Continuous Integration: Jenkins, Maven

IDE: JDeveloper, Eclipse, B2B Editor, Document Editor, PyCharm

Web Technology: Web services, XML, SOAP, WSDL, XSD

PROFESSIONAL EXPERIENCE

Confidential, Durham, NC

Hadoop Administrator

Responsibilities:

  • Manage to do installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera (CDH5.0),Yarn distributions.
  • Responsible for Cluster maintenance, commissioning and decommissioning Data nodes, Cluster Monitoring, Troubleshooting, Manage & review Hadoop log files.
  • Configure and tune environment and batch jobs to ensure optimum performance and 99.99% availability.
  • Monitoring systems and services, architecture design and implementation of hadoop deployment, configuration management, backup, and disaster recovery systems and procedures.
  • Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml based upon the job requirement.
  • Managed and reviewed Hadoop Log files as a part of administration for troubleshooting purposes. Communicate and escalate issues appropriately.
  • Proactively involved in ongoing maintenance, support and improvements in Hadoop cluster.
  • Involved in Installing and configuring Kerberos for the authentication of users and hadoop daemons.
  • Manage to coordinate with Development, Network, Infrastructure, and other organizations necessary to get work done.
  • Worked with big data developers, designers and scientists in troubleshooting mapreduce job failures and issues with Hive and Pig.
  • Involved in implementing High Availability and automatic failover infrastructure to overcome single point of failure for Name node utilizing zookeeper services.

Confidential Cupertino, CA

Hadoop Administrator

Responsibilities:

  • Design and deploy Hadoop cluster production environment that can scale to petabytes.
  • Proactively identify opportunities to implement automation and monitoring solutions.
  • Design, configure and manage the backup and disaster recovery for Hadoop data.
  • Optimize and tune the Hadoop environment to meet the performance requirements.
  • Install and configure monitoring tools for the Hadoop environment
  • Work with big data developers, designers and scientists in troubleshooting map reduce job failures and issues with Hive, Pig etc.
  • Troubleshoot production issues and find resolution, Performance tune, wherever applicable.
  • Participating in a 24x7 on-call support rotation and off-hours maintenance windows.

Confidential, Columbus, OH

Hadoop Administrator

Responsibilities:

  • Involved in implementation and support of the Enterprise Hadoop environment, including; design, capacity planning, cluster set up, performance tuning, monitoring, infrastructure planning, scale up/out and administration.
  • Managed to work closely with infrastructure, network, database, and business intelligence and application teams to ensure business applications are highly available and performing within agreed on service levels.
  • Performed analysis and provide input to support capacity planning and solution design decision.
  • Manage to troubleshoot system issues and quickly identify solutions to eliminate impact to business Customers.

Confidential Oshkosh, WI

Sr. Weblogic Admin

Responsibilities:

  • Installation of Domains and Managed Servers
  • Weblogic Admin Configurations (JDBC Connection pools, JMS, Filestore, Bridge etc)
  • Created Integration design patterns and development standards for the client.
  • Clustering, Load balancing, Deploying Applications (JAR, EAR, WAR).
  • Server fine tunings and Performance enhancements.
  • Created decision matric for analyzing best suited technology for the integration.
  • Create and/or update system requirements and associated technical design documentation.
  • Lead efforts or conduct and document complex testing (unit, integration, system) for application integrations.
  • Involved in capacity planning for the servers, installation of different environment like development, test and production. Provide basic system administration of FMW

Confidential

SOA Teach Leader & Weblogic Admin

Responsibilities:

  • Involved in planning infrastructure setup for Fusion middleware SOA & AIA.
  • Configured domain for development, IT and production environment
  • Involved in EDI interface testing using Oracle Fusion Middleware SOA Suite and B2B Suite
  • Guiding the team with the deployment process and solving any error faced and finding solutions for new problems.

Confidential

Technical Lead & Consultant

Responsibilities:

  • Involved in exporting and importing integrations from development, staging and production environments.
  • Designed and developed extensive error handling solution.
  • Configured Trading Networks to send the data to different partners.
  • Implemented publish & subscribe model using notification and triggers.
  • Configured Trading Partners to exchange Business Documents and created Partner Profiles, using Profile Assistant.

Confidential

webMethods Developer

Responsibilities:

  • Code changes as per change request document.
  • Involved in Coding and GUI.
  • Completed Unit testing for the changed code.
  • Requirement Analysis, Design and Development.
  • Logging request with Integration department for code deployment.
  • Report generation for change in code.

We'd love your feedback!