Hadoop Administrator Resume
Durham, NC
SUMMARY
- Highly skilled Cloudera Certified Administrator for Apache Hadoop (CCA - 500) having strong abilities in administration of large data clusters in big data environments and is extremely analytical with excellent problem-solving skills. Over 9 years of IT experience with 3+ years of experience in Hadoop Big Data environment, Maintenance of various servers including weblogic, Hadoop cluster and administration.
- Experience with complete Software Design Lifecycle including design, development, testing and implementation of moderate to advanced complex systems and projects.
- Hands on experience in deploying, configuring, supporting and managing Hadoop Clusters of Cloudera in Linux platform and Amazon cloud.
- Proficient working with Hadoop 1.x (HDFS and MapReduce) and Hadoop 2.x (HDFS, MapReduce, YARN) architectures.
- Manage to troubleshoot system issues and quickly identify solutions to eliminate impact to business customers.
- Hands on experience in installing, configuring, and using Hadoop ecosystem components like HIVE, Impala, Zookeeper, Sqoop, HUE, Spark on Cloudera & MapR Hadoop Distribution.
- Managing the health of Cluster, resolving performance related issues, coordinating with various parties for Infrastructure support.
- Manage to implement the Name Node High Availability (HA), Resource Manager High Availability (HA) for Hadoop clusters and designing automatic failover control using Zookeeper and Quorum Journal Nodes.
- Hands on experience in Implementing Hadoop security solutions such as Kerberos for securing Hadoop clusters and Data.
- Hands on experience in administering Linux systems to deploy Hadoop clusters and monitor using Nagios, Ganglia, Ambari, Cloudera Manager and Zookeeper.
- Hands on experience in analyzing Log files for Hadoop and eco system services and finding root cause.
- Manage to work on Python scripting and Pandas, Numpy, Scipy, Scikit-Learn, Matplotlib, web Scrapping, BeautifulSoup.
TECHNICAL SKILLS
Big Data: Manage Big Data components/frameworks such as Apache Hadoop, CDH5.x, YARN, ZooKeeper, MapReduce, Pig, Hive, Hadoop Distributed File System (HDFS) and other Hadoop Eco System components.
Middleware: webMethods, Oracle Weblogic Server, Oracle SOA Suite 11g& 12C, BPEL, OSB, B2B, AIA
Cloud: Oracle Cloud, Amazon Cloud(AWS)
Scripting: Python, Shell Scripting
Monitoring tools: Cloudera Manager 5.0.6, Apache Ambari, Ganglia
Continuous Integration: Jenkins, Maven
IDE: JDeveloper, Eclipse, B2B Editor, Document Editor, PyCharm
Web Technology: Web services, XML, SOAP, WSDL, XSD
PROFESSIONAL EXPERIENCE
Confidential, Durham, NC
Hadoop Administrator
Responsibilities:
- Manage to do installation, configuration, supporting and managing Hadoop Clusters using Apache, Cloudera (CDH5.0),Yarn distributions.
- Responsible for Cluster maintenance, commissioning and decommissioning Data nodes, Cluster Monitoring, Troubleshooting, Manage & review Hadoop log files.
- Configure and tune environment and batch jobs to ensure optimum performance and 99.99% availability.
- Monitoring systems and services, architecture design and implementation of hadoop deployment, configuration management, backup, and disaster recovery systems and procedures.
- Configured various property files like core-site.xml, hdfs-site.xml, mapred-site.xml based upon the job requirement.
- Managed and reviewed Hadoop Log files as a part of administration for troubleshooting purposes. Communicate and escalate issues appropriately.
- Proactively involved in ongoing maintenance, support and improvements in Hadoop cluster.
- Involved in Installing and configuring Kerberos for the authentication of users and hadoop daemons.
- Manage to coordinate with Development, Network, Infrastructure, and other organizations necessary to get work done.
- Worked with big data developers, designers and scientists in troubleshooting mapreduce job failures and issues with Hive and Pig.
- Involved in implementing High Availability and automatic failover infrastructure to overcome single point of failure for Name node utilizing zookeeper services.
Confidential Cupertino, CA
Hadoop Administrator
Responsibilities:
- Design and deploy Hadoop cluster production environment that can scale to petabytes.
- Proactively identify opportunities to implement automation and monitoring solutions.
- Design, configure and manage the backup and disaster recovery for Hadoop data.
- Optimize and tune the Hadoop environment to meet the performance requirements.
- Install and configure monitoring tools for the Hadoop environment
- Work with big data developers, designers and scientists in troubleshooting map reduce job failures and issues with Hive, Pig etc.
- Troubleshoot production issues and find resolution, Performance tune, wherever applicable.
- Participating in a 24x7 on-call support rotation and off-hours maintenance windows.
Confidential, Columbus, OH
Hadoop Administrator
Responsibilities:
- Involved in implementation and support of the Enterprise Hadoop environment, including; design, capacity planning, cluster set up, performance tuning, monitoring, infrastructure planning, scale up/out and administration.
- Managed to work closely with infrastructure, network, database, and business intelligence and application teams to ensure business applications are highly available and performing within agreed on service levels.
- Performed analysis and provide input to support capacity planning and solution design decision.
- Manage to troubleshoot system issues and quickly identify solutions to eliminate impact to business Customers.
Confidential Oshkosh, WI
Sr. Weblogic Admin
Responsibilities:
- Installation of Domains and Managed Servers
- Weblogic Admin Configurations (JDBC Connection pools, JMS, Filestore, Bridge etc)
- Created Integration design patterns and development standards for the client.
- Clustering, Load balancing, Deploying Applications (JAR, EAR, WAR).
- Server fine tunings and Performance enhancements.
- Created decision matric for analyzing best suited technology for the integration.
- Create and/or update system requirements and associated technical design documentation.
- Lead efforts or conduct and document complex testing (unit, integration, system) for application integrations.
- Involved in capacity planning for the servers, installation of different environment like development, test and production. Provide basic system administration of FMW
Confidential
SOA Teach Leader & Weblogic Admin
Responsibilities:
- Involved in planning infrastructure setup for Fusion middleware SOA & AIA.
- Configured domain for development, IT and production environment
- Involved in EDI interface testing using Oracle Fusion Middleware SOA Suite and B2B Suite
- Guiding the team with the deployment process and solving any error faced and finding solutions for new problems.
Confidential
Technical Lead & Consultant
Responsibilities:
- Involved in exporting and importing integrations from development, staging and production environments.
- Designed and developed extensive error handling solution.
- Configured Trading Networks to send the data to different partners.
- Implemented publish & subscribe model using notification and triggers.
- Configured Trading Partners to exchange Business Documents and created Partner Profiles, using Profile Assistant.
Confidential
webMethods Developer
Responsibilities:
- Code changes as per change request document.
- Involved in Coding and GUI.
- Completed Unit testing for the changed code.
- Requirement Analysis, Design and Development.
- Logging request with Integration department for code deployment.
- Report generation for change in code.
