We provide IT Staff Augmentation Services!

Hadoop  Administrator/developer Resume

4.00/5 (Submit Your Rating)

Holliston, MA

OBJECTIVE:

To use my experience and skills in a personable and professional manner in the hope of complementing the organization’s culture and enhancing its growth.

SUMMARY:

  • Over 10 years of experience in IT Industry with strong experience with Big Data Hadoop
  • Experienced professional in Java/ J2ee programming and application development
  • Experienced developing application codes using HTML, JavaScript, JQuery, JSP
  • Working experience in Map Reduce programming model and Hadoop Distributed File Systems
  • Knowledge of writing Hive Queries to generate reports using Hive Query Language
  • Hands on experience in installing, configuring Cloudera Apache Hadoop ecosystem components like Flume, Hbase, Zoo Keeper, Oozie, Hive, Sqoop and Pig
  • Hands - on experience in distributed systems technologies, infrastructure administration, monitoring, configuration
  • Basic Knowledge of UNIX and shell scripting

TECHNICAL SKILLS:

Database: Oracle, PL/SQL, SQL, My SQL, MS Access

Programming Languages: C Language, Java, JDK 1.1.7, Visual Basic

Scripting: ASP, HTML, PHP, Python, Perl, JavaScript

Networking: Ethernet, Switches, Routers, Network Protocols, Subnetting Implementing

Operating System: Linux/Unix, Windows Server 2003/ XP, Active Directory

Big Data: Hadoop, MapReduce, High-performance computing, Data mining, HBase, Django, Pig, Hive, HDFS, Zookeeper

PROFESSIONAL EXPERIENCE:

Confidential, HOLLISTON, MA

Hadoop Administrator/Developer

Responsibilities:

  • Confidential enables its customers to cost effectively mine, manage and monetize data delivering actionable analytics that drive unsurpassed business performance.
  • Dragonfly’s Products, Data Factory facilities and Data Engineering Services are focused on cloud-based, open data architectures and tools that provide data extraction and processing data sources towards data analytics deliverables

Confidential

Hadoop Administrator/Developer

Responsibilities:
  • M3xlarge nodes with 4 core CPU and 15 Gb RAM and 1.6TB node size
  • Daily getting 1TB of data size in JSON format with popular hash tags along with 8 billion events and trillions of real time tweets
  • Hadoop cluster -nodes- 30 node cluster
  • Mongo DB cluster (MongoDB with 1000 IOPS)
  • Using Kafka we stream the data with twitter4j from source to Hadoop. From Hadoop to Mongodb move the data using Map reduce, hive and pig scripts by connecting with mongo-hadoop connectors. Analyze data on HDFS and send the results to MongoDB databases to update the information on the existing table.
  • Continuous monitoring and managing the Hadoop cluster using Cloudera Manager.
  • Developed simple and complex MapReduce programs in Java for Data Analysis.
  • Transfer the data from HDFS TO MONGODB using pig, hive and Map reduce scripts and visualize the streaming data in dashboard tableau.
  • Do analytics using map reduce, hive and pig in HDFS and sends back those results to MongoDB databases and update information in collections.
  • Installed and configured CDH-Hadoop environment and responsible for maintaining cluster and managing and reviewing Hadoop log files.
  • Load data from various data sources into HDFS using Kafka.
  • Install KAFKA on Hadoop cluster and configure producer and consumer coding part in java to establish connection from twitter source to HDFS with popular hash tags.
  • Implemented Partitioning, Dynamic Partitions, Buckets in HIVE.
  • Developed PIG Latin scripts for the analysis of semi structured data.

Environment: CDH4.7, Hadoop-2.0.0 HDFS, MapReduce, MongoDB-2.6, Tableau 8.2, Hive-0.10, Sqoop-1.4.3, Oozie-3.3.4, Zookeeper-3.4.5, Hue-2.5.0

Confidential

Hadoop Administrator/Developer

Responsibilities:
  • Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing
  • Created Pig Latin scripts to sort, group, join and filter the desperate enterprise wise data
  • Responsible in administration, monitor and maintain Hadoop cluster, develop MapReduce jobs, assist and guide team members.
  • Experienced in reviewing Hadoop log files
  • Administer, Monitor and Maintain Hadoop cluster setup with over 100TB available storage
  • Design and build scalable infrastructure and platform to collect and process very large amounts of data

Environment: Hadoop, MapReduce, HDFS, Pig, Hive, Java (jdk1.7), Flat files, Oracle 11g/10g, PL/SQL, WindowsNT, UNIX

Confidential

Hadoop Administrator

Responsibilities:
  • Provided 24/7 Support in monitoring Hadoop/HBase Cluster using tools like Ganglia, BMC and Nagios
  • Administer, Monitor and Maintain Hadoop 0.20 cluster setup
  • Responsible for providing administration and support of multiple Hadoop clusters for a variety of mission-critical custom and packaged software applications, in addition to a large reliable distributed data processing framework and analytical infrastructure

Environment: Hadoop, HDFS, Map Reduce, Zookeeper, HBase, Pig Latin, Sqoop, Hive, Pig, SQL, Oracle PL/SQL, Oozie, MySQL, Java Script, JQuery, Web Services

Confidential, COCONUT CREEK, FL

Network Administrator

Responsibilities:
  • Provide XP to Windows 7 platform Migration including Outlook 2003 to Outlook 2010
  • Competent in transfer of all files, photos, music, email and settings (including pop/smtp)
  • Provide on-site, phone and remote system and network troubleshooting and repairs
  • Drive mapping, network drives, modem and router configuration
  • Manage all business levels of operations: including IT Staffing, Best Practice Repair or Replacement, Data Forensics, finance, marketing and client retention
  • Provide and inspire outstanding service to customers by maintaining attention to detail and completing assigned work in a timely and efficient manner

Confidential, DAVIE,FL

Network Administrator

Responsibilities:
  • Designed and implemented Windows NT 4.0 Server with Windows 98 clients including one remote site using RAS; installed EZDental/EagleSoft software and provided training to the staff; migrated to W2K3 server with XP-Pro clients and RRAS/VPN for the remote site; provided ongoing support for both locations.

We'd love your feedback!