Hadoop Developer Resume

SUMMARY

4 years of experience in Big data ecosystem related technologies like Hadoop, Pig, Hive, Sqoop, WebLech, Apache Tika, MySQL, and Apache Flume.
Good knowledge of Hadoop Cluster architecture (data ingestion pipeline design, Hadoop information architecture, data modeling, data mining, machine learning, and advanced data processing) and monitoring the cluster.
Developed of Big Data projects using Hadoop, MapReduce, Pig, Hive and other open source tools/technologies.
Excellent knowledge of Hadoop components like HDFS (Name Node and Data Node), MapReduce (Job Tracker and Task Tracker), MapReduce programming paradigm, Hive, Pig, Sqoop, WebCrawler, and Apache Flume.
Experience installing, configuration, supporting and managing Hadoop clusters.
Wrote basic MapReduce programs using Java.
Performed data analysis, create databases and tables, and load data to HDFS using Hive and Pig.
Good understanding of Data Structure and Algorithms.
Experienced in using NFS (network file systems) for Name node metadata backup.
Experience in importing and exporting terra bytes of data using Sqoop from HDFS to Relational Database Systems and vice - versa.
Experience in streaming and migrating real-time data using Flume into Hadoop Storage (HDFS).
Experience in designing and implementing MapReduce jobs to support distributed data processing and process large data sets utilizing the Hadoop cluster.
Experience in writing Pig Latin Scripts, HQL Scripts, and Java scripts to run multiple MapReduce jobs.
Good knowledge of KDC and LDAP security.
Experience in writing Unix shell scripts and SQL queries.
Knowledge of Kafka and Spark.
Participating in system integration onsite deployment, customer support and product up gradation.
Interacting with onshore team for requirements gathering, analysis, implementation and testing of the system.
Delivering and implementing the project as per the scheduled milestones.
Possess good communication and interpersonal skills.

PROFESSIONAL EXPERIENCE

Big Data Tools: Hadoop, Pig, Hive, Sqoop, Flume, WebLech

Databases: Hive, MySQL

Scripting: Pig Latin script, HQL, SQL, Shell script, Java Script.

Operating Systems: UNIX (AIX), Linux (CentOS), Windows 2007, 2008, 2010.

Data Analysis: Clustering, Classification, Regression analysis, predictive analysisvariable selection, machine learning.

Framework & Architecture: Hadoop-MapReduce

Cloud computing: AWS

PROFESSIONAL EXPERIENCE

Confidential

Hadoop Developer

Responsibilities:

Responsible for managing and extracting structured/unstructured data coming from various source, and loading them to HDFS for further processing.
Crawled feeds/data from social media sites such as Facebook, Twitter and other websites using Web Lech.
Analyzed large data sets by running Hive queries and Pig scripts.
Stream analyzed data to the existing relational databases using SQOOP for making it available for visualization.
Involved in creating workflow engine to run multiple Hive and Pig jobs.
Established custom Map Reduce programs in order to analyze data and used Pig Latin to clean unwanted data.
Manipulated data using pig and hive.
Created databases, tables, and load data using hive and pig, which will run internally in MapReduce way.

Confidential

Hadoop Developer

Responsibilities:

Responsible for importing of data from various data sources.
Analyzed, manipulated and cleaned unwanted data using PIG and Hive.
Involved in installing Hadoop Ecosystem components.
Import/Export data into HDFS from RDBMS and vice-versa using Sqoop.
Created databases, tables, and load data using hive and pig, which will run internally in MapReduce way.
Setup Hadoop cluster including adding/removing nodes, load balancing, and performance tuning.
Write basic MapReduce programs using Java.

We provide IT Staff Augmentation Services!

We'd love your feedback!

Resume Categories

Client Services

Job Seekers

Visa Sponsorship