We provide IT Staff Augmentation Services!

Senior Hadoop Developer Resume

4.00/5 (Submit Your Rating)

SUMMARY

  • Over 4 years of Big Data experience with extensive knowledge in Hadoop Ecosystem Tools.
  • Currently working as a Senior Hadoop Developer in Retail Project
  • AS a Co - Author, Represented my Team in TACTICs Conference on Analytical Re-Imagination by presenting the Paper of Automatic Detection of traffic signal violation in real time using Big Data for Indian roads
  • Extensive Hands-on Experience in Hadoop Development
  • Worked as Junior Research associate in several Machine Learning Proof of Concepts
  • As a member of Big Data Solution Group, Involved in design and proposal of Solution & Technical Architecture for several Big Data Proof of Concepts
  • Good exposure and Hands-on experience in Hadoop Administration as well by installing Cloudera and Horontworks Hadoop
  • Conducted internal trainings on Hadoop Ecosystem Tools(Map Reduce, Hive, Hbase, YARN)
  • Possess good experience in the Retail, Telecom and Investment Banking Domains.
  • Good team member/leader with excellent communication skills and ability to work independently along with strong problem solving, learning and interpersonal skills.

TECHNICAL SKILLS

  • Hadoop Map-Reduce
  • HiveQL
  • Pig Latin
  • Oozie Workflow
  • Sqoop
  • Flume
  • Spark
  • Python
  • R
  • Kafka
  • Storm
  • Presto
  • Spark
  • Hbase
  • MySQL
  • MongoDB

PROFESSIONAL EXPERIENCE

Confidential

Senior Hadoop Developer

Responsibilities:

  • Analysis of Business and Technical Requirements.
  • Understanding and designing the application architecture.
  • Processing of data using PySpark and Hive
  • Migrating Hive queries in Spark Scala.
  • Automating the Jobs using Oozie

Confidential

Hadoop Developer

Responsibilities:

  • To create pyspark script which process the streaming images in real time.
  • To segment the individual parking spaces from the entire parking area.
  • To identify whether the parking space occupied or not.
  • To Store the identified spots in Hbase

Confidential

Hadoop Developer

Responsibilities:

  • To create Kafka Twitter Producer which will produce twitter streaming data and also trending hastag data.
  • TO Create Storm Topology for processing real time twitter Data.
  • Store the processed real time data in Hbase

Confidential

Hadoop Developer, Tableau Developer

Responsibilities:

  • Analysis of Business and Technical Requirements.
  • Pre-Processing / Cleansing of data using Hive
  • To Create Flume conf to ingest real time netowrk data into Hadoop Environment.
  • To Create Storm Topology to process real time data.
  • Create Data Model to store the historical aggregated data and real time processed data using Hive-Hbase Storage.
  • To Develop Tableau Dashboards for visualization

Confidential

Hadoop Developer, Tableau Developer

Responsibilities:

  • Analysis of Business and Technical Requirements.
  • Pre-Processing / Cleansing of data using Hive
  • Created UDF's for Pre-processing.
  • To Create HiveQL for generating a Aggregated report.
  • Developed Tableau Dashboards for visualization

Confidential

Hadoop / Hive Developer

Responsibilities:

  • Analysis of Business and Technical Requirements.
  • Understanding and designing the application architecture.
  • Processing of data using Hive.
  • Unique user list is stored in Hive - Hbase Table.

Confidential

Hadoop Developer

Responsibilities:

  • Analysis of Business and Technical Requirements.
  • Understanding and designing the application architecture
  • Storage of Airlines data in HDFS.
  • Pre-Processing / Cleansing of data using Pig Latin.
  • Used Mahout Random Forest Algorithm for predicting the target variable
  • Developed Oozie end-to-end workflow & Spring based Web-UI for visualization

Confidential

Hadoop Developer

Responsibilities:

  • Analysis of Business and Technical Requirements.
  • Understanding and designing the application architecture
  • Storage of trade data in HDFS.
  • Processing of data using Impala / Presto.
  • Front Runner list is stored in Hbase
  • Retrieved Front Runner list is shown in Spring based UI.

Confidential

Big Data Developer

Responsibilities:

  • Involved in requirements gathering
  • Understanding and designing the application architecture
  • Used Sqoop to transfer data from RDBMS to HDFS
  • Developed Map Reduce program to store the Data in HBASE
  • Developed Map Reduce program to retrieve the data from HBASE and to process it.
  • Data Visualization was developed by using Java String

We'd love your feedback!