Senior Hadoop Developer Resume
4.00/5 (Submit Your Rating)
SUMMARY
- Over 4 years of Big Data experience with extensive knowledge in Hadoop Ecosystem Tools.
- Currently working as a Senior Hadoop Developer in Retail Project
- AS a Co - Author, Represented my Team in TACTICs Conference on Analytical Re-Imagination by presenting the Paper of Automatic Detection of traffic signal violation in real time using Big Data for Indian roads
- Extensive Hands-on Experience in Hadoop Development
- Worked as Junior Research associate in several Machine Learning Proof of Concepts
- As a member of Big Data Solution Group, Involved in design and proposal of Solution & Technical Architecture for several Big Data Proof of Concepts
- Good exposure and Hands-on experience in Hadoop Administration as well by installing Cloudera and Horontworks Hadoop
- Conducted internal trainings on Hadoop Ecosystem Tools(Map Reduce, Hive, Hbase, YARN)
- Possess good experience in the Retail, Telecom and Investment Banking Domains.
- Good team member/leader with excellent communication skills and ability to work independently along with strong problem solving, learning and interpersonal skills.
TECHNICAL SKILLS
- Hadoop Map-Reduce
- HiveQL
- Pig Latin
- Oozie Workflow
- Sqoop
- Flume
- Spark
- Python
- R
- Kafka
- Storm
- Presto
- Spark
- Hbase
- MySQL
- MongoDB
PROFESSIONAL EXPERIENCE
Confidential
Senior Hadoop Developer
Responsibilities:
- Analysis of Business and Technical Requirements.
- Understanding and designing the application architecture.
- Processing of data using PySpark and Hive
- Migrating Hive queries in Spark Scala.
- Automating the Jobs using Oozie
Confidential
Hadoop Developer
Responsibilities:
- To create pyspark script which process the streaming images in real time.
- To segment the individual parking spaces from the entire parking area.
- To identify whether the parking space occupied or not.
- To Store the identified spots in Hbase
Confidential
Hadoop Developer
Responsibilities:
- To create Kafka Twitter Producer which will produce twitter streaming data and also trending hastag data.
- TO Create Storm Topology for processing real time twitter Data.
- Store the processed real time data in Hbase
Confidential
Hadoop Developer, Tableau Developer
Responsibilities:
- Analysis of Business and Technical Requirements.
- Pre-Processing / Cleansing of data using Hive
- To Create Flume conf to ingest real time netowrk data into Hadoop Environment.
- To Create Storm Topology to process real time data.
- Create Data Model to store the historical aggregated data and real time processed data using Hive-Hbase Storage.
- To Develop Tableau Dashboards for visualization
Confidential
Hadoop Developer, Tableau Developer
Responsibilities:
- Analysis of Business and Technical Requirements.
- Pre-Processing / Cleansing of data using Hive
- Created UDF's for Pre-processing.
- To Create HiveQL for generating a Aggregated report.
- Developed Tableau Dashboards for visualization
Confidential
Hadoop / Hive Developer
Responsibilities:
- Analysis of Business and Technical Requirements.
- Understanding and designing the application architecture.
- Processing of data using Hive.
- Unique user list is stored in Hive - Hbase Table.
Confidential
Hadoop Developer
Responsibilities:
- Analysis of Business and Technical Requirements.
- Understanding and designing the application architecture
- Storage of Airlines data in HDFS.
- Pre-Processing / Cleansing of data using Pig Latin.
- Used Mahout Random Forest Algorithm for predicting the target variable
- Developed Oozie end-to-end workflow & Spring based Web-UI for visualization
Confidential
Hadoop Developer
Responsibilities:
- Analysis of Business and Technical Requirements.
- Understanding and designing the application architecture
- Storage of trade data in HDFS.
- Processing of data using Impala / Presto.
- Front Runner list is stored in Hbase
- Retrieved Front Runner list is shown in Spring based UI.
Confidential
Big Data Developer
Responsibilities:
- Involved in requirements gathering
- Understanding and designing the application architecture
- Used Sqoop to transfer data from RDBMS to HDFS
- Developed Map Reduce program to store the Data in HBASE
- Developed Map Reduce program to retrieve the data from HBASE and to process it.
- Data Visualization was developed by using Java String
