SUMMARY

• Overall 3 years of experience in Architect, Analysis, Design, Development, Implementation, Maintenance and Enhancements on various IT Projects.
• 2 years of experience in Big Data Hadoop with hands - on experience in Map-Reduce, HDFS, Pig, Hive, Hbase, Sqoop, etc.
• Successfully delivered 6 Projects as a Java/Hadoop Engineer .
• Expertise in writing Hadoop Jobs to analyze data using MapReduce, Hive, Pig.
• A Cloudera Certified Hadoop Developer
• In depth understanding of Object Oriented Programming ( Java, C++ basics ).
• Hands on experience in installing configuring and using Hadoop ecosystem components like Hadoop MapReduce, HDFS, HBase, Hive, Sqoop, Pig.
• Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems (RDBMS) and vice-versa.
• Good understanding of NoSQL databases like Hbase, HDFS .
• 2 years of experience with SQL using databases like MySQL, Oracle etc.
• 3 years of experience in Java with hands-on experience in multiple projects.
• Experience in Front-End (Design) Web Development using technologies like HTML, CSS .
• Experience in maintaining large sets of data, processing them & using them for analysis.
• Experience in working in high pressure team environment with intense development activity on multiple projects simultaneously.
• Excellent communication and interpersonal skills.

TECHNICAL SKILLS

Programming Languages: Java, C++, PHP, Shell Scripting

Big Data Components: Cloudera Hadoop Stack, HDFS, Map-Reduce, Pig, Hive, Hbase, Sqoop, Tableau.

Database: MySQL, NoSql (Hbase).

Web Development: Full Front-end (HTML, CSS, JavaScript Basics)

IDE’s: Eclipse, Sublime Text.

OS: Windows 98/2000/7/8/10 , Linux (Ubuntu 14.04, 15.10).

Other: MS Office, Liber Office, Google Analytics

PROFESSIONAL EXPERIENCE

Confidential, Warren, NJ

MTS-II System Engr

Environment:

• Programming Language & Query Language - Java, JSF, XML, SQL & CQL
• Databases - MySQL, Cassandra

Responsibilities:

• Worked with across the board applications which would handle all the customer calls we receive every day, maintaining the data for each customer & communication with outside applications.
• Maintained more than 1800 service API’s for the primary application and 300 service API’s for the database application.
• Worked on major projects including the launch of Unlimited on Verizon and Juice on Verizon.
• Also working on transforming the application to Cloud (AWS).
• Converting application database from RDBMS (Oracle) to NoSql (Cassandra), which included designing new data model and getting all the data from legacy application to our new system.
• Work flow also included monitoring logs and maintaining all the Test and Development environments, with continuous builds and deployment.

Confidential, NYC, NY

Java/Hadoop Developer

Environment:

• Hortonworks Hadoop Stack - HDFS, Hbase, Hive, Solr & Spark.
• Programming Language & Query Language - Java, SQL & HiveQL
• Databases - MySQL, HBase & HDFS

Responsibilities:

• Worked with getting the data from multiple vendors like Apple, Universal, Youtube, etc into the Hadoop system. The system used to analyze large amounts of data everyday. The total rows that used to be stored were 3 million every day.
• Wrote different algorithms in Java for different types of data.
• Every company had different types of format, therefore, nearly 12 algorithms were created in this process to process them.
• This process data was then stored to HBase.
• Hive was used in the frontend to show the data given by the customers.
• I also did analytics on the data looking up for the different ways of where the song/album was sold in large quantities & where it was not. So, feedback was then given to the vendors along with their bestselling song/album.
• Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.

Confidential

Java/Hadoop Engineer

Environment:

• Cloudera Hadoop Stack - HDFS, Hbase, Hive, Pig & Spark.
• Programming Language & Query Language - Java, HTML, CSS, Genetic Algorithms (AI), SQL, Pig Scripting & HiveQL
• Databases - MySQL, HBase & HDFS

Responsibilities:

• I worked with the historical data sets and also on getting new information of any tenders passed or deals placed. We started off with 5 companies, but gradually we increased.
• I had worked on to getting the data into the system. I was working on HDFS, Hive and Map­ Reduce.
• Also, I and my mentors worked on making the algorithm that would support our project in a way that it had to be made just once, but can be deployed on multiple data sets.
• The Algorithm took around 70-80 days to be deployed while the data was successfully stored in Hbase
• Automated all the jobs starting from pulling the Data from different Data Sources like MySQL and pushing the result data set to Hadoop Distributed File System and running MR jobs and PIG/Hive using Sqoop.
• The result being that we were able to get nearby 68% success rate, which was higher than expected. The reason for only 68% success was because of the fact that the application was in its growing stage and therefore, would give higher accuracy as the data grows.

Confidential

Java/Hadoop Engineer

Environment:

• Cloudera Hadoop Stack - HDFS, Hbase, Hive, Pig & Sqoop.
• Programming Language & Query Language - Java, JSP, SQL, Pig Scripting & HiveQL
• Databases - Oracle, HBase & HDFS

Responsibilities:

• Collected data for 3 years and kept it in Hbase for real time query.
• Batch jobs were scheduled to do analytic using Map-Reduce and Hive as a warehouse to store the results of that.
• Took initiative to create a system that can ingest large amount of student data for my college so that over a longer period of time, we would be able to compare the performance.
• Our main motive was to show the change of results (+ve or -ve) and performance of the students.
• Made our System which we used to get the values of Grade of various batches, comparing them with the previous year results and plotting graphs on the go.
• Project has been fully deployed and has been running successfully for the last 2 years.

Confidential

Jr. Java/Hadoop Developer

Environment:

• Cloudera Hadoop Stack - HDFS, Hbase, Hive, Pig, Sqoop.
• Programming Language & Query Language - Java, SQL, Pig Scripting & HiveQL
• Databases - MySQL, HBase & HDFS

Responsibilities:

• I was a part of the original team who decided the structure and how things should work with the system.
• I was traveling a lot as the team required to map many places with the ratings & services provided.
• I helped in development of Pig Script, keeping it updated and running it every second day.
• I wrote the whole map-reduce jobs for the system.
• Getting over 270 GB of data into HDFS & Hbase from a relational database (MySQL).
• I was also part of the front-end team, helping in the building of front-end design of the website.
• Sharing reports at the end of each week to my team.

Confidential

Jr. Java/Hadoop Developer

Environment:

• Cloudera Hadoop Stack - HDFS, Hbase, Hive, Pig & Sqoop.
• Programming Language & Query Language - Java, SQL, Pig Scripting & HiveQL
• Databases - MySQL, HBase & HDFS

Responsibilities:

• I was responsible to make custom Mapper & Reducer jobs to retrieve huge amounts of data.
• The data was kept in Hbase through which we used to access the records for the Mappers.
• Also helped in making a JSP site which used to fetch this data for each employee ID.
• The JSP website was directly linked with the Hbase to pull information of employees.
• I also worked on Front end web development during this project.
• Processing almost 0.6 Gb of employee data daily.