We provide IT Staff Augmentation Services!

Hadoop Developer Resume

5.00/5 (Submit Your Rating)

Atlanta, GA

SUMMARY

  • 7+ years of experience in IT industry this includes 2+ years of hands on experience in Big Data Technologies and 5 years of experience in Java.
  • Worked with Cloudera and Hortonworks distributions on Hadoop Framework.
  • Excellent knowledge on Hadoop Ecosystem Architecture and core components of Hadoop cluster like Masters and Slaves of HDFS and Map Reduce.
  • Experience in analyzing data using HiveQL, Pig Latin, HBase and MapReduce programs.
  • Experience in extending Hive and Pig core functionality by writing UDF's.
  • Experience in migrating the data using Sqoop from HDFS to Relational Database System and vice - versa.
  • Knowledge of administrative tasks such as installing Hadoop and its ecosystem components such as Hive and Pig.
  • Excellent knowledge of NoSQL databases like HBase, Cassandra and MongoDB.
  • Knowledge of installing, configuring, debugging and troubleshooting Hadoop clusters.
  • Strong expertise in Java, object-oriented design and analysis, programming styles and design patterns.
  • Experience in deploying applications in Web/Application Servers like Tomcat, WebLogic and Oracle Application Servers.
  • Development and maintenance of web applications and enterprise applications using Java, J2EE, JSP, Servlets, Hibernate, JDBC, HTML, PHP, XML and Java Script.
  • Experience in Mobile App Development in iOS using XCODE5 Tool.
  • Strong knowledge of Software Development Life Cycle and expertise in detailed design documentation.
  • Extensive experience with Waterfall and Agile Scrum Methodologies.
  • Excellent Analytical, Logical, Debugging, Programming, Communication, Organizational and Time management skills.
  • Quick learner and excellent team player having ability to meet tight deadlines and work under pressure.
  • ORACLE Certified Java Programmer (OCJP).

TECHNICAL SKILLS

Hadoop Ecosystem: Apache Hadoop (HDFS/MapReduce), Pig, Hive, HBase, Sqoop, Flume, Oozie, Hue, HiveQL, Pig Latin, Impala, Scala, Spark, Amazon EC2.

Technologies: Core Java, J2EE, SQL, Unix Shell, Pig, HiveQL, C++, C, Scala, JavaScript, Hibernate, JDBC, JSP, XML, PHP, HTML, JavaScript, SOAP, Servlets, JSF, Maven, SQL/PLSQL, ANT Build Script, Sybase 12.5.4, AJAX, JSF.

Frameworks: Struts MVC, Spring MVC 2.5.6 and log4j.

IDE's: Eclipse, Xcode5, Net Beans, IBM-RAD 7.5, PythonAnyWhere, Codio

Application Servers: Apache Tomcat and Oracle Web based Server

Operating Systems: Windows 95/98/2000/XP/Vista/7, Unix

Databases: Oracle 9i/10g/11g, MySQL, DB2, MS-SQL Server, MS-Access.

NoSQL Databases: MongoDB, HBase, Cassandra

PROFESSIONAL EXPERIENCE

Confidential, Atlanta, GA

Hadoop Developer

Responsibilities:

  • Responsible for building scalable distributed data solutions using Hadoop.
  • Installed and configured Hive, Pig, Sqoop, Flume and Oozie on the Hadoop cluster.
  • Setup and benchmarked Hadoop/HBase clusters for internal use.
  • Developed Simple to complex MapReduce Jobs using Java, Hive and Pig scripts.
  • Optimized Map/Reduce Jobs to use HDFS efficiently by using various compression mechanisms.
  • Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and Extracted the data from MySQL into HDFS using Sqoop.
  • Analyzed the data by performing Hive queries and running Pig scripts to study customer behavior.
  • Used UDF’s to implement time conversion functions, encryptions logics in Pig and Hive.
  • Implemented business logic by writing UDF's in Java and used various UDFs from Piggybanks and other sources.
  • Continuous monitoring and managing the Hadoop cluster using Cloudera Manager.
  • Worked with application teams to install operating system, Hadoop updates, patches, version upgrades as required.
  • Installed Oozie workflow engine to run multiple Hive and Pig jobs.
  • Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.

Environment: CDH 5.x Distribution, MapReduce, HDFS, Hive, Pig, Java, SQL, Cloudera Manager, Sqoop, Flume, Oozie, Java, Eclipse.

Confidential, NY

Hadoop Developer

Responsibilities:

  • Involved in moving all log files generated from various sources to HDFS for further processing. Responsible to manage data coming from different sources.
  • Handled 2 TB of data volume and implemented the same in Production.
  • Developed and Supported Map Reduce Programs those are running on the cluster.
  • Installed and configured Pig and also written PigLatin scripts.
  • Developed UDFs for Pig Data Analysis.
  • Involved in installing Hadoop developer machine and Ecosystem components.
  • Performance Optimization of Hadoop cluster based on job requirements.
  • Installed and configured Hive and also written Hive UDF's. Created Hive tables and working on them using Hive QL.
  • Wrote Hive queries for data analysis to meet the business requirements.
  • Developed Scripts and Batch Job to schedule various Hadoop Program.
  • Utilized fully Agile Scrum Methodology, Involved in distributed Scrum and also participate as Scrum master.
  • Used MRUnit & JUnit for Hadoop/Java unit testing.
  • Analyzed the data by performing Hive queries and running Pig scripts to know user behavior.
  • Used GIT for version control and created automated build scripts. Use Maven for continuous Integration.
  • Installed Oozie workflow engine to run multiple Hive and Pig jobs.

Environment: Hadoop 2.0, MapReduce, HDFS, Hive 0.9, Pig 0.10,Sqoop 1.4, Oozie 3.2.0, Cloudera CDH3/4 Distribution, MRUnit, JUnit, Eclipse, Maven, GIT, Jenkins

Confidential, Lynchburg, VA

Java Developer

Responsibilities:

  • Developed web components using JSP, Servlets and JDBC
  • Designed tables and indexes
  • Designed, Implemented, Tested and Deployed Enterprise Java Beans both Session and Entity using WebLogic as Application Server
  • Developed stored procedures, packages and database triggers to enforce data integrity. Performed data analysis and created crystal reports for user requirements
  • Provided quick turn around and resolving issues within the SLA.
  • Implemented the presentation layer with HTML, XHTML and JavaScript
  • Used EJB's to develop business logic and coded reusable components in Java Beans
  • Development of database interaction code to JDBC API making extensive use of SQL
  • Query Statements and advanced Prepared Statements.
  • Used connection pooling for best optimization using JDBC interface
  • Used EJB entity and session beans to implement business logic and session handling and transactions.
  • Developed user-interface using JSP, Servlets, and JavaScript
  • Wrote complex SQL queries and stored procedures
  • Actively involved in the system testing

Environment: J2EE, JSP, SOAP, Java Script, Servlet, JDBC, SQL, UNIX and JUnit.

Confidential

Java Developer

Responsibilities:

  • Involved in Requirements analysis, design, and development and testing.
  • Involved in setting up the different roles & maintained authentication to the application.
  • Designed, deployed and tested Multi-tier application using the Java technologies.
  • Involved in front end development using JSP, HTML & CSS.
  • Implemented the Application using Servlets
  • Deployed the application on Oracle Web logic server
  • Implemented Multithreading concepts in java classes to avoid deadlocking.
  • Used MySQL database to store data and execute SQL queries on the backend.
  • Prepared and Maintained test environment.
  • Tested the application before going live to production.
  • Documented and communicated test result to the team lead on daily basis.
  • Involved in weekly meeting with team leads and manager to discuss the issues and status of the projects.

Environment: Java, JSP, JDBC, Multi-Threading, HTML, Oracle Web logic server, Eclipse, MySQL, Junit

Confidential

Java Developer

Responsibilities:

  • Involved in requirements gathering for the application development.
  • Designed document specifications for J2EE application.
  • Involved in the design and development phase of the application.
  • Implemented the business logic using Session Beans in EJB.
  • Developed User Interface and end user screens using Java Swing, JSP and Servlet.
  • Implemented web services using SOAP.
  • Responsible for periodic generation of reports.
  • Performed Unit testing of the application using JUnit.
  • Carried out necessary validations of each developed screen by writing Triggers, Procedures and Functions available along with the objects, events and methods.
  • Designed and developed menus in order to navigate from once screen to another screen.
  • Used Hibernate framework with JDBC drivers to connect to the database and manipulate the data.
  • Use of Joins, Triggers, Stored Procedures and Functions in order to interact with backend database using SQL.
  • Review the changes on the weekly basis and ensure the deliverables to be quality.
  • Actively documented the common problems during testing and developing phase and also in production phase.
  • Coordinated with other Development teams, System managers and web master and developed good working environment

Environment: J2EE, EJB, JSP, SOAP, Java Script, Servlet, JDBC, SQL, UNIX and JUnit.

We'd love your feedback!