We provide IT Staff Augmentation Services!

Hadoop Developer Resume

2.00/5 (Submit Your Rating)

Bloomington, IL

SUMMARY:

  • Overall 8+ years of experience in IT industry which around 3 years of experience in Big Data in implementing complete Hadoop solutions along wif 5 years of experience in Java.
  • Good working experience in using ApacheHadoop ecosystem components like Map Reduce, HDFS, Hive, Pig, Oozie, Sqoop, Flume and Zoo Keeper.
  • Strong experience in data analytics using Hive and Pig, including by writing custom UDFs.
  • Performed importing and exporting data into HDFS and Hive using Sqoop.
  • Knowledge of working in ETL tools like Informatica and Pentaho Kettle.
  • Experience in job workflow scheduling and monitoring tools like Oozie and Zookeeper.
  • Extensive knowledge in using SQL Queries for backend database analysis.
  • Good understanding of NoSQL databases like MongoDB and Hbase.
  • Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems (RDBMS) and vice - versa.
  • Experience in analyzing data using Hive QL, Pig Latin, and custom MapReduce programs in Java.
  • Experienced in installing, configuring, and administrating Hadoop cluster of major Hadoop distributions.
  • In depth knowledge of creating Map Reduce codes in Java as per the business requirements.
  • Experience in developing multi-tier Java based web application.
  • Expertise in Core Java, J2EE, Multithreading, JDBC, Shell Scripting and proficient in using Java API’s for application development.
  • Good experience in developing applications using JavaEE technologies includes Servlets, Struts, JSP, and JDBC.
  • Well-versed in Agile, other SDLC methodologies and can coordinate wif owners and SMEs.
  • Experienced in creating and analyzing Software Requirement Specifications (SRS) and Functional Specification Document (FSD).
  • Strong knowledge of Software Development Life Cycle (SDLC).
  • Experienced in preparing and executing Unit Test Plan and Unit Test Cases after software development.

TECHNICAL EXPERTISE:

Big Data Ecosystems: Hadoop, MapReduce, HDFS, Hive, Pig, Sqoop, Zookeeper, Oozie, Flume

Programming Languages: Core Java, JSP, JDBC, Linux

Scripting Languages: JSP & Servlets, PHP, JavaScript, XML, and HTML

Databases: Oracle 11g/10g/9i, MySQL, DB2, MongoDB, HBase

Tools: Eclipse, JDeveloper, JUnit, Ant, MS Visual Studio

Operating Systems: Windows XP/7/8, CentOS, Ubuntu

Application Servers: Apache Tomcat, Jetty

ETL Tools: Pentaho Kettle and Talend

Testing Tools: NetBeans, Eclipse, JUnit, MR Unit

Methodologies: Agile, Scrum and Waterfall

PROFESSIONAL EXPERIENCE:

Hadoop Developer

Confidential, Bloomington, IL

Roles and Responsibilities:

  • Understanding business needs, analyzing functional specifications and map those to develop and designing MapReduce programs and algorithms.
  • Execution of Hadoop ecosystem and Applications through Apache HUE.
  • Optimizing Hadoop MapReduce code, Hive and Pig scripts for better scalability, reliability and performance.
  • Very good understanding of Partitions, Bucketing concepts in Hive and designed both Managed and External tables in Hive for optimized performance.
  • Extensively worked on creating Combiners, Partitioning, Distributed cache to improve the performance of MapReduce jobs.
  • Worked on Creating the MapReduce jobs to parse the raw weblogs data into delimited records.
  • Solved performance issues in Hive and Pig scripts wif understanding of Joins, Group and aggregation and how does it translate to MapReduce jobs.
  • Worked in tuning Hive and Pig scripts to improve performance.
  • Developed the OOZIE workflows automate the tasks of loading the data into HDFS and pre-processing wif Pig.
  • Feasibility Analysis (For the deliverables) - Evaluating the feasibility of the requirements against complexity and time lines.
  • Performing data migration from Legacy Databases RDBMS to HDFS using Sqoop.
  • Extracted the data from Teradata into HDFS using Sqoop.
  • Writing Pig scripts for data processing.
  • Implemented Hive tables and HQL Queries for the reports.
  • Written and used complex data type in storing and retrieved data using HQL in Hive.
  • Created Sqoop job wif incremental load to populate Hive External tables.
  • Developed Hive queries to analyze reducer output data.
  • Responsible for managing data coming from different sources.
  • Highly involved in designing the next generation data architecture for the unstructured data.
  • Very good experience wif both MapReduce 1 (Job Tracker) and MapReduce 2 (YARN).
  • Responsible for writing MapReduce jobs to handle multiple types of files (JSON, Text, XML)
  • Continuous monitoring and managing the Hadoop cluster through Cloudera Manager.
  • Implemented Hadoop Hive Cluster using Cloudera Distributed Vendor (CDH4). Planning, installation and configuration of Hadoop cluster and its ecosystem components.
  • Developed PIG Latin scripts to extract data from source system.
  • Created and maintained technical documentation for executing Hive queries and Pig scripts.
  • Involved in Extracting, loading Data from Hive to Load an RDBMS using Sqoop.
  • Involved in gathering business requirements and prepared detailed specifications that follow project guidelines required to develop written programs.
  • Actively participating in the code reviews, meetings and solving any technical issues.

Environment: HDFS, Map Reduce, Hive, Oozie, Java, PIG, CDH4, Shell Scripting, Linux, HUE, Sqoop, Flume, DB2, and Oracle 11g

Confidential, Louisville, KY

Hadoop Developer

Roles and Responsibilities:

  • Explored and used Hadoop ecosystem features and architectures.
  • Experience indefining, designing and developing Java applications, specially using Hadoop MapReduce by leveraging frameworks such as Hive.
  • Developed workflow using Oozie for running Map Reduce jobs and Hive Queries.
  • Worked on loading log data directly into HDFS using Flume.
  • Involved in loading data from LINUX file system to HDFS.
  • Responsible for managing data from multiple sources.
  • Experienced in running Hadoop streaming jobs to process terabytes of XML format data.
  • Created and maintained Technical documentation for launching Cloudera Hadoop Clusters and for executing Hive queries and Pig Scripts
  • Experience in working wif various kinds of data sources such as MongoDb and Oracle.
  • Successfully loaded files to Hive and HDFS from Mongo DB.
  • Familiarity wif a NoSQL database such as MongoDb.
  • Experience in managing the CVS and migrating into Subversion.
  • Experience in managing development time, bug tracking, project releases, development speed, release forecast, scheduling and many more. Using a custom framework of Nodes and MongoDb to take care of the back-end calls wif a lightning fast speed.
  • Intensive Object-Oriented JavaScript, jQuery and plug-ins are used to work on dynamic user interface.
  • Experience in Partner wif Hadoop developers in building best practices for Warehouse and Analytics environment.
  • Experience in working wif various kinds of data sources such as DB2 and Oracle.
  • Successfully loaded files to Hive and HDFS from Mongo DB.
  • Extracted files from MySQL through Sqoop and placed in HDFS and processed.
  • Collecting and aggregating large amounts of log data using Apache Flume and staging data in HDFS for further analysis.
  • Worked on debugging, performance tuning of Hive & Pig Jobs.
  • Implemented test scripts to support test driven development and continuous integration.
  • Worked on tuning the performance Pig queries.
  • Involved in loading data from LINUX file system to HDFS.
  • Importing and exporting data into HDFS and Hive using Sqoop.
  • Experience working on processing unstructured data using Pig and Hive.
  • Supported MapReduce Programs those are running on the cluster.

Environment: Hadoop, HDFS, Pig, Sqoop, HBase, Shell Scripting, Maven, Hudson/Jenkins, Ubuntu, Linux Red Hat, Mongo DB.

Confidential, Bloomfield, C

Java/J2EE Developer

Roles and Responsibilities

  • Responsible for understanding the scope of the project and requirement gathering.
  • Review and analyze the design and implementation of software components/applications and outline the development process strategies
  • Coordinate wif Project managers, Development and QA teams during the course of the project.
  • Used Spring JDBC to write some DAO classes to interact wif the database to access account information.
  • Used Tomcat web server for development purpose.
  • Involved in creation of Test Cases for JUnit Testing.
  • Used Oracle as Database and used Toad for queries execution and also involved in writing SQL scripts, PL/SQL code for procedures and functions.
  • Used CVS, Perforce as configuration management tool for code versioning and release.
  • Used Log4J to print the logging, debugging, warning, info on the server console.
  • Extensively used Core Java, Servlets, JSP and XML
  • Developed the application in Spring for MVC and integrated wif Hibernate for ORM.
  • Developed and enhanced application in Java using Collections, Generics, Object Serialization, Multi-Threading using core java design patterns.
  • Proposed value additions for enhancement of application.
  • Implemented persistence layer using various features of Hibernate framework.
  • Developed modules using Servlets, JSP for web application.
  • Developed front end using JQuery, JavaScript, AJAX, and HTML.
  • Developed Web Services for data transfer from client to server and vice versa using SOAP and WSDL.
  • Designed and developed customized report functionalities based on the business requirement.
  • Worked on developing and leading new modules, enhancements and change requests.
  • Created Class diagrams, Sequence diagrams, Use case diagrams using Rational Rose and UML.
  • Build, Customize and maintained the continuous integration of the project/tool using Maven.

Environment: Java1.5, J2EE, XML, Spring 3.0, Log4j, CVS, Maven, Eclipse, Apache Tomcat 6, Hibernate, Servlets, JSP, JQuery, JavaScript, AJAX, HTML, SOAP, WSDL, EJB, XML, WebSphere, Rational Rose, Windows NT, UNIX and Oracle 11g.

Java/J2EE Developer

Confidential

Responsibilities:

  • Interacting wif the client on a regular basis to gather requirements.
  • Understanding the business, technical, and functional requirements.
  • Checking for timely delivery of various milestones.
  • Using Spring Framework, Axis, developed web services including design of the XML request/response structure.
  • Implemented Hibernate/Spring framework for Database and business layer.
  • Configured Oracle wif Hibernate, wrote hibernate mapping and configuration files for database processing (Create, Update, select) operations.
  • Involved in creating Oracle stored procedures for data/business logic.
  • Created PL/SQL stored procedures for Contract generation module.
  • Worked on fine-tuning the response time of Web Service components.
  • Developed user interface using JSP, Struts and Java Script to simplify the complexities of the application.
  • The entire application was developed in J2EE using an MVC based architecture wif halp of Apache Struts 1.3.8.
  • Implemented the application using the concrete principles laid down by several Java/J2EE Design patterns like Business Delegate, MVC, Singleton, Data Transfer Object (DTO) and Service Locator.
  • Coded Struts Action classes andModel classes.
  • Used JavaScript for client-side validations, and AJAX to create interactive front-end GUI.
  • Implemented client side validations using JavaScript.
  • Used Web Sphere as the application server for deployment.
  • Developed Web applications wif Rich Internet applications using Java applets, SilverLight, JavaFX.
  • Debugged and developed applications using Rational Application Developer (RAD).
  • Developed a Web service to communicate wif the database using SOAP.
  • Involved in writing stored procedures, complex queries using SQL to process the data on MYSQL DB.
  • Performed unit testing on various project modules using JUnit framework.
  • Used Apache Ant as build tool.
  • Used IBM Rational Clear Case as version control tool for maintaining source code and project documents.
  • Implemented Log4J for Logging Errors, debugging and tracking.
  • Involved in configuring and deploying of code to different environments Integration, QA and UAT.
  • Preparing and designing system/acceptance test cases and executing them.

Environment: Java 1.5, JSF Sun RI, Facelets, Richfaces, Spring, XML, XSL, XSD, XHTML, Hibernate, Oracle 9i, PL/SQL, Spring, SOAP Web service, Web Sphere, Oracle, JMX, ANT, Maven2, JUnit, SVN

Java Developer

Confidential

Responsibilities:

  • Developed Servlets and JSP based on MVC pattern using Struts Action framework.
  • Used Tiles for setting the header, footer and navigation and Apache Validator Framework for Form validation.
  • Used Log4J logging framework to write Log messages wif various levels.
  • Involved in fixing bugs and minor enhancements for the front-end modules.
  • Used JUnit framework for writing Test Classes.
  • Coded various classes for Business Logic Implementation.
  • Develop and test the code according to the requirements.
  • Preparing and executing Unit test cases.
  • Doing functional and technical reviews.
  • Support to the testing team for System testing/Integration/UAT.
  • Assuring quality in the deliverables.
  • Conducted Design reviews and Technical reviews wif other project stakeholders.
  • Implemented Services using Core Java.
  • Developed and deployed UI layer logics of sites using JSP.
  • Struts (MVC) is used for implementation of business model logic.
  • Worked wif Struts MVC objects like Action Servlets, Controllers, and Validators, Web Application Context, Handler Mapping, Message Resource Bundles and JNDI for look-up for J2EE components.
  • Developed dynamic JSP pages wif Struts.
  • Used built-in/custom Interceptors and Validators of Struts.
  • Involved in the complete life cycle of the project from the requirements to the production support.

Environment: Windows, Java 1.4, J2EE, JDBC, Servlets, JSP, Struts, Hibernate, Web services, SOAP, WSDL, Design Patterns, MVC, HTML, JavaScript 1.2, WebLogic 8.0, XML, JUnit, Oracle 10g, My Eclipse.

We'd love your feedback!