We provide IT Staff Augmentation Services!

Hadoop Developer Resume

0/5 (Submit Your Rating)

Boston, MA

SUMMARY

  • Excellent application development professional with Java, Big Data and Apache Hadoop technologies.
  • Over 6 years of experience in software design, development and maintenance in Big Data, Hadoop ecosystem, Java/J2EE web application and development.
  • 2.5+ years of exclusive experience in Hadoop and its components HDFS, Map Reduce, Apache Pig, Hive, Sqoop, HBase, Oozie, and MongoDB.
  • Experience in writing Map Reduce programs using Apache Hadoop.
  • Extensive Experience in Setting Hadoop Cluster
  • Excellent understanding / knowledge of Hadoop architecture and Map Reduce programming.
  • Proficient in installation, configuration of Hadoop, HDFS, Sqoop.
  • Good working experience on using Sqoop to import data into HDFS from RDBMS and vice - versa.
  • Responsible for analyzing big data and provide technical recommendations to improve current existing systems.
  • Extensive experience working in Springand Struts frameworks.
  • Experience in working with persistence frameworks, Hibernate and JPA for object relational mapping with database.
  • Expertise in designing and developing applications using Java/J2EE Technologies including Servlets, EJB, JSP, JDBC &JMS.
  • Experience working with front end technologies HTML 5, Javascript, JQuery and AJAX.
  • Worked with various projects involving XML technologies including XSL, XSLT, DOM, JDOM, SAX and XPATH.
  • Extensively worked on application servers likeWebLogic 11g, WebSphere application server 6.x, and JBoss 5.0& 7.1.
  • Experienced in MVC (Model View Controller) architecture and various J2EE design patterns like singleton and factory design patterns.
  • Good experience in developing database programs like stored procedures, functions, triggers and packages.
  • Worked onWeb Services including RESTful, SOAP, WSDL, UDDI, JAX-RS and JAXB.
  • Implemented Service Oriented Architecture (SOA) using Web Services and JMS (Java Messaging Service).
  • Experience working with ANT and Maven build tools.
  • Fully exposed to Software Development Life Cycle including Agile and Waterfall methodology.
  • Expertise in creating Conceptual Data Models, Process/Data Flow Diagrams, Case Diagrams, Class Diagrams and Sequence Diagrams.
  • Proficient in preparing System Design Document and Installation Guide.
  • Excellent understanding of Financial, Healthcare, Automobile, Telecom and Retail domains.
  • Creative and innovative in applying technical knowledge and ability to go to the core of the problem.

TECHNICAL SKILLS

Languages: Core Java, Advanced Java, SQL, PL/SQL, WSDL, C++

Front End Technologies: HTML5, JavaScript, CSS 3, AJAX

Web Technologies: Servlets, JSP, JSTL, JDBC

Frameworks: Spring 3.0/2.5,Struts 2.0, Hibernate 4.x/3.x

Unit Test Frameworks: JUnit, Mockito

Design Methodologies: Rational Rose, MS Visio& StarUML

Application Servers: JBoss 7.1, WebSphere 6.x, WebLogic 11g, JBoss 5.0

Databases: ORACLE 9i/10g/11g, SQL Server 2008

IDEs: Eclipse, Netbeans, RAD, JDeveloper, TOAD, SQL Developer

Testing Tools: JUnit 4.x, EasyMock3.x

SCM Tools: Mercurial, GitHub, Subversion, CVS, Perforce, Clearcase

Operating Systems: Linux, Unix, Windows NT/XP/2000, MAC OS X

Build Tools: Maven 3.x, ANT 1.x

PROFESSIONAL EXPERIENCE

Confidential, Boston, MA

Hadoop Developer

Responsibilities:

  • Involved in all phases of Software Development Life Cycle (SDLC).
  • Coordinated with business customers to gather business requirements. And also interacted with other technical peers to derive Technical requirements.
  • Worked on Installing and configuring MapReduce, HDFS and developed multiple MapReduce jobs in java for data cleaning and preprocessing.
  • Developed java based mapreduce programs for custom processing
  • Wrote Hive UDFs in Java where the functionality is too complex.
  • Used Pig (PigLatin) scripts for ad-hoc data retrieval
  • Extracted files from Cassandra through Sqoop and placed in HDFS and processed.
  • Created Data model for Hive tables.
  • Created Hive tables and wrote Hive queries using Hive QL
  • Imported and exported data into HDFS and HIVE using Sqoop
  • Responsible to manage data coming from different sources
  • Monitoring the running MapReduce programs on the cluster.
  • Responsible for loading data from Linux file systems to HDFS.
  • Used MR Unit and Junit for unit testing.
  • Monitored System health and logs and responded accordingly to any warning or failure conditions.

Environment: ApacheHadoop 2.2.0 (YARN), CDH 4 (Cloudera Distribution), Java 7, Cassandra (NoSQL), Oracle 11g/10g, MySQL, Linux, Sqoop, Hive, Oozie, Pig.

Confidential, Minneapolis, MN

Hadoop Developer

Responsibilities:

  • Importing and exporting data into HDFS and Hive using Sqoop
  • Implementing MR programs to analyze large datasets in warehouse for business intelligence purpose
  • Experienced in managing and reviewing Hadoop log files
  • Load and transform large sets of data.
  • Supported Map Reduce Programs those are running on the cluster
  • Involved in creating Hive tables, loading with data and writing hive queries
  • Monitoring cluster performance through Ganglia
  • Customizing batch Java programs & Shell script development
  • Controlling & ownership of the production application & batch servers
  • Writing custom made crons/scripts for proactive alerting mechanism to benefit support teams
  • Production & UAT Release deployment

Environment: ApacheHadoop, CDH 3 (Cloudera Distribution),Java 7, HDFS, Hive, Sqoop

Confidential

Java/ J2EE Developer

Responsibilities:

  • Used Agile as development methodology.
  • Developed class diagrams and sequence diagrams using StarUML.
  • Developed user interface using JSP, JavaScript and HTML5.
  • Worked on AJAX implementation for retrieving the content and display it without reloading the existing page.
  • Used Spring framework for Dependency Injection and integrated with Hibernate.
  • Developed Persistence service layer by Using Hibernate to populate and fetch data from DB.
  • Extensively worked with Hibernate Query Language (HQL) to store and retrieve the data from Oracle database.
  • Implemented authentication and authorization using spring security.
  • Involved in the configuration of Hibernate O/R mapping files.
  • Developed shell scripts to run the nightly batch cycle and to set environment variables.
  • Used Maven to build the project, run unit tests and deployed artifacts to Nexus repository.
  • Involved in writing SQL queries and procedures.
  • Developed RESTful Web Services to retrieve mutual funds data.
  • Used SOAP UI to test the web services.
  • Used JMS API for asynchronous communication to put the messages in the Message queue.
  • Used log4j for logging the information.
  • Used Autosys to automate the batch process.
  • Involved in documenting application test results, fixing bugs and enhancements.
  • Responsible for configuring and deploying application in Development environment and releasing code to engineering team for Test/Stage/Production deployment.

Environment: Eclipse, Java 1.7,JSP, HTML, JavaScript, Spring MVC, Hibernate, Jersey, SOAP UI, Oracle 11g, JBoss 7.1, JMS 1.1,ActiveMQ, Maven, AnthillPro, StarUML, JMeter, Subversion.

Confidential

Java/J2EE Developer

Responsibilities:

  • Involved in development, design and upgrade for the application.
  • Gathered the requirements and prepared Business Requirement Document.
  • Handled all the bug fixes and made enhancements.
  • Implemented MVC architecture in the project.
  • Used Struts validation framework and implemented tiles framework in the presentation layer.
  • Used JSTL tag libraries to reduce the scriplet coding.
  • Used Hibernate in data access layer to access and update information to the database.
  • Implemented security for ART application and database.
  • Configured and deployed applications on JBoss Server.
  • Designed UI using JSP, JQuery and HTML.
  • Development of MQ application programs for Java JMS environments using queues and messages.
  • Working with JMS Handling and managing exception conditions.
  • Handling acknowledgements, retries, cancellations and transactions.
  • Performed Unit testing using JUnit and used Log4j for logging, debugging and tracking errors.
  • Implemented asynchronous messaging service using JMS to send and receive the object
  • Messages between different sub systems of the application
  • Exposed and consumed the services in the application using Apache CXF and Apache camel
  • Developed business process documentation for identifying business risks and implementing mitigating controls and processes.

Environment: Eclipse, JSP, ANT, Struts, JavaScript, JMS, Struts, Apache Camel, Apache CXF, XML, UNIX, Oracle 10g, Multi-threading, JBoss 5.0

We'd love your feedback!