Hadoop Developer Resume
Boston, MA
SUMMARY
- Excellent application development professional with Java, Big Data and Apache Hadoop technologies.
- Over 6 years of experience in software design, development and maintenance in Big Data, Hadoop ecosystem, Java/J2EE web application and development.
- 2.5+ years of exclusive experience in Hadoop and its components HDFS, Map Reduce, Apache Pig, Hive, Sqoop, HBase, Oozie, and MongoDB.
- Experience in writing Map Reduce programs using Apache Hadoop.
- Extensive Experience in Setting Hadoop Cluster
- Excellent understanding / knowledge of Hadoop architecture and Map Reduce programming.
- Proficient in installation, configuration of Hadoop, HDFS, Sqoop.
- Good working experience on using Sqoop to import data into HDFS from RDBMS and vice - versa.
- Responsible for analyzing big data and provide technical recommendations to improve current existing systems.
- Extensive experience working in Springand Struts frameworks.
- Experience in working with persistence frameworks, Hibernate and JPA for object relational mapping with database.
- Expertise in designing and developing applications using Java/J2EE Technologies including Servlets, EJB, JSP, JDBC &JMS.
- Experience working with front end technologies HTML 5, Javascript, JQuery and AJAX.
- Worked with various projects involving XML technologies including XSL, XSLT, DOM, JDOM, SAX and XPATH.
- Extensively worked on application servers likeWebLogic 11g, WebSphere application server 6.x, and JBoss 5.0& 7.1.
- Experienced in MVC (Model View Controller) architecture and various J2EE design patterns like singleton and factory design patterns.
- Good experience in developing database programs like stored procedures, functions, triggers and packages.
- Worked onWeb Services including RESTful, SOAP, WSDL, UDDI, JAX-RS and JAXB.
- Implemented Service Oriented Architecture (SOA) using Web Services and JMS (Java Messaging Service).
- Experience working with ANT and Maven build tools.
- Fully exposed to Software Development Life Cycle including Agile and Waterfall methodology.
- Expertise in creating Conceptual Data Models, Process/Data Flow Diagrams, Case Diagrams, Class Diagrams and Sequence Diagrams.
- Proficient in preparing System Design Document and Installation Guide.
- Excellent understanding of Financial, Healthcare, Automobile, Telecom and Retail domains.
- Creative and innovative in applying technical knowledge and ability to go to the core of the problem.
TECHNICAL SKILLS
Languages: Core Java, Advanced Java, SQL, PL/SQL, WSDL, C++
Front End Technologies: HTML5, JavaScript, CSS 3, AJAX
Web Technologies: Servlets, JSP, JSTL, JDBC
Frameworks: Spring 3.0/2.5,Struts 2.0, Hibernate 4.x/3.x
Unit Test Frameworks: JUnit, Mockito
Design Methodologies: Rational Rose, MS Visio& StarUML
Application Servers: JBoss 7.1, WebSphere 6.x, WebLogic 11g, JBoss 5.0
Databases: ORACLE 9i/10g/11g, SQL Server 2008
IDEs: Eclipse, Netbeans, RAD, JDeveloper, TOAD, SQL Developer
Testing Tools: JUnit 4.x, EasyMock3.x
SCM Tools: Mercurial, GitHub, Subversion, CVS, Perforce, Clearcase
Operating Systems: Linux, Unix, Windows NT/XP/2000, MAC OS X
Build Tools: Maven 3.x, ANT 1.x
PROFESSIONAL EXPERIENCE
Confidential, Boston, MA
Hadoop Developer
Responsibilities:
- Involved in all phases of Software Development Life Cycle (SDLC).
- Coordinated with business customers to gather business requirements. And also interacted with other technical peers to derive Technical requirements.
- Worked on Installing and configuring MapReduce, HDFS and developed multiple MapReduce jobs in java for data cleaning and preprocessing.
- Developed java based mapreduce programs for custom processing
- Wrote Hive UDFs in Java where the functionality is too complex.
- Used Pig (PigLatin) scripts for ad-hoc data retrieval
- Extracted files from Cassandra through Sqoop and placed in HDFS and processed.
- Created Data model for Hive tables.
- Created Hive tables and wrote Hive queries using Hive QL
- Imported and exported data into HDFS and HIVE using Sqoop
- Responsible to manage data coming from different sources
- Monitoring the running MapReduce programs on the cluster.
- Responsible for loading data from Linux file systems to HDFS.
- Used MR Unit and Junit for unit testing.
- Monitored System health and logs and responded accordingly to any warning or failure conditions.
Environment: ApacheHadoop 2.2.0 (YARN), CDH 4 (Cloudera Distribution), Java 7, Cassandra (NoSQL), Oracle 11g/10g, MySQL, Linux, Sqoop, Hive, Oozie, Pig.
Confidential, Minneapolis, MN
Hadoop Developer
Responsibilities:
- Importing and exporting data into HDFS and Hive using Sqoop
- Implementing MR programs to analyze large datasets in warehouse for business intelligence purpose
- Experienced in managing and reviewing Hadoop log files
- Load and transform large sets of data.
- Supported Map Reduce Programs those are running on the cluster
- Involved in creating Hive tables, loading with data and writing hive queries
- Monitoring cluster performance through Ganglia
- Customizing batch Java programs & Shell script development
- Controlling & ownership of the production application & batch servers
- Writing custom made crons/scripts for proactive alerting mechanism to benefit support teams
- Production & UAT Release deployment
Environment: ApacheHadoop, CDH 3 (Cloudera Distribution),Java 7, HDFS, Hive, Sqoop
Confidential
Java/ J2EE Developer
Responsibilities:
- Used Agile as development methodology.
- Developed class diagrams and sequence diagrams using StarUML.
- Developed user interface using JSP, JavaScript and HTML5.
- Worked on AJAX implementation for retrieving the content and display it without reloading the existing page.
- Used Spring framework for Dependency Injection and integrated with Hibernate.
- Developed Persistence service layer by Using Hibernate to populate and fetch data from DB.
- Extensively worked with Hibernate Query Language (HQL) to store and retrieve the data from Oracle database.
- Implemented authentication and authorization using spring security.
- Involved in the configuration of Hibernate O/R mapping files.
- Developed shell scripts to run the nightly batch cycle and to set environment variables.
- Used Maven to build the project, run unit tests and deployed artifacts to Nexus repository.
- Involved in writing SQL queries and procedures.
- Developed RESTful Web Services to retrieve mutual funds data.
- Used SOAP UI to test the web services.
- Used JMS API for asynchronous communication to put the messages in the Message queue.
- Used log4j for logging the information.
- Used Autosys to automate the batch process.
- Involved in documenting application test results, fixing bugs and enhancements.
- Responsible for configuring and deploying application in Development environment and releasing code to engineering team for Test/Stage/Production deployment.
Environment: Eclipse, Java 1.7,JSP, HTML, JavaScript, Spring MVC, Hibernate, Jersey, SOAP UI, Oracle 11g, JBoss 7.1, JMS 1.1,ActiveMQ, Maven, AnthillPro, StarUML, JMeter, Subversion.
Confidential
Java/J2EE Developer
Responsibilities:
- Involved in development, design and upgrade for the application.
- Gathered the requirements and prepared Business Requirement Document.
- Handled all the bug fixes and made enhancements.
- Implemented MVC architecture in the project.
- Used Struts validation framework and implemented tiles framework in the presentation layer.
- Used JSTL tag libraries to reduce the scriplet coding.
- Used Hibernate in data access layer to access and update information to the database.
- Implemented security for ART application and database.
- Configured and deployed applications on JBoss Server.
- Designed UI using JSP, JQuery and HTML.
- Development of MQ application programs for Java JMS environments using queues and messages.
- Working with JMS Handling and managing exception conditions.
- Handling acknowledgements, retries, cancellations and transactions.
- Performed Unit testing using JUnit and used Log4j for logging, debugging and tracking errors.
- Implemented asynchronous messaging service using JMS to send and receive the object
- Messages between different sub systems of the application
- Exposed and consumed the services in the application using Apache CXF and Apache camel
- Developed business process documentation for identifying business risks and implementing mitigating controls and processes.
Environment: Eclipse, JSP, ANT, Struts, JavaScript, JMS, Struts, Apache Camel, Apache CXF, XML, UNIX, Oracle 10g, Multi-threading, JBoss 5.0
