Hadoop Engineer Resume
Burlington, MA
SUMMARY
- More than 7 Years of experience on gathering System Requirements, Analyzing the requirements, Designing and developing systems.
- Experienced Hadoop/Java developer having end to end experience in developing applications in Hadoop ecosystem
- Experience in understanding the client’s Big Data business requirements and transform it into Hadoop centric technologies.
- Experience in developing customized UDF’s in java to extend Hive and Pig Latin functionality
- Experience in defining job flows in Hadoop environment by using Oozie for data processing
- Experience in importing and exporting data from different databases like MySQL, Oracle into HDFS and Hive using Sqoop
- Sound knowledge on shell scripting
- Good knowledge of all phases of the Iterative Software Development Life Cycle (SDLC).
- Core competencies include designing and developing applications usingjdk1.4, jdk1.5and jdk1.6.
- Sound knowledge of web applications using JSP, Servlets, EJB, RMI, JSF and JDBC.
- Strong experience of frameworks Spring, Struts, Hibernate.
- Sound knowledge of XML Transformations using XSL, XSLT for XML to HTML transformation.
- Experience in using tools like Ant, Maven.
- Good experience of Databases such as Oracle, DB2 etc.
- Good knowledge of SQL, PL/SQL.
- Excellent knowledge of Web Services using SOAP, WSDL, XML DOM.
- Developed applications using IDEslike IBM RAD,Eclipse and Netbeans.
- Sound experience with application servers like Weblogic, WebSphere, and Apache Tomcat.
- Experience with Object to Relational Mapping tools (Hibernate) and Model Driven Architecture supporting tools.
TECHNICAL SKILLS
Hadoop: HDFS, Map - Reduce, Hive, Pig, Sqoop, Flume, Zookeeper & Oozie
Language: Java
Web Technologies: Servlets, JSP,JDBC, RMI
Scripting: HTML, JavaScript, AJAX, DHTML, XML, and XSL/XSLT
Frameworks: Spring2.x, Hibernate
Web Services: JAX-WS, JAX-B, WSDL, UDDI, SOAP
Application/Web Servers: IBM WebSphere 6.1, BEA WebLogic 6.x/8.x,Apache Tomcat, JBOSS 4.0, Glassfish
RDBMS/Databases: Oracle10g and MS-SQL Server
Tools: RAD, Eclipse, Rational Rose, JDeveloper, NetBeans, Toad, Sql developer
Operating Systems: Windows2003, Unix, Linux
Build Tools: ANT, Maven
Unit Testing Tools: Junit3/4
Version Control Tools: Subversion, CVS, And IBM Rational Clear Case
PROFESSIONAL EXPERIENCE
Confidential, Burlington, MA
Hadoop Engineer
Responsibilities:
- Developed map reduce programs in java
- Written Hive queriesand Hive UDF’s.
- Implemented partitioning, dynamic partitions, bucketsin Hive.
- Created partitioning tables using Hive, and stored data in S3.
- Configured Oozie and implementedworkflows.
- Written shell scripts to call Oozie workflows.
- Written java code using cdh4 packages to copy files from NFS to HDFS
- Configured and installed Hive on Amazon Emr cluster
- Involved in copying data from Hadoop physical cluster to S3 bucket
- Involved in Sqooping data from Hdfs to Data warehousing system’s using Sqoop
- Worked under Scrum methodology in whole project
- Implemented unit test cases for all java MR jobs using MRUnit
Environment: JDK1.6, Python,Red Hot Linux, HDFS, Map-Reduce, MRUnit, Hive, Pig, Sqoop, Flume, Zookeeper, Oozie, AWS, S3,Jira, Scrum, Teradata, Cdh4,HBase, Maven.
Confidential, Pleasanton, CA
Hadoop Developer
Responsibilities:
- Written map-reduce programs for extracting different patterns of data from Hadoop cluster
- Worked closely with business people to get the requirements and analyzing the business functionalities
- Dumped the data using Sqoop into HDFS for analyzing.
- Developed ad-hoc queries and data metrics on large data sets stored in Hadoop file system using PIG.
- Worked on data migration from existing data sources to Hadoop File System.
- Involved in developing design doc for different kinds of transactional data
- Configured Hadoop in Linux and deploying application.
- Setup/Install Hadoop on 10 Physical nodes.
- Implemented unit testing using MRUnit framework
Environment: JDK1.6,Red Hot Linux, HDFS, Map-Reduce, MRUnit, Hive, Pig, Sqoop, Flume, Zookeeper, Oozie, Netezza, Teradata, DB2, Scrum.
Confidential, Pleasanton, CA
Responsibilities:
- Involved in design and development phases of Software Development Life Cycle (SDLC) using Scrum methodology
- Involved in analysis and design requirements documents.
- Involved in creating POJO classes using Hibernate Persistence framework. And used XML mapping files to describe the relationship between database tables and class attributes.
- Used spring framework for Dependency Injection (IOC) integrated with Hibernate.
- Implemented Spring Web Services for sending and retrieving data from different applications using Restful protocol.
- Involved in implementing front end form development using JavaScript
- Developed the data grid JavaScript component for displaying TOGM application offer details
- Implemented drop down control for coupon deals and promotional period
- Worked inScrum development environment.
- Involved in creating Junit test cases and integration testing.
Environment: JDK1.6, Scrum, J2EE, HTML, JSP, Spring (IOC), JQuery, Web Logic, Tomcat, Hibernate, JavaScript, Maven, CSS, DB2, XML, Eclipse, JUnit, Log4j, and Web Services
Confidential, Sacramento CA
Java Developer
Responsibilities:
- Designed the application UML Class Diagrams, Sequence diagrams using RSA.
- Involved in creating technical design for the project along with core team members.
- Interaction with business requirements team and developed business process
- Developed task utility services necessary for generating documents
- Develop utility classes using TDD
- Developed code to validate the state of Business Objects (POJO’S) using singleton pattern
- Used spring DI for object creation throughout the project
- Contributed to the screen flow (UI) using JSF frame work
- Designed XML files to implement most of the wiring need for Hibernate annotations and spring configurations.
- Worked on Hibernate object/relational mapping according to database schema.
- Creating Unit test Packages with JUnit.
Environment: JDK1.5,Scrum, J2EE, HTML, JSP, Springs (IOC and AOP), JSF, Web Sphere, Hibernate, JavaScript, Maven, CSS, DB2, XML, UML, XSLT, FTP, HTTP, RSA7.0, JUnit, Log4j, Apache Velocity, JMS, JDBC, EJB and Web Services
Confidential, New York, NY
Java Developer
Responsibilities:
- Analysis and understanding of business requirements.
- Developed application using Spring MVC, JSP, JSTLand AJAX on the presentation layer, the business layer is built using spring and the persistent layer uses Hibernate 3.0.
- Developed views and controllers for client and manager modules using Spring MVC 3.0and Spring Core 3.0.
- Business logic is implemented using Spring Core 3.0and Hibernate 3.0.
- Data Operations are performed using Spring ORMwiring with Hibernate and Implemented Hibernate Templateand criteria API for Querying database.
- Developed Exception handling framework and used log4J for logging.
- Developed Web Services using XML messages that use SOAP. Developed Web Servicesfor Payment Transaction and Payment Release.
- Developed Restful web Services
- Created WSDL and the SOAPenvelope.
- Developed and modified database objects as per the requirements.
- Involved in Unit integration, bug fixing, acceptance testing with test cases, Code reviews.
Environment: Java/J2EE, JSP, CSS, Java Script, AJAX, Hibernate 3, Spring 3.0, XML, Web Services, SOAP, Restful, Maven, Rational Rose, HTML, Log4J, JBoss 4
Confidential, Los Angles, CA
J2EE Developer
Responsibilities:
- Involved in design and development phases of Software Development Life Cycle (SDLC)using Scrum methodology
- Used Spring 2.0 Frameworkfor Dependency injection and integrated it with the Struts Framework and Hibernate.
- Implemented the application using the concrete principles laid down by several design patterns such as MVC-2, Business Delegate, Data Access Object and Singleton.
- Developed user interface using JSP, JSP Tag libraries, Ajax, Struts Tag libraries and Java Script to simplify the complexities of the application.
- Used Java Messaging Services (JMS) for reliable, asynchronous communication to send automatic email notifications to clients.
- Implemented Model View Controller (MVC-2) architecture using Jakarta Struts 2.0 Framework at presentation tier.
- Created Action Classes which route submittals to appropriate Business Delegate and render retrieved information.
- Validated all forms using Struts validation frameworkand implemented Tilesframeworkin the presentation layer.
- Extensively used Hibernate3.0 in data access layer to access and update information in the database.
- Used WebServices to prefilled data from Crcprefill.
- Used Xfire&Wsgen to generate classes from WSDL, XSD.
- Expertise in implementing Service Oriented Architectures (SOA) with XML based Web Services (SOAP/UDDI/WSDL).
- Used JAXB XML parsersfor data retrieval.
- Used MyEclipse 6.0.1for writing code.
- Used JBOSS 4.0.3for deploying various components of application.
- Designed various tables required for the project in Oracle10g databaseand used theStored Procedures in the application.
- Developed JUnittest cases for all the developed modules using mock Object.
- Used Log4Jfor logging and tracing the messages.
- Used CVS for version control across common source code used by developers.
Environment: MyEclipse 6.0.1, JBOSS 4.0.3, JSP 2.0, Servlets 2.3, Ajax, Struts 2.0, Spring 2.0, Hibernate 3.0, JMS 1.1, XML, WebServices, SOAP, WSDL, JAXB, Xfire, Wsgen, Log4J, JUnit, Crap4J, ANT, Maven 2.0, JavaScript, Microsoft Script Editor, Scrum, HTML, CVS, PL/SQL, Oracle 10g, Rational Rose, Windows XP.
Confidential, Boston, MA
Java Developer
Responsibilities:
- Interacted closely with business users to gather the requirements and conducted review meetings
- Architected and designed the application by adopting various J2EE Patterns and Open source Frameworks like Struts, Spring and Hibernate.
- Create and manage the Hibernate configuration.
- Implemented Security Framework to enableauthorization and authentication
- Developed Java Classes using Various Design Patterns like Factory, MVC, VO, Singleton and Delegate.
- Used Eclipse 3.1 to code Java classes, JSP and Tag library for various web Modules like Security Setup, Curvesand Derivatives Linking
- Worked on schema design, SQL, Triggers and Stored Procedures
- Setup Web Logic, Domain, Admin sever, Managed Server and Connection Pool
- Developed XML and processed using XML DOM.
- Coded JavaScript for AJAX and client side data Validation
- Managed project artifacts, including program code using Accurevsource control
- Automated build process using Hudson and Ant
- Responsible for Production Release and support
Environment: Java 5, JSP, Oracle 10G, XML, Eclipse 3.10, AJAX, Struts, Spring, Hibernate, MDP, MQ, Weblogic 9.2, Windows XP Professional and UNIX.
Confidential
Project Trainee
Responsibilities:
- Documented and organized the requirements for a system.
- Developed web applications.
- Tested and ensured software quality.
Environment: Java Servlet, JSP, Oracle 8i. Java Script, HTML