SUMMARY

• 7+ years of overall experience in applications development, integration, maintenance and support using Java/J2EE, Hadoop platforms.
• Strong understanding of Hadoop ecosystem components like MapReduce, Pig, Hive, Hbase, Oozie, Sqoop, Flume, Cloudera Manager, Hadoop YARN, Zookeeper.
• Experience with agile development model working on complete Software Design Lifecycle including design, development, testing and implementation of moderate to advanced complex systems.
• Strong in developing Map Reduce applications, MRUnit Test, analyzing and processing data using Hive and Pig, creating Map Reduce workflows.
• Good Understanding on Hadoop YARN(Yet Another Resource Negotiator) Architecture.
• Implemented various ETL activities using Pig, Hive and Sqoop. Worked with Sequence file and Avro formats.
• Written unit test cases using JUnit and MRUnit for MapReduce jobs.
• Good knowledge in programming JDBC, Servlets and JSP.
• Experience in working with ETL workflow.
• Proficient in writing MapReduce jobs, HiveQL queries and Pig based scripts.
• Configuring Sqoop and Flume to respective RDBMS and Servers to load data to HDFS.
• Expertise in Object Oriented Programming using Java and J2EE related technologies.
• Excellent understanding and knowledge of Nosql databases like HBase and Cassandra.
• Experienced with Agile SCRUM methodology, involved in design discussions and work estimations, takes initiatives, very proactive in solving problems and providing solutions.
• Hands on experience in Analysis, Design, Coding and Testing phases of Software Development Life Cycle (SDLC).
• Ability to learn rapidly and be productive in new areas.

TECHNICAL SKILLS

Hadoop Ecosystem: MapReduce, Pig, Hive, Oozie, Sqoop, Flume, Hadoop YARN, Zookeeper

Languages: Java, Java Script, XML, XSL, XSLT, SQL and PL/SQL

Hadoop Distributions: Apache, Cloudera, Hortonworks

No - sql Databases: Hbase, Cassandra

Databases: Oracle, MySQL

Web Frameworks: Servlets, JSP, Spring MVC, Struts, Hibernate, Apache Axis2

Operating Systems: Windows 7, Linux, Cent OS, Ubuntu

Tools: Oracle SQL Developer, Toad

IDE: Eclipse, Intellij

Framework: Play Framework, Spring Framework

Indexes: Elastic Search

Testing Frameworks: Selenium WebDriver, Apache JUnit, Apache MRUnit

PROFESSIONAL EXPERIENCE

Confidential, TX

Hadoop Developer

Responsibilities:

• Designing and creating stories for the development and testing of the application.
• Developing Java MapReduce programs for grouping the data and to calculate the algebraic calculations for the reducer.
• Configuring and performance tuning the sqoop jobs for importing the input (raw) data from the data warehouse.
• Developing hive queries using partitioning, bucketing and windowing functions.
• Optimized hive joins for large tables and developed map reduce code for the full outer join of two large tables.
• Designed and developed entire pipeline from data ingestion to reporting tables.
• Creating the raw Avro data for an efficient feed to the map reduce processing.
• Design and Develop Pig Latin scripts and Pig command line transformations for data joins and custom processing of Map reduce outputs.
• Creating Hbase tables for random read/writes by the map reduce programs.
• Creating hive tables to the imported data for validation and debugging.
• Creating data model, schemas and stored procedures for reporting database.
• Creating Liquibase project for tracking and propagating reporting database changes.
• Designing and creating Oozie workflows to schedule and manage Hadoop, java, pig and sqoop jobs.
• Implemented custom workflow scheduler service to manage multiple independent workflows. Implemented a web application which uses Oozie Rest API and schedule jobs.
• Actively involved in developing front end spring web application for consumers to create custom profiles for data processing.
• Actively involved in deploying and testing the application in different environments.
• Configuring Hadoop Environment: Kerberos authentication, DataNodes, NameNodes, MapReduce, Hive, Pig, Sqoop, Oozie workflow engine

Environment: Hadoop, MapReduce, HDFS, Pig, Hive, Hbase, Oozie, Cloudera CDH4.5, Cloudera CDH5.1.3, Kerberos security, SQL, Linux, Java, J2EE, Web services, DB2, Netezza.

Confidential, NJ

Hadoop Developer

Responsibilities:

• Worked on performing minor upgrade of Hadoop Cluster from CDH3-u4 to CDH3-u6.
• Wrote scripts to monitor the health of hadoop daemon services and act accordingly.
• Experience in working with High transactional NoSQL databases like hbase.
• Imported data from Hbase using the Mapreduce Java API and parsed cleansed and mined useful and meaningful data in HDFS using Map-Reduce for further analysis.
• Good at understanding the Hbase Architecture for reads and writes.
• Performed analysis on structured and semi-structured data in HDFS and Hive.
• Fine tuning hive jobs for optimized performance.
• Configured hive metastore in MYSQL database to establish multiple connections from clients.
• Wrote custom UDF’s and UDAF’s in Hive for record and batch processing of data.
• Implemented Partitioning, Dynamic Partitions, Buckets in HIVE.
• Implemented the daily workflow for extraction, processing and analysis of data with Oozie.
• Used HBase on the back-end of the application for faster read/writes of the real-time data coming from the customers.
• Wrote Map-reduce scripts to import data into HBase, Performed batch processing on the data in HBase as per the BI team requirements.
• Used Pig as ETL tool to do transformations, event joins and some pre-aggregations before storing the data onto HDFS.
• Synchronized the workflow for Hive, Pig, and MapReduce jobs with OOZIE.
• Computed various metrics using Java MapReduce to calculate metrics that define user experience, revenue etc.

Environment: Java/J2EE, Mapreduce, Oozie, Pig, Hive, Sqoop, Hbase

Confidential

Java Developer

Responsibilities:

• Followed agile methodology and involved in various phases of Software Development Life Cycle (SDLC) of the web/desktop application like Requirement gathering, Design, Analysis and Code development.
• Developed a prototype of the application and demonstrated to business users to verify the application functionality.
• Designed High-level Design (HLD), Functional requirements and discussed the new functionality in team meetings.
• Used Eclipse as development environment and deployed application on Weblogic Application server.
• Developed and implemented the MVC Pattern using JSP/Servlets, Spring frameworks for Web Applications.
• Implemented server side tasks using Servlets and XML.
• Helped developed page templates using Spring framework.
• Extensively used Core Java concepts such as Multi-Threading, Exceptions, and Collections etc in Application.
• Created and deployed web pages using HTML, JSP, JavaScript and CSS.
• Written JUnit Test cases for performing unit testing.
• Implemented Java/J2EE Design patterns like Singleton, Factory patterns.
• Worked with QA team for testing and resolving defects.
• Communicated with the third party applications for Integration.
• Had Client interactions, Knowledge management and sharing.
• Updated the database information with the customer changed profiles.
• Developed a Login and Registration API to manage the personal information of the customer and storing them in LDAP.
• Integrating with third party applications which are used to manage customer secured information such as Register, forgot password, forgot username, update profile etc and simultaneously mail the customer on any updates. All the redirections and mail content are manipulated based on application ID.
• Expertise on High level design, Low level design, Coding, Unit testing, Integration testing and Load testing.
• Provided Technical support for production environments resolving the issues, analyzing the defects, providing and implementing the solution defects. Resolved more priority defects as per the schedule.

Environment: Java, JDBC, JSP, Servlets, HTML, JUnit, Oracle10g, SQL, Eclipse IDE, XMLSpring, Hibernate

Confidential

Programmer

Responsibilities:

• Involved in requirements analysis and use case development.
• Developed many JSP pages, used Java Script for client side validation.
• Implementing GUI using Strut’s Framework.
• Developed Servlets, JSP Pages using Custom Tags.
• Involved in Configuring web.xml and spring-config.xml according to the Spring framework.
• Hibernate is used to interact with Database.
• Used Spring’s Dependency Injection, AOP Framework’s etc.
• Used Hibernate Session management and HQL to retrieve data from Oracle database.
• Developed Stored Procedures in Oracle.
• Implemented connection pooling using oracle.
• Configured JMS Queue’s, Queue Connection Factories.
• Worked with JPA queries for performance improvements.
• Prepared utilities for the Unit -Testing of Application Using Junit.
• SVN (Subversion) is used for version control.

Environment: Core Java 1.4, Servlets, JSP, EJB(Message Driven Beans), JMS, Spring, Hibernate 3.2.1, Oracle 10g, JUnit, Eclipse 3.2, Spring Source Tool Suite, Apache Tomcat 5.0, Weblogic Application Server, Log4J 1.2 8, HTML, SQL, Windows NT.