SUMMARY

• Over 8 years of experience in Hadoop, Java and J2EE. About 3 years of experience in Hadoop technologies like MapReduce, Pig, Hive, HBase, SQOOP and Oozie.
• Around 3 years of experience in development and support related activities for Java/J2EE technologies
• Around 2 years of experience in Forte 4GL (OOPS)
• Ability to optimize the usage of Hadoop to get maximum performance
• Experience in installation, configuration, management and deployment of Big Data solutions and underlying infrastructure of Hadoop cluster
• Experience in designing, developing and implementing connectivity products that allows efficient exchange of data between our core database engine and the ecosystem in Hadoop
• Well experienced Mapper, Shuffling, Partitioner, Reducer and Combiner process along with custom Partitioning for efficient Bucketing
• Proficient in working with Hadoop, HDFS, writing Hive and PIG scripts
• Experience in importing and exporting data using SQOOP from HDFS to RDBMS and vice - versa
• Experience in extending Hive and Pig core functionality by writing custom UDFs
• Expertise with querying relational database using SQL
• Expertise in shell scripting on UNIX platform
• Knowledge in JEE application servers like Apache Tomcat
• Knowledge in JEE compliant IDE’s like Eclipse
• Hands on experience in developing the applications with java, JDBC, JNDI, J2EE, J2EE - servlets, JSP, EJB, SOAP, Web Services, Hibernate, Struts, Spring, XML, HTML, XSD, PL/SQL, Oracle10g
• In depth knowledge of Object Oriented Programming methodologies (OOPS) and object oriented features like Inheritance, Polymorphism, Exception handling
• Experience in Relational Databases primarily like Oracle, SQL Server, MySQL and knowledge of non-relational and NOSQL database HBase
• Experience in writing test cases and unit testing
• Experience in full Software Development Life Cycle (SDLC), which includes Designing, Developing, Testing and Implementation
• Excellent technical, logical, code debugging and problem solving capabilities and ability to watch the future environment and customer probable activities carefully
• Experience in Business Requirements Analysis, Application Design, Development, Data Conversion, Implementation and different aspects of software development like Coding and Testing as both Developer and Analyst
• Handled several techno-functional responsibilities including estimates, identifying functional and technical gaps, requirements gathering, designing solutions, development, developing documentation, and production support
• Ability to work independently as well as in a team and able to effectively communicate with customers, peers and management at all levels in and outside the organization

TECHNICAL SKILLS

Hadoop: Ecosystem Hadoop, MapReduce, Hive, Pig, SQOOP, YARN, Oozie, Zookeeper, Flume

Programming Languages: Core Java, J2EE, C

Frameworks: MVC, Struts

Web/Application Servers: Apache Tomcat

Databases: Oracle 11g/12c, SQL Server 2012

IDE’s & Utilities: Eclipse, SQL Developer

Web Technologies: HTML 5, CSS 3, XML

Scripting Languages: JavaScript

Operating Systems: UNIX, WINDOWS, MAC

PROFESSIONAL EXPERIENCE

Sr Hadoop Developer

Confidential, Miami FL

Responsibilities:

• Coordinated with business customers to gather business requirements. And also interact with other technical peers to derive Technical requirements and delivered the BRD and TDD documents.
• Extensively involved in Design phase and delivered Design documents.
• Worked on analyzing Hadoop cluster and different Big Data analytic tools including Pig, Hive HBase database and SQOOP.
• Installed Hadoop, Map Reduce, HDFS, and Developed multiple map reduce jobs and Hive for data cleaning and pre-processing.
• Importing and exporting data into HDFS and Hive using SQOOP.
• Migration of huge amounts of data from different to Hadoop.
• Written Hive jobs to parse the logs and structure them in tabular format to facilitate effective querying on the log data.
• Involved in creating Hive tables, loading with data and writing hive queries that will run internally in map reduce way.
• Experienced in defining job flows.
• Involved in loading data from UNIX file system to HDFS.
• Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting.
• Experienced in managing and reviewing the Hadoop log files.
• Used Pig as ETL tool to do Transformations, even joins and some pre-aggregations before storing the data onto HDFS.
• Load and Transform large sets of structured and semi structured data.
• Responsible to manage data coming from different sources.
• Involved in creating Hive Tables, loading data and writing Hive queries.
• Utilized Apache Hadoop environment by Hortonworks.
• Created Data model for Hive tables.
• Exported data from HDFS environment into RDBMS using SQOOP for report generation and visualization purpose.
• Worked on Oozie workflow engine for job scheduling.
• Involved in Unit testing and delivered Unit test plans and results documents.

Environment: Hadoop, MapReduce, HDFS, Hive, Pig, Hue, Java, SQL, Oracle, SQOOP, Flume, Oozie, Java 8, Unix, Eclipse.

Hadoop Developer

Confidential - Evanston, IL

Responsibilities:

• Installed and configured Apache Hadoop to test the maintenance of log files in Hadoop cluster.
• Installed and configured Hive, Pig, Sqoop, Flume and Oozie on the Hadoop cluster.
• Installed Oozie workflow engine to run multiple Hive and Pig Jobs.
• Setup and benchmarked Hadoop /HBase clusters for internal use.
• Developed Java MapReduce programs for the analysis of sample log file stored in cluster.
• Developed Simple to complex Map/reduce Jobs using Hive and Pig.
• Developed Map Reduce Programs for data analysis and data cleaning.
• Developed PIG Latin scripts for the analysis of semi structured data.
• Developed and involved in the industry specific UDF (user defined functions)
• Used Hive and created Hive tables and involved in data loading and writing Hive UDFs.
• Worked on debugging, performance tuning of Hive & Pig Jobs.
• Developed Hive queries to process the data for visualizing.
• Implemented Partitioning, Dynamic Partitions, Buckets in Hive.
• Worked on tuning the performance Pig queries.
• Used Sqoop to import data into HDFS and Hive from other data systems.
• Involved in loading data from LINUX file system to HDFS.
• Developed Unix Scripts to data loading and automation.
• Supported Map Reduce Programs those are running on the cluster.
• Gained experience in managing and reviewing Hadoop log files.
• Continuous monitoring and managing the Hadoop cluster using Cloudera Manager.
• Developed Pig Latin scripts to extract data from the web server output files to load into HDFS.
• Involved in developing Hive DDLs to create, alter and drop tables.
• Created and maintained technical documentation for launching Hadoop clusters and for executing Hive queries and Pig Scripts.

Environment: Apache Hadoop, HDFS, Cloudera Manager, Java, MapReduce, Eclipse Indigo, Hive, PIG, Sqoop, Oozie, Unix and SQL.

Java Developer

Confidential, Trenton, NJ

Responsibilities:

• Worked with customers to gather requirements and develop use cases, project and test plans.
• Involved in developing the UI pages using HTML, DHTML, Java script, AJAX, JQUERY, JSP and tag libraries etc.
• Involved in creating & consuming the WSDL based web services using WSDL, SOAP, XSD etc.
• Created new connections through application coding for better access to DB2 database and involved in writing SQL & PL SQL - Stored procedures, functions, sequences, triggers, cursors, object types etc.
• Worked on advanced level programming in C/C++ including thread synchronization multithreading, multi processing, concurrency and TCP/IP Socket Programming.
• Developed Session Beans to encapsulate the business logic and Entity beans as the persistence objects.
• Designed and developed User Interface Screens using HTML, DHTML and JSP.
• Developed EJB-Session Beans that implements the business logic.
• Involved in developing application using Spring MVC and also used other modules of Spring DI & AOP.
• Helped new team members & junior developers to make them on the board easily.
• Involved in writing developer test cases & scope & traceability matrix.

Environment: Java 1.5, J2EE, HTML, DHTML, JavaScript, CSS, Servlets, JSP, Web Sphere Application Server, Spring-DI, MVC, JUNIT, Oracle, XML, Unix, Putty, SQL.

Java Developer

Confidential

Responsibilities:

• Involved in the analysis, design, implementation, and testing of the project
• Implemented presentation layer with HTML, XHTML and JavaScript
• Involving in creation object model to relational using hibernate
• Developed web components using JSP, Servlets and JDBC
• Implemented database using SQL Server
• Designed tables and indexes
• Wrote complex SQL and stored procedures
• Involved in fixing bugs and unit testing with test cases using JUnit.
• Risk analysis and Issue escalation to the Management.
• Developed user and technical documentation

Environment: Java, SQL, Servlets, HTML, XML, Hibernate, JavaScript, Spring

Associate System Engineer

Confidential

Responsibilities:

• Involved in analysis, design, implementation, and testing of the project.
• Implemented the presentation layer using Forte 4GL components.
• Implemented business layer using Objected Oriented Principles of Forte 4GL.
• Implemented XML for communication with other modules web services.
• Implemented business logic using Java.
• Involved in fixing bugs and unit testing with test cases.
• Provided support during installation phase.
• Involved in resolving critical production tickets.
• Analyzing the Server logs for errors and exceptions.
• Developed user and technical documentation.
• Involved in peer-to-peer review.
• Risk analysis and Issue escalation to the Management.
• Participating in the Client meetings and updating the weekly status.
• Conducting KT sessions and hands-on training to the Teams at offshore.

Environment: Forte 4GL, SQL developer, Oracle 10g, SOAP, Java 1.5, MQC, Eclipse