SUMMARY:

• 8+ years of extensive IT experience in all phases of Software Development Life Cycle (SDLC) with skills in data analysis, design, development, testing and deployment of software systems.
• 4+ years of strong experience, working on Apache Hadoop ecosystem components like MapReduce, HDFS, HBase, Hive, Sqoop, Pig, Oozie, Zookeeper, Flume with CDH4&5 distributions and EC2 cloud computing with AWS.
• Worked with different flavours of Hadoop distributions which includes Cloudera and Hortonworks.
• Experienced in analysing data using HQL, Pig Latin and extending HIVE and PIG core functionality by using custom UDFs.
• Good understanding of NoSQL databases and hands on experience in writing applications on NoSQL databases like Hbase.
• Involved in importing Streaming data using FLUME to HDFS and analysing using PIG and HIVE.
• Configured Zookeeper to coordinate the servers in clusters to maintain the data consistency.
• Implemented POC's to migrate map reduce programs into Spark transformations using spark and Scala.
• Good knowledge on various scripting languages like Linux/Unix shell scripting and Python.
• Experienced in installation, configuration, supporting and managing of Big Data and underlying infrastructure of Hadoop Cluster.
• Used Oozie, ControlM and Autosys workflow engine for managing and scheduling Hadoop Jobs.
• Proficient in Data Warehousing, Data Mining concepts and ETL transformations from Source to target systems.
• Diverse experience in working with variety of Database like Teradata, Oracle, MySql, IBM DB2 and Netezza.
• Good knowledge in Core Java and J2EE technologies such as Hibernate, JDBC, EJB, Servlets, JSP, JavaScript, Struts and Spring.
• Experienced in using IDEs and Tools like Eclipse,NetBeans, GitHub, Jenkins, Mavenand IntelliJ.
• Strong team player, ability to work independently and in a team as well, ability to adapt to a rapidly changing environment, commitment towards learning, Possess excellent communication, project management, documentation, interpersonal skills.

TECHNICAL SKILLS:

Big Data: Hadoop, HDFS, MapReduce, Hive, Sqoop, Pig, HBase, Flume, Zookeeper, Oozie, Impala, Kafka.

Databases: SQL Server, MySQL, Oracle, Hbase, Netezza.

Languages: SQL, PL/SQL, HTML, Java,J2EE, JSP, Servlets, Hibernate, JDBC JSP, UNIX Shell Scripting, Python

Tools: Eclipse, NetBeans, Jenkins, IntelliJ, Maven, Anthill

Version Control: GitHub, SVN

Operating Systems: Windows Server 2008/2012, UNIX, LINUX

Packages: MS Office Suite, MS Visio, MS Project Professional

PROFESSIONAL EXPERIENCE:

Confidential, Indianapolis, IN

Sr. Hadoop Developer

Responsibilities:

• Worked extensively on Hadoop Components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, YARN and Map Reduce programming.
• Developed Map - Reduce programs to clean and aggregate the data.
• Implemented Hive Ad-hoc queries to handle Member data from different data sources such as Epic and Centricity.
• Implemented Hive UDF's and did performance tuning for better results
• Analyzed the data by performing Hive queries and running Pig Scripts.
• Implemented optimized map joins to get data from different sources to perform cleaning operations before applying the algorithms.
• Experience in using Sqoop to import and export the data from Netezza and Oracle DB into HDFS and HIVE.
• Implemented POC to introduce Spark Transformations.
• Worked in transforming data from map reduce into HBase as bulk operations.
• Implemented CRUD operations on HBase data using thrift API to get real time insights.
• Developed workflow in Oozie to manage and schedule jobs on Hadoop cluster for generating reports on nightly, weekly and monthly basis.
• Used Zookeeper to manage Hadoop clusters and Oozie to schedule job workflows.
• Implemented test scripts to support test driven development and continuous integration.
• Developed Pig Latin Scripts to extract data from log files and store them to HDFS. Created User Defined Functions (UDFs) to pre- process data for analysis.
• Participated in design and implementation discussion for the developing Cloudera 5 Hadoop eco system.
• Used JIRA and Confluence to update tasks and maintain documentation.
• Worked in Agile development environment in sprint cycles of two weeks by dividing and organizing tasks. Participated in daily scrum and other design related meetings.
• Created final reports of analysed data using Apache Hue and Hive Browser and generated graphs for studying by the data analytics team.
• Used SQOOP to export the analysed data to relational database for analysis by data analytics team.

Environment: Hadoop, CDH, Map Reduce, Hive, Pig, Sqoop, Flume, HBase, Java, Spark, Oozie, Linux, Python, UNIX

Hadoop Developer

Responsibilities:

• Worked on importing and exporting the data using Sqoop from HDFS to Relational Database systems and vice-versa.
• Wrote PIG Latin scripts to filter the data and to load into HDFS.
• Involved in loading data from UNIX file system to HDFS.
• Handled importing of data from various data sources, performed transformations using Hive, MapReduce and loaded data into HDFS.
• Worked on analyzing data with Hive and Pig and real time analytical operations using Hbase.
• Worked on loading and transforming of large sets of structured, semi structured and unstructured data.
• Implemented Map reduce secondary sorting to get better performance for sorting results in Map Reduce programs.
• Worked on User Defined Functions in Hive to load the data from HDFS to run aggregation function on multiple rows.
• Involved in moving all log files generated from various sources to HDFS for further processing through Flume.
• Coordinated with the testing team for bug fixes and created documentation for recorded data, agent usage and release cycle notes.
• Created different UDF’s and UDAF’s to analyze the partitioned and bucketed data and compute various metrics for reporting on the dashboard and stored them in different summary tables.
• Monitored and managed Hadoop cluster using the Cloudera Managerweb- interface.
• Used Oozie Workflow engine to run multiple Hive and Pig jobs.
• Created stored procedures, triggers and functions to operate on report data in MySQL.
• Wrote backend code in Java to interact with the database using JDBC.

Environment: Hadoop, CDH, Map Reduce, Hive, Pig, Sqoop, Flume, HBase, Java, Oozie, Linux, Python, UNIX.

Hadoop Developer

Responsibilities:

• Involved in analysing the requirements and establish development capabilities to support future opportunities.
• Involved in Design and Development of technical specifications using Hadoop technology.
• Handled importing of data from various data sources, performed transformations using PIG, MapReduce, loaded data into HDFS and extracted the data from MySQL into HDFS using SQOOP.
• Worked on streaming the analyzed data to the existing relational databases using SQOOP by making it available for visualization and report generation to the BI team.
• Created Pig Latin scripts to sort, group, join and filter the enterprise wise data.
• Analysed Web server log data using Apache Flume.

Environment: HDFS, Sqoop, PIG, Hive, Map reduce, Cloudera Manager (CDH3), Java, and MySQL

Java Developer

Responsibilities:

• Developed the modules based on struts MVC Architecture.
• Developed UI using JavaScript, JSP, HTML, and CSS for interactive cross browser functionality and complex user interface.
• Developed technical and functional documentation for the project.
• Validated all forms using Struts validation framework and implemented Tiles framework in the presentation layer.
• Implemented Authorization & Authentication, security-using LDAP.
• Worked on Hibernate for handling database transactions and persisting objects.
• Used AJAX for interactive user operations and client side validations.
• Implemented design patterns and Object Oriented Java design concepts for development and exception handling.

Environment: Java, Spring MVC, EJB, Struts, Hibernate, WebLogic, Oracle, JUnit, log4j, AJAX, HTML and CSS.

Java Developer

Responsibilities:

• Implemented Multi-threading functionality using Java Threading API.
• Designed User Interface of the application using HTML, CSS, JavaScript, JSP, JSTL
• Involved in daily SCRUM meetings and weekly SPRINT meetings.
• Worked on Unit Testing and Integration Testing of all the components of our application.
• Designed and developed forms on the client side using HTML/DHTML and JavaScript.
• Used Log4j for debugging and VSS for version control.
• Used HP Quality Center for defect tracking and quality control.

Environment: Java, Spring MVC, EJB, Struts, Hibernate, WebLogic, Oracle, JUnit,log4j, AJAX, HTML and CSS.

Java Developer

Responsibilities:

• Key responsibilities included requirements gathering, designing and developing the Java application.
• Identified and fixed transactional issues due to incorrect exceptional handling and concurrency issues due to unsynchronized block of code.
• Created Java application module for providing authentication to the users for using this application and to synchronize handset with the Exchange server.
• Performed unit testing, system testing and user acceptance test.
• Gathered specifications for the Library site from different departments and users of the services.
• Wrote SQL scripts to create and maintain the database, roles, users, tables, views, procedures and triggers.
• Designed and implemented the UI using HTML and Java.
• Worked on database interaction layer for insertions, updating and retrieval operations on data.

Environment: Java, JDBC, HTML, SQL, Oracle, BM Rational, Eclipse IDE