PROFESSIONAL SUMMARY:

• 7+ years of IT experience with the last 1.8 years spent working on Hadoop/Big Data.
• Excellent understanding of Hadoop architecture and various such as Job Tracker, Task Tracker, NameNode, Secondary NameNode and DataNode.
• Hands - on experience on major components in Hadoop Ecosystem including Hive, PIG, Sqoop, Flume and knowledge of Mapper/Reduce/HDFS Frame work.
• Experience on Hadoop CDH4
• Experience in analyzing data using HIVEQL, PIG Latin and custom MapReduce programs in JAVA.
• Strong knowledge in developing customized UDF’s to extend Hive and Pig functionality.
• Good experience in writing Pig Latin scripts and Hive queries
• Experienced in developing MapReduce programs using Apache Hadoop for working with Big Data.
• Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.
• Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
• Team player with excellent analytical, communication and project documentation skills
• Responsible to manage data coming from different sources
• Involved in loading data from UNIX file system to HDFS.
• Involved in creating Hive tables, loading with data and writing hive queries
• Experienced in managing and reviewing Hadoop log files
• Experienced in defining job work flows as per their dependencies in Oozie.
• Have a knowledge on R
• Team player with excellent analytical, communication and project documentation skills
• Expertise in Defect Management and Defect Tracking to do Performance Tuning for product Quality.

TECHNICAL SKILLS:

Hardware / Platforms: Ubuntu, Windows 98/XP/2000, Win 7, Mainframe

Technical skills: Core Java, Map reduce, PIG, Hive, Shell scripting, Sqoop, Flume,Oozie,Hbase

Database Tools: DB2, SQL, knowledge on NOSQL

Testing Tools: Selenium 2.0 web driver, Junit4, Quality Center 11

PROFESSIONAL EXPERIENCE:

Confidential, Hoffman Estates, Illinois

Hadoop Developer

Responsibilities:

• Extract the data from different sources like main table from Teradata, marketing promotional history, and manual watch list from UI.
• Coordinated with business customers to gather business requirements.
• Importing and exporting data into HDFS from database and vice versa using SQOOP.
• Responsible to manage data coming from different sources.
• Worked on analyzing Hadoop cluster and different Big Data analytic tools including Pig, Hbase database and SQOOP.
• Load and transform large sets of structured and semi structured data.
• Collecting and aggregating large amounts of log data using Apache Flume and staging data in HDFS for further analysis.
• Analyzed data using Hadoop components Hive and Pig.
• Involved in running Hadoop streaming jobs to process terabytes of data.
• Gained experience in managing and reviewing Hadoop log files.
• Involved in writing Hive queries for data analysis to meet the business requirements.
• Worked on streaming the analyzed data to the existing relational databases using SQOOP for making it available for visualization and report generation by the BI team.
• Involved in creating the workflow to run multiple Hive and Pig jobs, which run independently with time and data availability.
• Developed PIG Latin scripts for the analysis of semi structured data. Involved in debugging PIG scripts
• Involved in creating calculated fields and dashboards in Tableau

Technology Used: Hadoop, HDFS, Hive, Sqoop, PIG, Teradata, Ubuntu, Java (JDK 1.6),Cloudera, Oozie

Confidential, San Bruno, CA

Hadoop Developer

Responsibilities:

• Moved all web crawling data flat files generated from various retailers to HDFS for further processing
• Designed and developed MapReduce Jobs using Java.
• Written the Apache PIG scripts and UDF to process the HDFS data.
• Created Hive tables to store the processed results in a tabular format.
• Developed the Sqoop scripts in order to make the interaction between HDFS and MySQL Database.
• Completely involved in the requirement analysis phase.
• Involved in debugging MapReduce job using MRUnit framework and optimizing MapReduce job
• Implemented the Hive queries for aggregating the data and extracting useful information by sorting the data according to required attributes.
• Involved in the functional team meeting to gather and understand business requirements.
• Converted the feasible business requirements to technical tasks in Design Documents.
• Worked on implementing Partition, Dynamic Partition and Buckets in Hive for efficiently accessing data.
• Wrote and implemented Pig UDF to preprocess the data and use it for analysis.
• Hands on experience with performing CRUD operations using HBase Java Client API

Technology Used: Hadoop, HDFS, Flume, PIG, MySQL, Ubuntu, Java (JDK 1.6),Cloudera, Oozie,HBase

Confidential, McLean, VA

Hadoop Developer

Responsibilities:

• Explored and used Hadoop ecosystem features and its architectures.
• Involved in meeting with the business team to gather their requirements.
• Utilized Flume to filter out the JSON input data read from the twitter firehose to retrieve only the data needed to perform analytics.
• Involved in writing Pig script to count the number of times a particular model of phone was tweeted in a particular duration.
• A comparison of the count of various models shows the relative popularity of the phone model in that duration.
• Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way
• Hive was used to find the location, phone pair to the popularity if phone with respect to location/State.
• Another Hive script was written to find the user, phone pair to the popularity if phone with respect to twitter users. This shows the interests of users in phone models.

Technology Used: Hadoop, HDFS, Hive, Flume, PIG, Ubuntu, Java (JDK 1.6),Cloudera

Confidential, Cleveland, Ohio

Java Developer

Responsibilities:

• Involved in designing and developing of both front end and server side components of the application.
• Designed and developed the action classes, business and database layer components such as DAOs using Struts (for MVC) and Spring framework for wiring components (IOC).
• Front-end validation was done using Struts Validation Framework as well as JavaScript was used
• Product development is an Agile (SCRUM) methodology, where progress and task assignment is discussed in everyday meetings.
• Strong Knowledge with Software Development Process like RUP, Test driven development (TDD), Scrum, Extreme Programming.
• Written Queries in Hibernate for retrieving the data from the database.
• Involved in integrating Spring and Hibernate.
• Working in an agile methodology Environment to deliver higher-quality software far more rapidly.
• Used web services to receive and send the information.
• Analyzed and fixed the defects in various environments.
• Worked and configured the application in Web Sphere application server.
• Developed logging module-using Log4J to create log files.

Technology Used: Core Java, Spring Framework, TDD, AGILE, LDAP, XML, XSLT, XPath, Rational Software Architect 7.0(RSA), JUnit 4, JavaScript, Web Sphere Application Server 6.1 (WAS), ANT 1.6, Rational Clear Case 7.0, Rational Clear Quest 7.0, WinSQL 4.6, DB2,CSS.

Confidential

Java Developer

Responsibilities:

• Developed many back-end application modules using J2EE patterns and Java Beans for business logic using Web Logic and Struts.
• Developed parts of User Interface using Core Java, HTML/JSP and client - side Validations using JavaScript.
• Developed JSP pages using Struts Custom Tag Libraries such as HTML tags, Bean Tags, Logic Tags and Template Tags.
• Developed the presentation layer using Struts Framework with JSP/JSTL.
• Responsible for coding all the JSP, Servlets, Struts used for the Ordering and Payments Module.
• Developed the JSP, Servlets and various Beans using Web Logic server.
• Designed properties file that has been used by many services and written code to read this properties file.
• Experience in installing, configuring and deploying application on Web Logic Server.
• Developed the server side validation using JMS, JSP and Java Beans.

Technology Used: Java/J2EE, JSP, JSTL, Java Script, XML, HTML, JSF, Java Beans, Hibernate, Bean Tags, Struts framework, Servlets, WebLogic Server, Ant, JMS, SQL, LINUX, PostgreSQL, VSS.

Confidential

Java Developer

Responsibilities:

• Involved in analysis, design, development and implementation of this application.
• Developed User Interface using HTML, JSP.
• Validated the data using JavaScript.
• Developed Servlets for retrieving/updating the data from tables in the database.
• Designed and created the database tables to conform third normalization form.
• Wrote PL/SQL stored procedures and triggers.
• Trained the users on using the software.

Technology Used: J2EE 1.3, Servlets 2.2, JDBC 2.0, Oracle, HTML, JavaScript, Apache Tomcat 3.3, Eclipse and Windows 2000