OBJECTIVE:

To apply my Hadoop developer skills to facilitate overcoming challenges posed by big data management to contribute to the success of the organization along with enhancing my technical expertise.

PROFESSIONAL SUMMARY:

• IT professional over 5 years of diversified experience in software development. More than 2 years of experience in BigData technologies and Hadoop ecosystem.
• Hands on experience in designing and implementing Big Data projects using components of Hadoop ecosystem including Hive, Pig, Sqoop, Oozie, Flume.
• Experience in loading large datasets in HDFS using Hive, Pig and Mapreduce along with the ability of extending Hive and Pig functionality using custom UDFs.
• Extensive experience in importing and exporting large amount of data from HDFS using Sqoop.
• Strong hold in job workflow scheduling tools like Oozie.
• Experience in handling text, sequence and Avro files.
• Good exposure to Hadoop stack like Zookeeper and Flume.
• Good knowledge of writing shell scripts in Linux .
• Experience in installation, configuration, management and development of big data solutions using Cloudera and Hortonworks distributions.
• Strong knowledge on HDFS architecture along with YARN and MapReduce framework.
• Experience upgrading the existing Hadoop cluster.
• Experience in managing the cluster resources by implementing fair scheduler and capacity scheduler.
• Proficient knowledge of Software Development Life Cycle (SDLC)
• Strong in Internet technologies like HTML/HTML5, CSS, JavaScript, HTML - DOM, Ajax and JQuery.
• Experience in database design: designing schema, MySQL, SQL, stored procedures and triggers.
• Strong experience in Java technologies.
• Expertise in understanding and developing ETL (Extract, Transform and Load) logic based on the requirements.
• Efficient in all phases of the development lifecycle, coherent with Data Cleansing, Data Conversion, Performance Tuning.
• Highly motivated and creative individual with a strong mathematical, analytical and complex problem solving capabilities. A team player having ability to work individually.
• Balanced mix of technical, communication and interpersonal skills.

TECHNICAL EXPERTISE

Programming Languages: C, C++, C#, Dot Net, Java

Hadoop Ecosystem: HDFS, MapReduce, Hive, Pig, Sqoop, Flume, Zookeeper, Oozie

Web Technologies: HTML, CSS, Java Scripting, XML, JSP, Ajax, Telerik

Platforms: Windows, Linux, Mac

DBMS: MS Access, Oracle, SQL Server, PL/SQL, MySQL

Modelling Tools: Unified Modelling Language (UML)

Testing Tools: JUnit, EclEmma, Google CodePro Analytix, Javadocs, FindBugs, PMD, CheckStyle

Packages: MS Office, Adobe Photoshop, Flash

Versioning Tools: Subversion, Git

Other Tools: Net Beans IDE, Eclipse IDE, MS Project, Microsoft Visual Studio, Google Code

Distribitions: Cloudera, Hortonworks and Apache Hadoop

PROFESSIONAL PROJECT EXPERIENCES:

Hadoop Engineer

Confidential

Responsibilities:

• Responsible for handling large amount of historical and current data of user's behaviour from the webserver.
• Effectively used sqoop for retrieving the data from HDFS to RDBMS and migrating the meaningful data back to HDFS.
• Developed pig scripts to parse and cleanse the data in HDFS obtained from different sources to make it suitable for ingestion into Hive schema for analysis.
• Configured Hive metastore to use MySql Database, to make all the tables created in Hive available to different users simultaneously.
• Used hive for creating internal and external tables for static and dynamic partitions.
• Created custom UDFs for evaluation, filtering, loading and storing data to extend the Pig and Hive functionality.
• Wrote pig scripts for identifying behavioural patterns.
• Implemented Oozie workflow engine to automate several interdependent jobs.
• Responsible for generating sample test data for testing purposes.
• Involved in working with testing strategies and test plans for ETL workflow.
• Involved in test design and created test cases to validate the HIVE tables and data quality in different process areas.
• Thoroughly tested Mapreduce programs using MRUnit and Junit testing frameworks.
• Created use cases for test case creation to validate the business flow process.
• Provided user support by troubleshooting the issues in Hadoop jobs along with debugging problems for development team and proposed solution for tuned performance.

Tools: and Technologies: HDFS, MapReduce, Sqoop, Hive, Pig, Oozie, Flume, MySQL, Eclipse

Graduate Assistant in Hadoop

Confidential

Responsibilities:

• Worked on installation of Hadoop components like Sqoop, Hive, Oozie.
• Extracted Tables from MySql through Sqoop (using full load as well as incremental load) and placed in HDFS to process the records.
• Involved in creating Hive tables, and loading and analyzing data using hive queries for building merged/flattened view of historical data.
• Developed and executed HQL queries.
• Developed User Defined Functions in Hive to transform large volume of data with respect to business requirements.
• Worked with Avro files.
• Created workflow to automate data ingestion pipeline from different data sources into HDFS using Oozie.
• Involved in test design and created test cases to validate the HIVE tables and data quality in different process areas.
• Created use cases for test case creation to validate the business flow process.
• Performed tasks to test programs for validity of results, accuracy, reliability, and conformance to documented functional requirements.
• Provided user support by troubleshooting the issues in Hadoop jobs along with debugging problems for development team and proposed solution for tuned performance.

Tools: and Technologies: HDFS, MapReduce, Sqoop, Hive, Oozie, MySql, Eclipse

Software Developer Intern in Java

Confidential, Maryland

Responsibilities:

• Improved the part of BuildTopia website by adding new functionalities.
• Transformed and enhanced static webpages to more dynamic, interactive and user-friendly web pages that involved me to work with HTML/DHTML, CSS, JSP, Javascript and JSP.
• Resolved some business layer issues using servlets

Tools: and Technologies: J2EE, Java, HTML/DHTML, CSS, JSP, JavaScript, SQL, CSS, JDBC, Servlets, Eclipse

Software Developer in Java

Confidential

Responsibilities:

• Gathered the user requirements.
• Created Software Requirement Specification that included Data Flow Diagrams, Business Functions in Proposed System, Input and Output Requirements of the System, Users of the System, Technologies to be used, Software and Hardware Requirements.
• Created the database according to the user requirement specification using MySQL.
• Created the presentation layer.
• Used JDBC to generate connection between back end & the business logic layer and to perform the entire database related task like inserting data in the database or retrieving data from the database or updating the data.
• Created bean class to set the getter and setter properties of the required fields.
• Used wrapper classes, collection framework, AWT and Swings functionalities for implementing business logic.
• Used Jasper Reports for generating the details of buyer and the seller of cars.
• Used Splash to make the application look more attractive to the user.
• Created the database according to the requirement specification using MySQL.
• Created the presentation layer using HTML, DHTML, CSS, JavaScript.
• Used JDBC to generate connection between back end & the business logic layer and to perform all the database related task like inserting data in the database or retrieving data from the database or updating the data.
• Created Java Bean class to set the getter and setter properties of the required fields.
• Used JSP and Servlet functionalities along with wrapper classes and collection framework for implementing business logic.
• Used Session Management to manage client’s information for specific period of time.
• Responsible for putting validations for wrong or null data entry where ever required.
• Used Ajax to make the front end layer more attractive and to handle multiple requests at one time.

Tools: and Technologies: J2EE/Java, JDBC (Java Database Connectivity), JSP, Servlets, MySQL, Ajax, Net Beans.

Software Developer in Java & Implementation Coordinator

Confidential

Responsibilities:

• Responsible for collecting the requirements from users.
• Developed the Software Requirement Specification (SRS) that included Used Case Diagrams, Entity Relationship Diagrams, Table Relationship Diagrams, Control Flow Diagrams, UML Diagrams.
• Involved in the database designing and creating Stored Procedure for insertion, updation and deletion functions using SQL Server.
• Developed and prototyped features and interfaces to meet business requirements using Class files.
• Worked on Data Repairs and Data Cleanup.
• Involved in analyzing, modelling and developing front end (GUI) layer of the application using HTML, DHTML, CSS and Ajax.
• Worked with Servlets for implementing business logic and used JDBC for connecting the it to the database.
• Responsible for putting validations on various fields to avoid wrong or null data entry using Javascript.
• Used Jasper Reports to help user to dynamically generate reports.

Tools: and Technologies: J2EE, JDBC (Java Database Connectivity), JSP, Servlets, SQL, HTML, CSS, Javascript, Eclipse.

Software Developer Intern in Java

Confidential

Responsibilities:

• Interacted directly with end users to understand the functional requirements.
• Created the Software Requirement Specification document.
• Implemented the application using Struts framework.
• Developed the dynamic front end layer of JSP, Servlet, JavaScript, CSS
• Designed application to work with any JDBC complaint database.
• Queries were implemented using MySQL.
• Involved in the build process with the Configuration management team and version control through CVS.
• Used Servlets for server side programming and stored data in database tables.

Tools: and Technologies: HTML, CSS, JavaScript, JSP, AJAX, JDBC, Servlets, J2EE/Java, Net Beans, MySQL.