SUMMARY:

• Overall 10+ years of experience in analysis, design, coding, testing and support in IT industry which also includes solid experience in Big Data Hadoop technologies and solutions.
• Experience in Cloudera/Hortonworks Hadoop distribution (HDFS, MapReduce, Hive, Pig, Spark, Sqoop, Oozie, Cassandra and Flume)
• Expertise in writing Hadoop Jobs for analyzing data using Hive and Pig.
• Experience in working with MapReduce programs using Apache Hadoop for working with Big Data.
• Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems (RDBMS) and vice - versa.
• In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce concepts.
• Extending Hive and Pig core functionality by writing custom UDFs.
• Experience on UNIX commands and Shell Scripting.
• Knowledge on NoSQL databases including HBase, MongoDB and Cassandra
• Specialization in server side Java & J2EE Application.
• Experience in Web/Ecommerce development using Java/J2EE.
• Hands on experience in J2EE based technologies (JSP, Servlets, JDBC, JMS and EJB)
• Experience in Open Source Technologies like Struts, Spring and Hibernate.
• Experience in UML (Class Diagrams, Sequence Diagrams, Usecase Diagrams)
• Experience in SQL queries for data retrieval and modification.
• Experienced in Bug Reporting and Defect tracking using tools like Rational Clear Quest, HP Quality Center and Test Director to log and defect management.
• Experience in Agile Scrum development methodology and frameworks.

TECHNICAL SKILLS:

Big Data Ecosystem: Hadoop, Map Reduce, HDFS, Cassandra, Spark, Hive, Pig, Sqoop, Oozie, Flume

Hadoop Distribution: Hotornworks (HDP 2.3), Cloudera (CDH 5.4)

Operating System: Windows, UNIX/Linux

Languages: C, C++, Java, SQL, PL/SQL, UNIX/Linux Shell Scripts, Python, Scala

Java Technologies: JDBC3.0, Servlets, JSP, Java Beans, JMS, EJB

Frame Work: Struts1.1, Spring3.0, ANT 1.7

Web /App Servers: Websphere8.5, Weblogic7.0, Tomcat5.0

ORM: Hibernate

Markup Languages: HTML, JavaScript, CSS

IDE: WAST8.0, RAD7.0, ECLIPSE4.2

Databases: Teradata 14.0, Oracle 8.0, DB2, SQL Server.

Bug Tracking Tool: Test Director 9.0

Designing Tool: Rational Rose (Used for Use Cases, Class Diagrams and Sequence Diagrams)

SCM Tools: CVS, SVN, Clear Case, Harvest

Web Tools: AJAX, JQuery, JSON, Responsive Web Designing

Methodologies: Agile, Waterfall

PROFESSIONAL EXPERIENCE:

Confidential, Charlotte, NC

Senior Hadoop Developer

Responsibilities:

• Involved in all phases of the Big Data Implementation including requirement analysis, design, development, building, testing, and deployment of Hadoop cluster in fully distributed mode
• Created Linux and Python Scripts to automate the daily ingestion of raw data
• Processed the raw data using Hive jobs and scheduling them in Crontab
• Developed HIVE UDFs to get the MDK and GeoIp values
• Moved data to appropriate partition based on record-level timestamp(as we have more than one day’s worth of data in log files)
• Compressed transformed/enriched data files with bzip2Codec
• Developed the regular expression (RegexSerDe) to in corporate the two different raw data sets
• Experience in Daily production support to monitor and trouble shoots Hadoop/Hive jobs
• Developed Housekeeping process purge the old data from Edge node and HDFS.
• Implemented two different process for Internal and External Weblogs
• Manage and review Hadoop log files.
• Support/Troubleshoot hive programs running on the cluster
• Involved in fixing issues arising out of duration testing
• Handling structured, semi structured and unstructured data
• Automated the History and Purge Process
• Involved in the process of migrating to the new cluster.

Environment: Hadoop 2.x, Hive 0.13.1, Python, Unix Scripts, HDP 2.3, Redhat Linux

Confidential

Hadoop Developer

Responsibilities:

• Involved in all phases of the Big Data Implementation including requirement analysis, design, development, building, testing, and deployment of Hadoop cluster in fully distributed mode
• Mapping the DB2 V9.7, V10.x Data Types to Hive Data Types and validated
• Performed load and retrieve unstructured data ( CLOB, BLOB etc)
• Data Ingestion process from DB2 to HDFS
• Developed Hive jobs to transfer 8 years of bulk data from DB2 to HDFS layer
• Implemented Data Integrity and Data Quality checks in Hadoop using Hive and Linux scripts
• Job automation framework to support & operationalize data loads
• Automated the DDL creation process in hive by mapping the DB2 data types
• Used Bzip2 compression technique to compress the files before loading it to Hive
• Manage and review Hadoop log files.
• Support/Troubleshoot hive programs running on the cluster
• Involved in fixing issues arising out of duration testing.

Environment: Hadoop 2.x, Hive 0.13.1, DB2 10.x, HDP 2.3, Redhat Linux, Java 1.6, Linux Scripts

Confidential

Hadoop Developer

Responsibilities:

• Involved in development, building, testing, and deploy to Hadoop cluster in distributed mode.
• Created Linux Scripts to automate the daily ingestion of Confidential data
• Processed the raw data using Hive jobs and scheduling them in Crontab
• Importing RDBMS data into HDFS, Hive using Sqoop
• Helped the Analytics team with Aster queries using HCatlog
• Automated the History and Purge Process
• Developed the verification and control process for daily load
• Experience in Daily production support to monitor and trouble shoots Hadoop/Hive jobs

Environment: Hadoop 2.x, Pig 0.12, Hive 0.13.1, Linux, Sqoop 1.4.5, HDP 2.3, Redhat Linux, Aster

Confidential

Web Lead/Developer

Responsibilities:

• Responsible for requirement analysis of all the web applications and understanding the client requirements.
• Involved in estimating the tasks, code reviews, defect tracking and resolving technical issues.
• Involved in high level and low level design of all the web applications and contributed towards Detail Design Specifications for the web applications.
• Involved in migrating EJB’s to simple JDBC classes and DB2 to Teradata conversion.
• Involved in migration project which migrates the web applications from Websphere to Tomcat and back to Websphere.
• Prepared JMS queue configurations and implementation steps for JMS Queues and listeners on Websphere Application Server.
• Designed the generic framework for Reference Tables using Struts and JDBC metadata.
• Involved in Quartz implementation of Spring framework for PricingModel Application.
• Involved in developing JSP pages, CSS and JavaScript frameworks.
• Implemented AJAX framework for Factor Home functionality of PricingModel Application.
• Developed Action classes, Domain Classes and classes in Persistence layer.
• Involved in Unit and Integration testing for all the Applications and JUnit Test cases for Reference Tables Application.
• Supported UAT, PROD and BCP environments for all the Applications.
• Lead a team of four for Reference Tables, CoreIntraday and Teradata conversion projects.
• Worked on the Pricing Model Optimization Project comprises Struts and Spring Framework.
• Designed a reusable component using xml based framework for Pricing Model Application in Optimization Project.

Environment: JSP, Struts, Spring, Java Beans, AJAX, JavaScript, JDBC, JMS, WSAD 6.1, DB2 8.0, Teradata14.0, PAC 2000 and Harvest

John Deere, Moline, IL

Senior Java Developer

Responsibilities:

• Responsible for requirement analysis of application and understanding the client requirements.
• Involved in full implementation of Online Configurator, DTACacheUpdate, EProductsReporter and Price Book applications.
• Prepared use cases, class diagrams and sequence diagrams based on the client requirements.
• Involved in developing JSP pages and classes in Persistence layer.
• Developed servlets, JavaBeans and Domain Classes.

Environment: JSP, Servlets, Java Beans, JavaScript, JDBC, Web Services, RAD 6.0, DB2, SQLServer and Test Director.

Confidential

Java Developer

Responsibilities:

• Involved in Update Staff and Maintain Authority modules.
• Involved in designing class diagrams and sequence diagrams.
• Involved in developing Broker classes and Domain classes.
• Developed Action classes and FormBeans.
• Involved in Unit Testing.

Environment: JSP, Struts, JDBC, WebSphere6.0, Rational Rose, Test Director and DB2.