SUMMARY

• Senior Hadoop Developer/Admin with 8 years of experience in Information Technology including 4 years of experience in Hadoop Development and Ecosystems
• Hands on experience on Hadoop Ecosystem components like Hadoop Map Reduce, HDFS, YARN, HIVE, PIG, HBase, BigTop, Zookeeper, Sqoop, Oozie, Flume and Avro.
• Experience in writing map - reduce programs in Java
• Experience in writing custom User Defined Functions in java for Hive and Pig.
• Experience with installation, configuration, supporting and managing of Big Data and underlying infrastructure of Hadoop Cluster.
• Experience in working with Flume to load the log data from multiple sources directly into HDFS.
• Hands on experience with Kerberos integration with Hadoop nodes and daemons.
• Maintenance of all the services in Hadoop ecosystem using Zookeper
• Experience in setting up and configuring distributed monitoring systems for Hadoop Clusters like Ganglia and Nagios.
• Experienced in Core Java, Servlets, JSP, Struts2, Spring, Hibernate, JDBC and Web Services
• Experience in XML/XPATH/XQUERY, XSLT,HTML, Tag Libraries, Custom Tags, and Design Patterns
• Good Experience in Configuring JDBC connectivity, Stored Procedures, triggers and Connection pool Management.
• Experience in RDBMS concepts, writing PL/SQL database queries, stored procedures, and triggers.
• Good knowledge of developing RESTful Web Services using Jersey framework.
• Hands on knowledge with configuration and report generation for Web Analytics services like Unica NetInsight and Google Analytics
• Experience in developing HTML/PHP/JSP templates using Adobe Dreamweaver
• Hands on with newsletter designing with tools like Benchmark

TECHNICAL SKILLS

• Java
• Visual C++
• PHP5
• Hadoop Map Reduce
• HDFS
• YARN
• HIVE
• PIG
• HBase
• BigTop
• Zookeeper
• Visio
• Sqoop
• Oozie
• Ambari
• Flume
• Avro
• Servlets
• JSP
• Custom Tags
• AJAX
• JSTL
• JDBC
• JAXB
• JAXP
• Web Services
• Spring
• Oracle 10g/11
• MySQL 5.5
• MarkLogic 4
• Windows 10/8/7/Vista/XP
• UNIX / Linux Red Hat 6.x
• JavaScript/ JQUERY
• Unix Shell Script
• XSLT
• SQL/ PL-SQL
• XQUERY
• Tomcat 5.5/6.0
• Jetty. Eclipse 3.2
• Net Beans
• Visual Studio
• SVN (Tortoise SVN)
• Rational Team Concertclients

PROFESSIONAL EXPERIENCE

Senior Big Data Developer

Confidential, Dover, NH

Responsibilities:

• Hands-on experience with Apache Spark
• Involved in configuring and optimizing hive and pig programs using Apache Tez and ORC file format
• Developed Mapreduce programs to Extract, clean and transform data from different sources
• Involved in developing UDFS for Hive and Pig programs
• Responsible for performance tuning and benchmarking Hadoop cluster.
• Involved with configuring settings for Ambari/Hortonworks Data Platform
• Developed multiple MapReduce jobs in java for data cleaning and preprocessing
• Job Scheduling experience with Oozie and ESP(Event Stream Processing)
• Involved in analyzing system failures, identifying root causes, and recommended course of actions.
• Hands on with Apache Drill for testing purposes
• Used Sqoop and ODBC connections for exporting data to Teradata and SAS
• Involved in creating and deploying Hadoop Applications using RPMS
• Hands on experience with Splunk logging system

Environment: Java 7/8, HDP 2.3.4, MapReduce 2.7, Yarn 2.7, Hive 1.2, Pig 0.15 HBase 1.1, Spark 1.4/1.6, RHEL 6.4, HDFS 2.7, Oozie4.2, Sqoop 1.4, Splunk 6.1, Rational Team Concert

Senior Hadoop Developer/Admin

Confidential, Oaks, PA

Responsibilities:

• Involved in installation and configuration of Hadoop and its ecosystem of components Zookeper, Hive and Pig
• Managed loading data from various sources
• Experience with automated Hadoop cluster deployment using Puppet tool
• Hands on Nagios plugins to monitor Hadoop Name Node Health status, number of Task trackers running, number of Data Nodes running.
• Responsible for performance tuning and benchmarking Hadoop cluster.
• Job tracking and resource management using Yarn
• Developed multiple MapReduce jobs in java for data cleaning and preprocessing
• Used a workflow scheduler system tool Oozie to manage Hadoop jobs
• Involved in analyzing system failures, identifying root causes, and recommended course of actions.
• Configured Capacity Scheduler to configure jobs for maximum cluster utilization
• Hands on with Service-Level Authentication and Access Control List in Hadoop

Environment: Java 6/7, Oracle 10g/11, PL/SQL, Hadoop 2.2, MapReduce2.2, Hive 0.12, RHEL 6.4, Nagios 3.5, Oozie 4

Hadoop Developer/Admin

Confidential, White Plains, NY

Responsibilities:

• Processed high volumes of data from different sources and loaded them in to Hadoop cluster and use them for further processing
• Worked with Github for version control
• Involved in upgrading Hadoop cluster to CDH4 and integrate the new Hadoop-related projects
• Implemented Partitioning, Dynamic Partitions, Buckets in HIVE.
• Wrote Mapreduce programs with Java API and Eclipse
• Hands on experience with Ganglia for monitoring multiple Hadoop clusters
• Experience with obtaining data from Oracle 10g databases and pushing it to Hadoop clusters using Sqoop
• Developed a java based utility for displaying status of Hadoop services to users
• Hands on with configuring Tableau for data visualization, analysis and report generation
• Monitor System health and logs and respond accordingly to any warning or failure conditions
• Hands on experience with benchmarking a Hadoop cluster using GridMix
• Hands on with Cloudera Backup and Disaster Recovery(BDR)

Environment: Cloudera based Hadoop Ecosystem 4, MapReduce2, Hive 0.8, Ganglia, Sqoop 1.4, Tableau, and Github.

Hadoop/Java Developer

Confidential, Birmingham, AL

Responsibilities:

• Involved in review of functional and non-functional requirements.
• Facilitated knowledge transfer sessions.
• Involved in architecting Hadoop clusters.
• Importing and exporting data into HDFS and Hive using Sqoop.
• Perform data analysis using Hive and Pig.
• Load log data into HDFS using Flume, Kafka.
• Monitoring Hadoop cluster using tools like Nagios, Ganglia and Cloudera Manager.
• Used cron jobs to automate monitoring of HDFS and HBase.
• Experience in configuring Kerberos with Open LDAP at back end.
• Prepare multi-cluster test harness to exercise the system for performance and failover.
• Create a complete processing engine, based on Cloudera's distribution, enhanced to performance.
• Build and support standard-based infrastructure capable of supporting tens of thousands of computers in multiple locations.

Environment: Hive 0.8, Pig 0.9, Kafka 0.7, Zookeeper 3.4, Sqoop 1.4, Java 6, Struts 2.1.x, Maven 2, SVN, Junit, XML/XSTL/XPATH.

Hadoop/Java Developer

Confidential, Charlestown, MA

Responsibilities:

• Exported data from MySQL Database to HDFS using Sqoop.
• Developed Map Reduce jobs using Java API.
• Installed and configured Pig and wrote Pig Latin scripts for Map Reduce jobs.
• Developed workflow using Oozie for running Map Reduce jobs and Hive Queries.
• Installed and configured Hive and also written Hive User Defined Functions.
• Worked on Cluster coordination services through Zookeeper.
• Worked on loading log data directly into HDFS using Flume.
• Involved in exporting from local (Linux) file system to HDFS.
• Experience in exporting data to relational databases using Sqoop.
• Experience with installing and Configuring on Open LDAP with SSL/TLS on Debian.
• Experience in Automate deployment, management and self-serve troubleshooting applications.
• Hands on with NoSQL database such as MongoDB.
• Experience with using Apache Subversion.
• Experience in managing development time, bug tracking, project releases, development speed, release forecast, scheduling and many more.
• Worked with Object-Oriented JS/JQUERY and J2EE for dynamic User Interface.

Environment: Hadoop 0.20, Pig 0.8, Sqoop 1.1, Ubuntu 10, Mongo DB 2

Java Developer

Confidential

Responsibilities:

• Worked with WebAnalytics team and Web Services team for Lexis Advance, a new search product for LexisNexis to develop backend services
• Used agile and waterfall methodologies in designing and developing the modules.
• Used Visual Paradigm to draw class, sequential, activity and use-case diagrams.
• Developed Presentation Layer using MVC.
• Used Unix crontab and cron4j(Java API) to schedule jobs using user interface
• Used Log4J for logging purposes.
• Developed DAO layer using JDBC, DAO design pattern to handle the interaction with Data base (Oracle)
• Developed an utility to read logs using MarkLogic viewer
• Configured installation and report generation of WebAnalytics tool Unica NetInsight
• Developed a java tool to generate a document file from XML file using Apache POI
• Used XQUERY, XPATH and ML Query to get information from MarkLogic Content Server
• Developed Frontend using Struts 2.0
• Developed Restful Web service to expose recent activity of the user as service using Jersey framework
• Hands on experience and rule customization with static code analysis APIS like Checkstyle, Findbugs and PMD
• Created stored procedures for making changes in Unica NetInsight internal Oracle DB.
• Designed a JavaScript file for logging the page activity.
• Created a java utility to sort and convert log files to XML files based on different parameters
• Experience in deploying java projects in different environments(dev, cert and prod)
• Worked with IBM Rational Clearcase for version control and workspace management

Environment: Java 5-6/J2EE, Oracle 10g, RHEL 6, MarkLogic 4, Unica NetInsight8.

Web Developer

Confidential

Responsibilities:

• Worked with development and maintenance of personal and small commercial websites for external clients.
• Developed Frontend/UI using JSP/Servlets, JavaScript, HTML and PHP
• Used Search Engine Optimization to make websites easier to search and rate high on search engines
• Worked with Client-Server model and MVC models for the websites
• Designed databases using Oracle 10g and MySQL
• Deployed websites in Apache Webserver and Apache Tomcat servers
• Configured servers and databases in Unix server and Windows Server 2003
• Handled data migration between database servers
• Added security features to existing websites to prevent cross site scripting and SQL injections.
• Hands on experience with Barracuda Firewall
• Hands on experience with designing and configuring newsletters using Benchmark Email.

Environment: Java 5/J2EE, Windows Server 2008, PHP 5.2, MySQL5, HTML4/JS/JQUERY