SUMMARY

• Over 7 plus years of professional IT experience and around 4 Years of Big Data Ecosystem experience in ingestion, storage, querying, processing and analysis of big data.
• In depth understanding ofHadoop architecture and its components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, Resource Manager, Node Manager and MapReduce programming paradigm.
• Hands on experience in installing, configuring and using Hadoop ecosystem components like Hadoop MapReduce, HDFS, HBase, Oozie, Hive, Sqoop, Pig, ZooKeeper, Flume.
• Experience in writing code for streaming data using Apache Hadoop Technologies Apache Kafka, Storm, Spark.
• Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems.
• Well versed with developing and implementing MapReduce programs for analyzing Big Data with different file formats.
• Experienced in writing custom UDFs and UDAFs for extending Hive and Pig functionalities.
• Knowledge of job workflow scheduling and monitoring tools like Oozie and ZooKeeper.
• Strong experience in collecting and storing log data in HDFS using Apache Flume.
• Experience working with Hadoop clusters using Cloudera, Hortonworks distributions.
• Knowledge withHadoopCluster administration, monitoring and managingHadoopclusters using Cloudera Manager.
• Experience in managing and reviewingHadooplog files.
• Collected data from different sources like web servers and social media for storing in HDFS and analyzing the data using otherHadooptechnologies.
• Knowledge with visualization and reporting using BI tool Tableau, QlikView.
• Worked extensively with Dimensional modeling, Data migration, Data cleansing, Data profiling, and ETL Processes features for data warehouses.
• Strong SQL skills & working knowledge with Teradata, IBM DB2, SQL, Oracle RDBMS.
• Expertise in design and development of various web Java/J2EE applications using various technologies like JSP, Servlets, Struts, Hibernate, Spring, JDBC, EJB, JMS, JSF, XML, JDBC, AJAX, SOAP and Web Services.
• Hands on experience using web services like RESTful and SOAP.
• Involved in all the phases of Software Development Life Cycle (SDLC): Requirements gathering, analysis, design, development, testing, production and post - production support.
• Strong and effective problem-solving, analytical and interpersonal skills, besides being a valuable team player.

TECHNICAL SKILLS

Big Data Technologies: Hadoop (Cloudera, Hortonworks), HDFS, HBase, Hadoop MapReduce, Hive, Pig, Impala, Sqoop, Flume, Solr, Oozie, ZooKeeper, Apache Kafka, Apache Storm, Apache Spark

No SQL Databases: HBase

Web Technologies: HTML, JavaScript, CSS, JQuery, DOJO

J2EE Technologies: Java, Servlets, JSP, JSR 168 Portlets and JSR 286, JSF, JMS, Java Beans, Spring

Languages: C, C++, .NET, Java, SQL

Development Environment: Eclipse, RAD 6.0/7.0/8.0/9.0 , Net Beans, Maven

Reporting Tools: Tableau, QlikView

Database: Oracle 8i/9i/10i/11g, DB2, MySQL, SQL Server

PROFESSIONAL EXPERIENCE

Confidential

Hadoop Developer

Responsibilities:

• Worked on analyzing Hadoop cluster and responsible for building scalable distributed data solutions using different Big data tools including Apache Kafka, Apache Storm, Apache Spark, Pig, Hive and Map Reduce.
• Involved in monitoring and managing the Hadoop cluster and related services on Cloudera Manager.
• Ingested semi structured and unstructured log data that are collected from different sources and stored in HDFS using Apache Flume from Kafka for further analysis.
• Developed a data pipe line for Kafka and Storm by configuring spouts and bolts and writing the Storm topologies with HDFS and Hive bolts as destinations.
• Configured Spark streaming to collect the data from HDFS and performs necessary transformations and aggregations and persists the data in NoSQL (HBase).
• Implemented Hive Queries on spark cluster using spark SQL module for processing the data.
• Developed MapReduce programs to parse the raw data, perform transformation and aggregation on complex data from multiple file formats including XML, JSON, CSV and other compressed file formats.
• Written Hive Queries for creating UDF’s, external tables, portioning, bucketing, aggregate functions and Pig scripts for defining the UDF’s for processing the data.
• Scheduled MapReduce and pig jobs using Oozie workflow manager to cleanse the user data.
• Imported and exported data from Teradata to HDFS using Sqoop.
• Documented the processes and procedures of task performed for future s.

Environment: Hadoop, Cloudera, Apache Kafka, Apache Storm, Apache Spark, Hive, Pig, MapReduce, Sqoop, ZooKeeper, Oozie, MySQL, DB2, Teradata, Big Data, Linux, Eclipse, JDK.

Confidential, IL

Hadoop Developer

Responsibilities:

• Proactively involved in architecture design, implementation ofHadoop and deployment configuration management.
• Worked in 300 node cluster environment and worked on petabytes of data.
• Worked on Hortonworks distributed Hadoop and managed all services on Ambari.
• Implemented solutions for ingesting data from various sources and processing the Data-at-Rest utilizing technologies such asHadoop, MapReduce Frameworks, HBase, Hive, Oozie, Flume, Sqoop etc.
• Implemented MapReduce jobs in java programs by performing operations and processing different formats of data.
• Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
• Developed and written Apache Pig scripts like UDF’s and Hive scripts by creating external tables, performed joins, complex data types, portioning and bucketing to process the HDFS data.
• Involved in collecting, aggregating and moving web log data from web servers to HDFS using Apache Flume and solr.
• Written Hive jobs to parse the logs and structure them in tabular format to facilitate effective querying on the log data.
• Involved in processing different file formats like sequence file, text files using Pig Latin.
• Involved in creating Hive tables, loading with data and writing Hive queries that will run in map reduce way.
• Experience in optimization of Map reduce algorithm using combiners and partitions to deliver the best results and worked on Application performance optimization for a HDFS cluster.
• Implemented business logic by writing UDFs in Java and used various UDFs from Pig and other sources.
• Worked on debugging, performance tuning of Hive & Pig Jobs.
• Used Hive to find correlations between browser logs in different sites and analyzed.
• Created and maintained Technical documentation for launchingHadoopClusters and for executing Hive queries and Pig Scripts.

Environment: Java,Hadoop, MapReduce, Pig, Hive, Linux, Sqoop, Flume, Eclipse and Hortonworks.

Confidential, NJ

Hadoop/Java Developer

Responsibilities:

• Installed and configured Hadoop and Hadoop stack on Ubuntu.
• Written multiple MapReduce programs in java for data extraction, transformation and aggregation from multiple file formats including XML, JSON, CSV and other compressed file formats.
• Worked on data analytics by writing Pig scripts and Hive queries like creating external tables for storing large data sets on HDFS and processed.
• Evaluated Oozie for workflow orchestration in the automation of MapReduce jobs, Pig and Hive jobs.
• Captured data from Teradata into HDFS using Sqoop and processed the data using Hive and MapReduce jobs.
• Captured the web data logs from web server into HDFS using Flume for analysis.
• Experienced in writing Hive UDFs to pre-process the data for analysis.
• Built front end using JSP, Servlets, HTML and JavaScript to create user friendly and appealing interface.
• Used JSTL and built custom tags whenever necessary which helps to build interactive UI.
• Used JQuery for doing validations and made AJAX calls for the better user experience.

Environment: Hadoop, HDFS, Pig, Hive, Oozie, Sqoop, flume, Servlets, Maven, JSPs, JSTL, HTML, JavaScript, JQuery, CSS, Linux Shell Scripting.

Confidential, TX

Java /J2EE Developer

Responsibilities:

• Involved in analysis, design and development phases of the project. Adopted agile methodology throughout all the phases of the application.
• Worked on developing the application involving Spring MVC implementations and Restful web services.
• Involved in design and development of JSPs to enhance the UI.
• Used JavaScript library for effective UI functionality, validations and used AJAX for business calls.
• Used Advanced DOJO library for building the pages such as grids.
• Involved in deployment activity of the application by preparing XML access scripts and configuring the application in different environments.
• Highly experienced in debugging production issues in WebSphere Application server (WAS) and also worked on production support for WAS environment.
• Prepared ANT scripts to build files and deployed in WebSphere server.
• JUnit was used for testing the Java code.
• Used Rational Clear Case for version controlling and used diff merging, check-ins, check-outs, and adding new work files to source control and labeling. Responsible for documentation, maintenance and version control of the system.
• Oracle SQL developer was used as the database system for the writing database queries.
• Implemented different levels of logging using Log4j.
• ALM was used to handle defects and Rally as used to track of assigned tasks iteration based.
• Worked with business users to address their requirements, QA/UAT team to resolve issues.

Environment: J2EE, Eclipse, Spring MVC, oracle, Java, JSPs, Restful, SOAP UI tool, JavaScript, DOJO, HTML, CSS, WebSphere Application Sever, Log4j, JUnit, ClearCase, Rally, ALM.

Confidential, New Jersey

Java/J2EE Developer

Responsibilities:

• Involved in analysis, design and development phases of the project
• Experience in the Installation of WebSphere Application Server and Portal Server.
• Involved in design and development of JSPs to enhance the UI and functionality of the Portlets.
• All custom Portlets developed by the application are built using Spring Portlet MVC specifications.
• Used design patterns Data Access Object to help in development.
• Extensive involvement in database design and writing database queries, stored procedures using DB2 Database.
• Had written JSP components using WCM API.
• Written JMS listener by using WCM API to auto publishes the content.
• Involved in development of web services for retrieving data and also related documents.
• Used JQuery JavaScript library for effective UI functionality and used Ajax for business calls.
• Support Implementation and Post-Implementation defect management with the urgency needed to support a successful go-live.
• Developed forms and dynamic web pages using HTML and CSS making UI more users friendly.
• Involved in developing Class and Sequence diagrams in RAD.
• JUnit was used for testing the Java code.
• Used SVN as the code repository and versioning system.

Environment: Core Java, J2EE, WebSphere Portal, Rational Application Developer (RAD), DB2, Portlets JSR 168 & JSR 286, Java, JSPs, WCM Spring MVC framework, WSRP, Restful, SOAP, JAXB, JavaScript, JQuery, HTML, CSS, Log4j, TDS LDAP, JUnit, SVN.