SUMMARY

• 7+ years of work experience in developing applications using Big Data Hadoop, Apache Spark and Java/J2EE technologies including requirements analysis, design, testing and support.
• 3+ years of exclusive experience working on Spark, Hadoop stack and around 4 years of experience in developing applications using Java technologies.
• Experience developing data pipelines using data processing frameworks like CDAP (Cask Data Application Platform) and CASK Hydrator.
• Experience in working with Apache Spark Batch Processing, Streaming and Spark SQL API in various contexts using Scala and Python.
• Robust knowledge of using various Hadoop technologies such as Map Reduce, Pig, Hive, Sqoop, Flume, Oozie, HBase.
• Experience in working with real time streaming using Flume and Apache Kafka.
• Experience with UNIX/Linux, Shell Scripting.
• Expertise in Core Java, Data Structures, Algorithms, Object Oriented Design (OOD), Collections Framework, Exception Handling, I/O System and Multi - Threading.
• Extensive knowledge in developing applications using JSP, Servlets, Struts, Spring, Web Services, JDBC, JPA (Hibernate) and SQL.
• Strong work experience in developing SOAP/Restful Web Servicesusing JAX-WS, JAX-RS and Python Django frameworks.
• Strong understanding of J2EE design patterns.
• Experience with full software development life-cycle, architecting scalable platform, object-oriented programming.
• Experienced in designing and developing applications using relational databases like Oracle, MySQL, PostgreSQL and NoSQL databases like HBase.
• Experienced in using Control Version Systems like Git, SVN and issue tracking tools like JIRA.
• Experienced in using build tools like Maven.
• Worked in software development methodologies like Agile/Scrum and Waterfall.
• Can work productively in a team and to take independent responsibilities.

TECHNICAL SKILLS

Hadoop/CDAP Technologies\Apache Spark: CDAP, CASK Hydrator, HDFS, Map Reduce \Spark v.1, Spark SQL, Python API (PySpark), \ v2.6.x, YARN, Hive 0.14.0, Pig 0.14.0, Pig \Scala API \Latin, Sqoop 1.4.4, Kafka 0.8.0, Flume 1.4.0, \Hue, Impala\

Scheduling\Servers: Zookeeper 3.4.6, Oozie 4.0.1\Apache Tomcat, JBoss, WebLogic\

Java Technologies\Web Services: Java 1.5/1.6/1.7/1.8, JDBC, Hibernate 3.0, \SOAP/Restful, JAX-RS, JAX-WS, Jersey, Axis\Spring 3.x, Struts 1.2/2.x\

IDE & Tools: \Version Control Eclipse, IntelliJ IDEA\SVN, GIT\

Build Automation: \Programming Languages Maven, Jenkins\Java/J2EE, Python/Django, Scala\

Operating Systems: \Database Linux, UNIX, Windows\HBase v0.98.0, Oracle, MySQL, PostgreSQL\

Others: Docker, Apache Solr

PROFESSIONAL EXPERIENCE

Confidential, Middletown, NJ

Developer

Responsibilities:

• Developed the functionality to migrate the post processing which was earlier on LLCs to Data Transformation Cluster and worked with CDAP team for the modules that require Hadoop for WIPM Classic and WIPM Metro projects.
• Developed and enhanced CDAP Hydrator Pipelines for processing the data and persist to Oracle database and to HDFS for further processing.
• Improved the performance of the pipelines further using Apache Spark and Scala with batch and stream processing of the data based on the requirement.
• Automated the build, installation and scheduling of CDAP and Spark applications using Shell Script, Maven, Jenkins and Oozie for various teams for deploying the CDAP applications onto the hadoop cluster.
• Designed and developed a PoC for Application Controller using Python, Django, MySQL for managing (deploy, maintain, control) various services and applications.
• Configure and test Confidential & Confidential proprietary queueing systems between hadoop clusters and high/low level collectors.

Environment: Apache Spark 2.1, Scala, CDAP 4.2, Hadoop 2.6.x, Java, Python, Django, Shell Script, Oozie, Linux, Maven, Oracle, MySQL, Git

Confidential, Mt Laurel, NJ

Hadoop Developer

Responsibilities:

• Imported the structured data from the OLTP systems using Sqoop.
• Migrated Map Reduce programs into Spark transformations using Scala and Spark for batch processing.
• Converted the data into structured Parquet files, which formed the basis for SQL powered analysis done using Hive.
• Performed joins on the map side using distributed cache.
• Processed transactional data has been saved into Hive tables after the necessary transformations.
• Developed complex Hive queries considering partitioning and bucketing techniques.
• Developed scripts and batch jobs to schedule various hadoop programs.
• Exported the final insights into HBase allowing low latency access for the downstream applications to discover additional patterns in customer spending sequence and for BI teams to generate reports.
• Scheduled the daily workflow for importing and processing of data using Oozie.

Environment: Hadoop 2.x, HDFS 2.6.0, Spark 1.4, Scala, Java, JDK 1.7, Hive 0.14.0, HBase 0.98.0, Linux, Oozie 4.0.1

Confidential, Milpitas, CA

Hadoop Developer

Responsibilities:

• Assisted in the configuration and set up of Map Reduce, Hive and Flume.
• Migrated the existing CRM and marketing spend data to Hadoop from RDBMS (MySQL) using Sqoop.
• Ingested the click stream data from web servers to Spark Streaming and HDFS using Kafka and Flume for further processing.
• Used Spark Streaming for real time data ingestion, data cleaning and performing transformations.
• Transformed the data by removing the duplicates, filtering and grouping the customer activity based on the sessions using Spark.
• Performed aggregations on the structured and unstructured data from clickstreams using Spark.
• Created Hive tables for storing the processed results in a tabular format
• Developed HiveQL queries to do analysis and identify correlations.
• Developed, tested and used custom Hive UDFs for the operations that are not preexisting in Hive.
• Optimized the data set joins by partitioning and bucketing the data while loading into hive warehouse.
• Developed Java Map Reduce jobs for performing tricky joins and grouping of data sets.
• Scheduled Oozie workflow engine to perform Sqoop incremental imports on a daily basis and run multiple jobs

Environment: Hadoop 2.0, Kafka 0.8.0, Flume 1.5.2, Spark 1.0.2, Map Reduce, Hive 0.12, Java, JDK 1.7, Sqoop 1.4.4, HBase 0.94.6, Oozie 3.3.2, Linux

Confidential, Dallas, TX

Java/Hadoop Developer

Responsibilities:

• Enhanced the existing features and added new features for SBCE on the Application level using Java.
• Simplified the configuration setup for the varying user defined environments by automating the processes and saving time for the ASBCE team.
• Worked on internal automation frameworks using Python.
• Assessed the quality by performing the feature tests and load tests using internal test tools.
• Worked on POC to generate the insights using hadoop from the data generated in the contact centers.
• Loaded the data from Confidential IQ MySQL database into HDFS using Sqoop and transform the data using Pig.
• Created Hive tables and loaded the data into tables after the necessary transformations.
• Developed HiveQL queries to analyze and get insights on agent activity, skills, agent scoring, customer satisfaction, etc.
• The analysis results are stored in HBase making it available for visualization applications to use.

Environment: Java, Python, Hadoop 2.0, HDFS, Hive 0.13, Pig 0.11, HBase 0.94.6, Sqoop 1.4.2, MySQL, Linux

Confidential

Java/J2EE Developer

Responsibilities:

• Represented the call events and the end point’s information in the form of graphs to ease the decision process about the call failed errors or unexpected call flows.
• Developed application using J2EE technologies like Spring, Hibernate and JSP.
• Developed Object Relational Mapping using Hibernate to persist objects to RDBMS.
• Developed the application using Spring MVC framework by implementing the classes for Services, Controller.
• Implemented the business layer using Spring DI and Spring AOP features.
• Implemented Restful web services using Jersey and display the results.

Environment: Java 1.7, Spring 3.0, Hibernate 3.0, JSP, JAX-RS, Eclipse, MySQL, Tomcat, Maven

Confidential

Java/J2EE Developer

Responsibilities:

• Developed the application using Struts 1.2 framework for designing MVC Model II architecture.
• Created Struts Action Class Controller for invoking the respective business logic methods
• Extensively used Enterprise Java Beans to encapsulate the application business logic.
• Designed the presentation layer using JSP, Struts Tag Library and JavaScript.
• Participated in developing Stored Procedures, Functions and Packages which address inline data transformations.
• Implemented log4j as the logging framework.
• Built and tested the application using Maven.
• Used JUnit for unit testing various components to meet functional and business requirements.

Environment: Java, JSP, Struts 1.2, log4j, JUnit, Oracle 9i, Maven

Confidential

Java/J2EE Developer

Responsibilities:

• Developed the application using Struts framework.
• Developed Controller logic for the application using Struts Action Classes and mapped them in configuration files.
• Implemented various J2EE design patterns like DAO pattern, Business Delegate and Singleton.
• Developed Data Access Objects for accessing Relational Database.
• Responsible for coding SQL Statements and Stored procedures for back end communication using JDBC.

Environment: Java, JSP, Struts, JDBC, Eclipse, MySQL