PROFILE SUMMARY:

• Over 11.5+ years of experience in Analysis, Architectural Design, Prototyping, Development, Integration and Testing of application using Java/J2EE Technologies and Big Data (Hadoop) technologies.
• Over 3+ years of experience with Hadoop Ecosystem including HDFS, Map Reduce, Hive, Pig, Storm, Kafka, YARN, HBase, Oozie, Zookeeper, Flume, Sqoop, Splunk, monitoring tools( Cloudera manager, Ganglia, Ambari), R and Spark.
• Experienced in client facing role and stake holder management
• Experienced with NoSQL databases like HBase, MongoDB and Cassandra to implement near real time analytics.
• Using Scala developed the spark code for capturing Twitter stream and stored in Cassandra
• Designed and build 2 multinode Cassandra data centre for storing Twitter data
• Created Dashboard using node.js for one of the FMCG giant
• Migrated 200TB of data to the data lake from the legacy system
• Created an application for document management and text search implementation using SOLR
• Created predictive model and recommendation engine using R/Spark - ML for Insurance and FMCG customer
• Expert database engineer; NoSQL and relational data modelling
• Responsible for building scalable distributed data solutions using DatastaxCassandra.
• Experienced in design/develop data model for Cassandra file system and implement CRUD operations using Thrift and Rest API.
• Experienced in working with Cassandra Query Language (CQL) to work with file system.
• Expertise in HBase Cluster Setup, Configurations, HBase Implementation and HBase Client API
• Worked on importing data into HBase using HBase Shell and HBase Client API
• Experienced in MongoDB data modelling, cluster setup, journaling and sharding creation
• Experienced in migrating Map reduce to spark Transformations using in memory processing.
• Design and develop Spark transformations, apply spark actions to imply algorithms.
• Experienced in working with Spark QL to analyse structure data queries.
• Knowledge in implementing predictive algorithms using Spark Mlib libraries.
• Expert in implementing unified data platform to gather data from different sources using Kafka Java Producers and consumers.
• Experienced in design Kafka brokers, creating custom partitions and integrated with apache storm for transformations.
• Experienced in implementing Kafka Simple consumers to get data from specific partitions.
• Experienced in implementing Storm topologies to do pre-processing before move data to target consumers.
• Experienced in design/develop storm spouts, bolts to get data from Kafka sources.
• Comprehensive experience in building Web-based applications using J2EE Frame works like Spring, Hibernate, Webservice(SOAP/Rest), JMS, EJB, Angular Js, JSF and SQL/PLSQL.
• Extensive experience into building application using Websphere Portal
• Assisted in Cluster maintenance, Cluster Monitoring and Troubleshooting, Managing and Reviewing data backups and log files.
• Excellent ability to use analytical tools to mine data, Predictive analysis, evaluating the underlying patterns and implement complex algorithms for data analysis.
• Expert in implementing unified data platform to gather data from different sources using Kafka Java Producers and consumers.
• Experienced in design Kafka brokers, creating custom partitions and integrated with apache storm for transformations.
• Experienced in implementing Kafka Simple consumers to get data from specific partitions.
• Experienced in implementing Storm topologies to do pre-processing before move data to target consumers.
• Experienced in design/develop storm spouts, bolts to get data from Kafka sources.
• Hands on experience in developing Map Reduce programs using Apache Hadoop for analysing the Big Data
• Expertise in optimizing traffic across network using Combiners, joining multiple schema datasets using Joins and organizing data using Partitioners
• Experience in writing Custom Counters for analysing the data and testing using MRUnit framework
• Experienced in writing complex Map Reduce programs that work with different file formats like Text, Sequence, Xml and Avro
• Expertise in composing Map Reduce Pipelines with many user-defined functions using to implement complex algorithms.

PROFESSIONAL EXPERIENCE:

Confidential

Technology: HBase, Solr, Sqoop, Hive, Oozie

Responsibilities:

• Involved with the architecture of the whole infrastructure, cluster setup on Hortwonwork HDP
• Prepared the disaster recovery and backup architecture for Hadoop cluster
• Involved in writing HBase queries and data modelling
• Involved in Solr implementation for Text searching
• Writing Hive tables and performance tuning of Hive(implementation of Tez)

Confidential

Technology: HBase, MongoDB, Cassandra,Zabbix,Java,AWS

Responsibilities:

• Involved with the architecture of the whole infrastructure, cluster setup on Hortwonwork HDP
• Prepared the disaster recovery and backup architecture for Hadoop cluster and AWS environment.
• Involved in Mikoomi plug-in configuration for monitoring MongoDB on different environment.
• Wrote node.js API for load testing of the environment.
• Involved in HDFS and HBase snapshot creation and storing into Amazon S3 and pulling back from S3
• Involved in writing HBase queries and data modelling
• Involved in creating Cassandra cluster for distributed data management and profiling the data
• Involved in Cassandra Data modelling
• Involved in creating Jaspersoft report from Cassandra DB.

Confidential

Technology: Java, HBase, Solr

Responsibilities:

• Involved with the Java code writing for inserting the data into Hbase
• Prepared the Solr configuration for Index creation

Confidential

Technology: PIG,Hive Sqoop, Syncsort,Talend,Informatica

Responsibilities:

• Involved with the architecture of the whole infrastructure, cluster setup
• Prepared the disaster recovery architecture for making Lowes cluster as a highly available cluster.
• Wrote PIG and Hive queries in order to do advanced analytics on top of the datasets and compared against each vendor.
• Wrote MapReduce program (EMR) to make the unstructured data to semi structured data and loaded into Hive tables.
• Evaluated various ETL tools like Informatica, Talend and Syncsort for data transformation and performance considerations.

Confidential

Technology: Java, Hadoop, Hive, Cassandra, Informatica

Responsibilities:

• House an ever growing set of data collected from multiple business units.
• Allow for quick collection of data
• Rapidly scale up and down to meet fluctuating demands.
• Provision a wide variety of open sourced virtual machines.
• Utilize open source technology to move away from enterprise license fees and avoid vendor lock in to any one particular product.
• Developing custom transformation supporting to Confidential
• Writing Map Reduce program
• Writing Hive Query
• Restful Webservice creation

Confidential

Technology: Java, Hadoop, Hive, Map Reduce, Cloudera Impala, Python,Apache Solr,Amazon

Responsibilities:

• Client Interaction
• Writing Map Reduce program
• Writing Hive Query
• Data analytics
• Bug Fixing

Confidential

Technology: Core Java, WebServices (Restful),mySql, Mule ESB, Junit,Angular.js

Responsibilities:

• Client Interaction
• Integrated Social Media like Facebook and Twitter.
• Service creation using REST API.
• Writing Angular.js code for responsive UI development
• ESB coding for data transfer
• JUnit test case writing

Confidential

Technology: Core Java, Swing/JavaFX,Oracle, XML

Responsibilities:

• Integration of Peopelsoft and Primavera for implementation of Timesheet Sync
• Java coding enhancement for the utility
• Testing the product's usability

Confidential

Technology:Java, JSP, Struts, EJB, Hibernate, GWT,My SQL, Android SDK, SQLite, Android Porting, Selenium WebDriver

Responsibilities:

• Initial offshore setup for the project
• Coding and Writing Automation script
• Coordinating with team members and communicating client
• Bug fixing
• Updating daily and weekly status to Project Manager
• Working on Android Notification Manager and Activity Manager

Confidential

Technology: Core Java, JSP, Spring, Hibernate, JSF, RAD, Oracle 10g,Apache Lucene-Solr

Responsibilities:

• Requirements Analysis
• Creation of Portlet using Websphere portal
• Writing code for Interportlet communication
• Bug fixing for existing portlet
• Writing UI code using JQuery

Confidential

Technology: WebSphere Portal, Core Java, JSP, RAD, Axis, Spring, UNIX

Responsibilities:

• Requirements analysis
• UML design using JUDE
• Multi-threading code writing for HILO server
• Client Communication
• Bug fixing for the enhancement of the product