PROFESSIONAL SUMMARY:

• 8 years of experience in IT, which includes experience in Bigdata, Hadoop ecosystem, Java/J2EE, SQL related technologies in Retail, Financial and Communication sectors.
• Hands on experience in installing, configuring and using of ecosystem components like Map Reduce, HDFS, Hive, PIG, Flume, Hbase, Zoo Keeper, Oozie, Cassandra, Sqoop and Cloudera Manager & Horton works Distribution of Hadoop.
• Experience in implementing advanced procedures like text analytics and processing using the in - memory computing capabilities like Apache Spark written in Scala.
• In-depth understanding of Data Structure and Algorithms
• Experience in developing PIG Latin Scripts and using Hive Query Language.
• Proficient knowledge on Apache Spark and programming SCALA to analyse large datasets using Spark and Storm to process real time data.
• Experience working on NoSQL databases including Hbase, Cassandra and MongoDB and experience using Sqoop to import data into HDFS from RDBMS and vice-versa.
• Agile Methodology and Iterative development.
• Good experience in writing Sqoop queries for transferring bulk data between Apache Hadoop and structured data stores.
• Substantial experience in writing Map Reduce jobs in Java, PIG, Flume, Tez, Zookeeper Hive and Storm.
• Good involvement in upgrading MapReduce calculations utilizing Mappers, Reducers, Combiners and Practitioners to convey best results for the extensive dataset
• Hands on experience on working with Amazon EMR framework for processing data on EMR and EC2 instances.
• Experience in performance tuning the Hadoop cluster by gathering and analysing the existing infrastructure.
• Working knowledge of RDBMS such as My SQL, Microsoft SQL Server.
• Understanding of Data warehouse and ETL tools.
• Expertise in system architecture, design and development of web application.
• Knowledge in developing Map Reduce Programs using Apache Hadoop for analysing the big data as per the requirement.
• In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, MRv1 and MRv2 (YARN).

TECHNICAL SKILLS:

Big Data: Hadoop, HDFS, Pig Hive Hbase, Sqoop, Cloudera, Oozie, Zookeeper, Cassandra, MongoDB, Spark, Scala

Language: Java, SQL, PL/SQL, HTML, XML, JavaScript, C#

Java/J2EE: Java, J2EE, Servlets, Portlets, JSP, JSF, Java Beans, JDBC, EJB

Open source framework and web development: Struts, Spring, Hibernate, JavaScript, Ehcache, JBoss and Web services, SOA, SOAP, REST, WSDL and UDDI.

Portals/Application servers: Weblogic, WebSphere Application server, WebSphere Portal server, JBOSS

Operating system: Windows, UNIX, Linux

Configuration Mgmt: CMVC, Clearcase, Clearquest, PVCS, CVS

Development Tools: Eclipse, Visual Studio, Net Beans, Rational Application Developer, Junit

Databases: NoSQL, Hbase, Cassandra, MongoDB, Oracle, SQL Server, DB2, MySQL, Toad, SQL

PROFESSIONAL EXPERIENCE:

Confidential, Atlanta, GA

Spark & Hadoop Developer

Responsibilities:

• Worked on analyzing hadoop cluster and different big data analytical and processing tools including Pig, Hive and Spark, Spark Streaming.
• Involved in architecture and design of distributed time-series database platform using NoSQL technologies like Hadoop/HBase, MongoDB.
• Responsible for configuring deployment environment to handle the application using Jetty server and Web Logic 10 and Postgres database Confidential the back-end.
• Involved in the implementation of Spring MVC Pattern and developed persistence layer using Hibernate framework.
• Implemented ORM through Hibernate and involved in preparing the Database Model for the project and followed Scrum methodology for the application development.
• Supported Map Reduce Programs those are running on the cluster and developed multiple Map Reduce jobs in Java for data cleaning and pre-processing.
• Extracted the data from various sources into HDFS using Sqoop and ran Pig scripts on the huge chunks of data.
• Further used pig to do transformations, event joins, elephant bird API and pre -aggregations performed before loading JSON files format onto HDFS.
• Involved in resolving performance issues in Pig and Hive with understanding of Map Reduce physical plan execution and using debugging commands to run code in optimized way.
• Good understanding of Partitions, Bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance.
• Worked with application teams to install operating system, Hadoop updates, patches, version upgrades as required.
• Exported the analysed data to the relational databases using Scoop for visualization and to generate reports for the BI team.
• Supported in settling up QA environment and updating configuration for implementing scripts with Pig and Sqoop.
• Configured Spark Streaming to receive real time data from the Apache Kafka and store the stream data to HDFS using Scala.
• Used Spark to perform analytics on data in hive.
• Responsible in using Spring MVC Framework for controlling central point request handling.
• Responsible in developing JSP view pages and involved in the development of DAO, Singleton Design Patterns.

Confidential, Milwaukee City, WI

Hadoop/ Java Developer

Responsibilities:

• Worked on Performance Enhancement and setting up pig, Hive and Hbase on multiple nodes and developed using Pig, Hive and Hbase, MapReduce.
• Worked with Distributed n-tier architecture and Client/Server architecture.
• Worked in implementation & maintenance of applications in Web-based environment.
• Developed MapReduce application using Hadoop, MapReduce programming and Hbase.
• Implemented data access using Hibernate persistence framework
• Developed the configuration files and the class’s specific to the spring and hibernate
• Utilized Spring framework for bean wiring & Dependency injection principles
• Expertise in server-side and J2EE technologies including Java, J2SE, JSP, Servlets, XML, Hibernate, Struts, Struts2, JDBC, and JavaScript development.
• Design of GUI using Model View Architecture (STRUTS Frame Work).
• Integrated Spring DAO for data access using Hibernate.
• Involved in the Development of Spring Framework Controllers
• Performed unit testing for all the components using Junit.
• Developed user interface using JSP, JSP Tag libraries JSTL, HTML, CSS, JavaScript to simplify the complexities of the application
• Involved in developing the Pig scripts and Hive Reports.
• Developed the scoop scripts in order to make the interaction between Pig and MySQL Database.

Confidential, Woodcliff Lake, NJ

Hadoop Developer

Responsibilities:

• Installed and configured Hadoop MapReduce, HDFS and developed multiple MapReduce jobs in Java for data cleansing and preprocessing
• Evaluated business requirements and prepared detailed specifications that follow project guidelines required to develop written programs.
• Moving log data periodically into HDFS using Flume. Building multi-hop flows, fan-out flows, and failover mechanism.
• Developed MapReduce jobs to automate transfer of data from Hbase and to read data files and scrub the data.
• Transferring data between MySQL and HDFS using Sqoop with connectors.
• Creating and populating Hive tables and writing Hive queries for data analysis to meet the business requirements.
• Installed and configured Pig and also written Pig Latin scripts.
• Migrating data from MySQL database to HBase. Running MapReduce jobs to access HBase data from application using Java Client API’s.
• Automating the jobs using Oozie.
• Installed and configured Hive, Pig, Sqoop, Flume and Oozie on the Hadoop cluster.
• Actively participated in software development lifecycle, including design and code reviews, test development, test automation.
• Involved in solution-driven agile development methodology and actively participated in daily scrum meetings.
• Monitoring Hadoop cluster using tools like Cloudera Manager.
• Automation script to monitor HDFS and HBase through Cron jobs.
• Create a complete processing engine, based on Cloudera's distribution, enhanced to performance.

Confidential, Denver, CO

Hadoop Developer

Responsibilities:

• Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing.
• Installed and configured Apache Hadoop to test the maintenance of log files in Hadoop cluster.
• Importing and exporting data into HDFS and Hive using Sqoop.
• Experienced in defining job flows and managing and reviewing Hadoop log files.
• Load and transform large sets of structured, semi structured and unstructured data.
• Responsible to manage data coming from different sources and for implementing MongoDB to store and analyze unstructured data.
• Supported Map Reduce Programs those are running on the cluster and involved in loading data from UNIX file system to HDFS.
• Installed and configured Hive and also written Hive UDFs.
• Involved in creating Hive tables, loading with data and writing hive queries that will run internally in map reduce way.
• Involved in Hadoop cluster task like Adding and Removing Nodes without any effect to running jobs and data.
• Created HBase tables to store variable data formats of PII data coming from different portfolios.
• Implemented best income logic using Pig scripts.
• Load and transform large sets of structured, semi structured and unstructured data
• Cluster coordination services through Zookeeper.
• Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
• Supported in setting up QA environment and updating configurations for implementing scripts with Pig and Sqoop.
• Continuous monitoring and managing the Hadoop cluster using Cloudera Manager.
• Used Hibernate ORM framework with Spring framework for data persistence and transaction management and involved in templates and screens in HTML and JavaScript

Confidential

SQL/ Java Developer

Responsibilities:

• Worked with several clients with day to day requests and responsibilities.
• Designed and developed Struts like MVC 2 Web framework using the front-controller design pattern, which is used successfully in a number of production systems.
• Resolved product complications Confidential customer sites and narrowed the understanding to the development and deployment teams to adopt long term product development strategy with minimal roadblocks.
• Convinced business users and analysts with alternative solutions that are more robust and simpler to implement from technical perspective and satisfying the functional requirements from the business perspective.
• Played a crucial role in developing persistence layer.
• Wrote SQL queries to perform back-end database operations.
• Wrote various SQL, PLSQL queries and stored procedures for data retrieval.
• Prepared utilities for the Unit -Testing of Application Using JSP and Servlets.
• Developed Database applications using SQL and PL/SQL.
• Applied design patterns and Object Oriented design concept to improve the existing Java/J2EE based code base.
• Identified and fixed transactional issues due to incorrect exception handling and concurrency issues due to unsynchronized blocks of code.
• Documented technical specs, class diagrams and sequence diagrams, developed technical design documents based on changes. Analyzed Portal capabilities and scalability and identified area where Portal could be used to enhance usability and improve productivity.