SUMMARY:

• Cloudera Certified Spark and Hadoop Developer with extensive experience working in Start - up environment.
• 9 + years of overall IT experience in a variety of industries, which includes hands on experience in Big Data Analytics and development, and Java and J2EE Technologies.
• Expertize with the tools in Hadoop Ecosystem including Pig, Hive, HDFS, MapReduce, Apache Sqoop, Flume, Apache Spark, Kafka, Yarn, Oozie, and Zookeeper.
• Extensive knowledge on Hadoop ecosystems such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce programming paradigm.
• Experience in designing and developing applications in Spark using Scala/Python to compare the performance of Spark with Hive and MySQL.
• Experience in manipulating/analysing large datasets and finding patterns and insights within structured and unstructured data.
• Strong experience on Hadoop distributions like Cloudera and HortonWorks.
• Experienced in writing complex MapReduce programs that work with different file formats like Text, Sequence, JSON, parquet and Avro.
• Experience in Oozie and workflow scheduler to manage Hadoop jobs by Direct Acyclic Graph (DAG) of actions with control flows.
• Experience in migrating the data using Sqoop from HDFS to Relational Database System (RDS) and vice-versa according to client's requirement.
• Extensive Experience on importing and exporting data using stream processing platforms like Flume and Kafka.
• Expertise in developing Object Oriented Software Systems and building complex, High performance Products using Java.
• Good Debugging skills and Hands on Experience in resolving complex issues.
• Designed and Developed many Set Top Box (STB) applications and Graphical User Interface (GUI) using Java and Worked on PSI table Section Filtering
• Well versed and have Hands on experience with UML (Unified Modelling Language) and OOAD (Object Oriented Analysis and Design) concepts.
• Involved in web-based technologies like Servlets, JSP, JMS and Spring, Hibernate Frameworks.
• Implemented MVC patterns in web architecture and worked on memory profiling using VisualVM.
• Contributed to Code Reviews and moderating reviews and monitoring the Review Practices being followed in the team.
• Taken part in CIP (Code Improvement Program) and have owned Code Review Defect leakage and refactoring activities.
• Have good knowledge and experience of Agile methodology.
• Self-motivated, proactive attitude and Ability to work independently with minimum supervision in a team environment.
• Travelled many times to Confidential France (CISCO) to participate in system Integration Activities.
• Received SPOT many a times in various projects for Outstanding Performance and for Process Adherence.
• Developing an Amazon Machine Image (AMI) that provides features to perform analytics of healthcare dataset like Diabetes dataset on my own.
• Completed Cloudera Spark and Hadoop Developer (CCA-175).
• Implemented various self-driven data engineering projects like analysing different types of datasets that are mentioned below.
• Performed Sqoop actions and Spark RDD transactions on various forms of datasets as, but not limited to, e-commerce dataset, IMDB movie dataset, global temperature dataset, diabetes dataset, etc.
• Imported and exported data between MySQL and HDFS using Sqoop.
• Changed delimiter and file format of data during import using Sqoop.
• Performed incremental import of data to HDFS and hive database using Sqoop.
• Loaded data into and out of HDFS using the Hadoop File System Commands
• Loaded RDD data of different file formats (Avro, Parquet, Text, JSON, Sequence etc.) and different compression codec (Gzip, Snappy) from HDFS using Spark.
• Written the results from RDD data back into HDFS in a variety of file formats using Spark.
• Performed standard extract, transport, load (ETL) processes on data using Spark.
• Used metastore tables as an input source or an output sink for spark applications
• Querying datasets and filtering data using Spark RDD, Spark DF and Spark SQL.
• Wrote queries that calculate aggregate statistics, join disparate datasets and produced ranked or sorted data using Spark RDD, Spark DF, Spark SQL, HiveQL, Hive and Impala.
• Provided s on Java to college students and helped them in their projects.

TECHNICAL SKILLS:

BigData/Hadoop Technologies: HDFS, YARN, MapReduce, Hive, Pig, Impala, Sqoop, Flume, Spark, Kafka, Spark SQL

STB Domain: DVB Standards, MHP (Multimedia Home platform)

Languages/technologies: Java, Scala, Python, HiveQL, Swings, HTML5, JavaScript, Servlet, JSP, JST, JMS, JSF, JDBC, JQuery, SOAP

Framework: JUnit, Spring, Hibernate

Design Patterns: Singleton, Observer, Factory, Model View Controller, Decorator

Cloud Computing Tools: Amazon AWS

Database: MySQL

Web/application Server: Apache Tomcat, Glassfish

Source Control: IBM Rational Synergy, SVN

IDE, Tools & Utilities: Eclipse, NetBeans, Rational Rose, Microsoft Visio, VisualVM

Operating Systems: Windows, Unix, Linux

PROFESSIONAL EXPERIENCE:

Confidential, New Jersey

Environment: Windows, MySQL, Tomcat, Amazon AWS, Cloudera QuickVM

Responsibilities:

• Product Lead Data Analytics module for Confidential .com.
• Designed and developed analytics module of Confidential .
• Responsible for big data analytics implementations with CDH, Hadoop and Java technologies.
• Researched and investigated on various social media APIs (Twitter, Facebook, LinkedIn, and Google).
• Performed advanced procedures like text analytics and processing, using the in-memory computing capabilities of Spark using Scala.
• Implemented MapReduce modelling programs using Amazon EMR, S3 and EC2.
• Implemented Email alerts using Amazon SES and Java Mail.
• Implemented graphs and charts using highcharts, highmaps, Google HeatMap JS.
• Implemented User management module.

Confidential

Environment: Windows, MySQL, NetBeans, GlassfishDescription:

Responsibilities:

• Design and develop the model part of the search tool using Facebook, LinkedIn and twitter search APIs.
• Involved in design and development of user interface and web pages using JSF.
• Involved in Design, Code reviews and Effort Estimation of Development activities.

Confidential

Environment: Java, Swings, JUnit, JavaScriptBox Manufacturer

Responsibilities:

• Developed the Technical Design Document on requirements documents.
• Designed and Developed areas which are impacted by CA system such as Channel selection, validating offers and Wake Up Channel Management.
• Leading Development Team and tracking development status
• Involved in Design, Code reviews and effort Estimation of development activities.

Confidential

Responsibilities:

• Developed the Technical Design Document based on requirements documents.
• STB Settings, Time Shifting and Program Card modules owner. Used SAX Parser for parsing xml related to program card feature.
• Designed and developed Graphical User Interface of Secured Channel Management module, Program search, STB installation and user ps. Program search is done based on specific criteria such as genre, program start time, etc.
• Developed Generic Widget which can display image, messages and progress bar at the same time.
• Refactored and involved in Profiling for Code Optimization.
• Designed and Developed Graphical User Interface of Time Shifting Module, Program Card module and Language Management.
• Helped and mentored team members in development of various modules
• Involved in Design, Code reviews and Effort Estimation of Development activities

Confidential

Environment: Java, Swings, JUnit, JavaScript

Responsibilities:

• Developed the Technical Design Document based on Requirements Documents.
• Designed and developed Wake Up Chanel Management module.
• Designed and developed Scanning module and Graphical User Interface of Program Search, STB installation, user ps and PVR. Program Search is done based on specific criteria such as genre, program start time, etc.
• Involved in Effort Estimation of Development activities.
• Helped and mentored team members in development of various modules
• Involved in Design and Code Reviews.
• Responsible for Tracking Development Status and coordinating with French counter-part.

Confidential

Environment: Java, Swings, JUnit, JavaScript

Responsibilities:

• Designed and developed Scanning, Maintenance and STB States management modules.
• Designed and developed graphical user interface of Scanning, Maintenance, Hard disk status and PVR.
• Involved in Bug fixing.
• Developed the Technical Design Document based on requirements documents.
• Responsible for tracking development status and coordinating with French counter-part.
• Helped and mentored team members in development of various modules.

Confidential

Environment: Java, Swings

Responsibilities:

• Designed and developed Maintenance module. Worked on Section Filtering of Maintenance related tables.
• Designed and developed graphical user interface of Installation, Settings, Ps, Banner and Filter
• Involved in bug fixing and Developed the Technical Design Document based on Requirements Documents.

Confidential

Responsibilities:

• Development of JSP pages, Servlets, Code Review, Defect logging, tracking and fixing.Online Journal Submission and Query manager

Confidential

Responsibilities:

• JSP pages, Servlets Development, Code Review, Defect logging, tracking and fixing.