EXPERIENCE SUMMARY:

• 12 years of Experience in IT Industry with 1year and 3 months of USA experience (1 year L1 and 3months H1)
• Cloudera Certified Hadoop Developer(CCD - 410).
• 4+ years of experience in Hadoop and its components like Map Reduce, spark,scala,Apache Pig, Hive, Sqoop, flume, HBase,impala, Talend Bigdata, Marklogic and Oozie.
• 6+ years of Experience in Developing JAVA and J2EE applications.
• 2 years of Experience in developing applications using AS400 and Mainframes.
• One of the authors of hadooptutorial.info site.
• Knowledge on Spark, Kafka, Spring Boot, Phoenix, Azkaban, Impala & MongoDB.
• Hands on Experience on Hunk (Splunk) and Tableau data visualization tools.
• Knowledge on Single node and Multi node Cluster setup.
• Knowledge on YARN Mapreduce.
• Hands on Experience in performing predictive analytics using Linear & Logistic Regression, Clustering, Decision Trees,Neural nets, Deep Learning and also Text Mining in R.
• Worked as Onsite Coordinator at Buffalo (New York City) for 1 year.
• International School of Engineering(INSOFE) certified analytics professional.
• Hands on Experience in Developing Applications using Spring, Struts, Hibernate Frameworks.
• Hands on Experience of using Log4J, Junit, ANT, Sonarcube, Cobertura, Emma, Jenkins, Github and Maven

TECHNICAL SKILLS:

Operating System: Windows 98/2000/XP, Ubuntu, Centos

Languages: Core Java - Implementing object oriented principles using Abstraction, Encapsulation, Inheritance and Polymorphism with access modifiers and specifies, extensively used CollectionsJava IO, Multithreading, JDBC and etc. J2EE - Servlets, JSPJNDI, Java Mail, parsing XML using SAX and DOM parsers. Written and deployed applications for Java/J2EE/JEE n Windows and UNIX platforms.

Application/Web Servers: WAS, Apache Tomcat.

RDBMS: Mysql, Postgres, DB2400 and DB2.

Frameworks: Hibernate, Spring, Struts, iBatis, Spring Boot, Flyway

Markup Languages: HTML, XML

IDE’s: RAD and Eclipse

Bigdata Technologies: MapReduce, HIVE, PIG, SQOOP, Spark, Kafka and OOZIE

No SQL databases: HBase, MONGO DB

Java Tools: Log4J, Junit, ANT, Sonarcube, Cobertura, Emma, JenkinsGithub, JFrog, Mockito, JBehave and maven

Others: R, Pivotal Cloud Foundry(PCF)

PROFESSIONAL EXPERIENCE:

Confidential, Cary, North Carolina

Environment: Hadoop, HDFS, Hive, Impala, Oozie, Tableau, Sqoop, Spark

Responsibilities:

• Involved in the design discussions of the project.
• Developed Sqoop jobs to import data from different RDBMS systems to hadoop.
• Developed Oozie workflows to schedule all the jobs.
• Developed Spark programs to perform the data validations.
• Developed tableau visualizations Data Quality reports.
• Interacting with the Business team in understanding and prioritizing the requirements.
• Mentoring the team on technical aspects.
• Conducted trainings for the team members on Hadoop Ecosystem.

Confidential, New jersey

Environment: Hadoop, HDFS, Flume, Hive, Impala, Oozie, Talend, Tableau, Sqoop, Spark

Responsibilities:

• Involved in design of the Xplore logs transfer to hadoop.
• Developed spark programs to process unstructured logs and store data in hive.
• Developed impala scripts to access the data from hive.
• Developed Sqoop jobs to import data from oracle to hadoop.
• Developed Oozie workflows to schedule all the Xplore related activities.
• Interacting with the Business team in understanding and prioritizing the requirements.
• Mentoring the team on technical aspects.
• Conducted trainings for the team members on Hadoop Ecosystem.

Confidential

Environment: Hadoop, HDFS, Kafka, Spring Boot, Spark, Hive, Sqoop, Drools, Oozie, Pivotal Cloud Foundry(PCF), Java 8

Responsibilities:

• Involved in design of Generic framework creation to provide metadata driven ingestion using Maria DB.
• Developed spark generic framework for business computations using dataframes.
• Involved in Performance tuning of the Spark programs.
• Review of the team code and changes.
• Developed generic Exceptional handling and logging using Spring Boot.
• Developed Jenkins pipeline for dev, SAT, UAT and Prod so that we can do CI/CD.
• Integrated Jenkins build with sonar cube so that we can analyze all the code level bug/issues and also code coverage.
• Interacting with the Business team in understanding and prioritizing the requirements.
• Mentoring the team on technical aspects.
• Conducted trainings for the team members on Hadoop Ecosystem.

Confidential

Environment: Hadoop, HDFS, MapReduce, Hive, Hbase, Sqoop, Talend Bigdata, Marklogic, Splunk.

Responsibilities:

• Involved in Project Architecture, Design, Coding and Unit testing phases.
• Developed Mapreduce programs for converting raw data to AVRO.
• Developed Hive Scripts for loading some processed data to Hive.
• Developed Hive Custom UDFs for filtering data in Hive.
• Developed Hive Scripts to perform different joins on Hive tables.
• Developed Talend jobs to store metadata into HBase tables.
• Developed Talend Jobs to convert data to XML documents.
• Developed marklogic scripts to process the XML documents to Marklogic database.
• Conducted trainings for the team members on Hadoop Ecosystem.

Confidential

Environment: Hadoop, HDFS, Pig and Elastic Search

Responsibilities:

• Involved in Project Architecture, Design, Coding and Unit testing phases.
• Developed Sqoop scripts for data ingestion from mainframes.
• Developed Pig Scripts for doing required transformations and load the data to ES indexes.
• Developed different ES Indexes so support different API searches.

Confidential

Environment: Hadoop, HDFS, Flume, MapReduce, Hive, Hbase, Phoenix, Hunk.

Responsibilities:

• Involved in writing custom Flume Interceptors.
• Developed Mapreduce programs for processing unstructured log data to Structured.
• Developed Phoenix Scripts for quering Hbase data.
• Developed Hive Scripts for loading some processed data to Hive.
• Developed Hive Custom UDFs for filtering data in Hive.
• Developed Custom Search commands in Hunk.
• Developed Hunk search scripts for connecting to Hive and generate high level reports, graphs and Dashboards.
• Conducted trainings for the team members on Hadoop Ecosystem.

Confidential

Environment: Hadoop, HDFS, Sqoop, MapReduce, Hive, YUI, jFreeCharts, Spring MVC, iBatis, DB2, iReport Designer.

Responsibilities:

• Involved in writing Sqoop commands for loading data from different DB2 databases to HDFS.
• Developed Mapreduce programs for processing the data.
• Developed Sqoop commands for exporting most of processed data to DB2 database.
• Developed Hive Scripts for loading some processed data to Hive.
• Worked on Controllers, services and DAOs.
• Worked on iBatis mapping files for adding new data fields.
• Worked on generation of online bar charts, pie charts, line charts using jFreecharts API.
• Worked on generation of detailed reports from Hive using iReport designer.
• Conducted trainings for the team members on Hadoop Ecosystem.

Confidential

Environment: Spring MVC, iBatis, DB2, Sqoop, PIG, Hive, iReport.

Responsibilities:

• Worked on Controllers, services and DAOs.
• Worked on hibernate mapping files for adding new data fields.
• Implemented the mentioned project using Hadoop Frame work.
• Wrote Sqoop commands for loading data from DB2 to HDFS.
• Developed PIG scripts for processing the data.
• Developed PIG UDFs for performing some calculations on data.
• Developed Hive Scripts for loading processed data into Hive tables.
• Involved in generation of reports from Hive tables using iReport tool.

Confidential

Environment: Struts, Hibernate, Maven, Tiles, DB2.

Responsibilities:

• Develop web application using Struts Framework
• Develop user interfaces using JSP, HTML and CSS
• Used JavaScript and struts validation framework for performing front end validations.
• Develop DAO design pattern for hiding the access to data source objects.
• Use Hibernate framework for the backend persistence
• Use Eclipse as IDE tool to develop the application and JIRA for bug and issue tracking
• Implemented Junit for Unit Testing.
• Involved in the Requirement Discussions with the Business.

Confidential

Environment: Java, JavaScript, XML and Lexmark Document Distributor (LDD), Axis.

Responsibilities:

• Developed JavaScript code for document validations and batch processing.
• Developed Java code for business validation of documents.
• Developed Web Service Client for connecting to one of our internal Shared Infrastructure system for document validations.
• Involved in the Requirement Discussions with the Business.