SUMMARY:

• 6 years of overall software development experience in Big data &Hadoop, Java in the area of Data Analytics, Data Transformation, ETL, web technologies and others.
• Expertise in understanding the client’s Big Data business requirements and transform them into Hadoop centric technologies with Data visualization creating business value
• Experience in Data migration from existing data stores to Hadoop HDFS.
• Worked on Hadoop distributions, Cloudera and Horton works.
• Hands on experience on Hadoop Distributed file system (HDFS), HIVE, HBase, PIG, Hadoop Map Reduce framework, YARN, Flume, Oozie, Zookeeper, and SQOOP.
• Implemented SQOOP for large dataset transfer between Hadoop and RDBMs.
• Coded Map Reduce scripts in java for Data transformation, Manipulation and preparation of certain unstructured data to the desired format to load later onto Hive and HBase.
• Worked extensively with Hive Query language (HQLs) warehousing the data on top of hadoop building the structure for the unstructured data.
• Developed UDF, UDAF, UDTF functions and implemented it in HIVE Queries.
• Developed PIG Latin scripts for handling business transformations.
• Developed Map Reduce programs to perform Data Transformation and analysis.
• Worked with Talend to perform ETL operations.
• Worked with join patterns and implemented Map side joins and Reduce side joins using Map Reduce.
• Worked on Data Visualization using Tableau and created statistics and dashboards for Analytics.
• Defining job flows in Hadoop environment - using tools like Apache Oozie.
• Expert knowledge over J2EE Design Patterns like MVC Architecture
• Experienced in J2EE, Spring, Hibernate, SOAP/Rest web services, EJB.
• Expertise with Application servers and web servers like Oracle, IBM WebSphere, Apache Tomcat and VMware.
• Experienced in developing the unit test cases using MRUnit, JUnit.
• Investigated on new technologies in Hadoop centric like Spark, Kafka to catch up with industry developments.
• Exposure to traditional and non-traditional databases like RDBMS.
• Exceptional ability to quickly master new concepts and technologies.
• Excellent verbal and written communication skills combined with interpersonal and conflict resolution skills and possess strong analytical skills.
• Experience in Telecom data analytics working mostly Confidential Confidential &t

TECHNICAL SKILLS:

Hadoop/Big Data: MapReduce, HDFS, Hive, Pig, HBase, Sqoop, Spark, Spark SQL, Spark Streaming, Kafka, Flume, Zookeeper, Oozie.

Distributed plat forms: Hortonworks, Cloudera

Programming Languages: Java, Scala, Python, R.

Java/J2EE Technologies: Servlets, JSP, JSF, JDBC, Java Beans, RMI & Web services (SOAP, RESTful).

Frameworks: Struts, Hibernate and Spring MVC.

Development Tools: Eclipse, Net Beans, Maven, Jenkins, SOAP UI, QC, Selenium WebDriver, Jira, SQL Developer, Talend, Informatica.

Methodologies: Agile/Scrum, UML, and Waterfall

NoSQL Technologies: HBase, Cassandra, MongoDBDatabases

MySQL, MS: SQL Server, SQL Server, PostgreSQL.

Web/ Application Servers: Apache Tomcat, WebLogic, WebSphere.

Visualization: Tableau

Web Technologies: HTML, CSS, XML, JavaScript, jQuery, AngularJS, AJAX, SOAP, and REST.

Scripting Languages: Unix Shell Scripting, Perl.

Operating Systems: UNIX, LINUX, Windows

PROFESSIONAL EXPERIENCE:

Confidential

Sr. Hadoop Developer

Responsibilities:

• Been a part of requirement analysis, identifying required Hadoop Centerictechnologies.
• Ingested data using Sqoop from different sources and stored into Data Lake.
• Cleanse data from Data Lake using HQL scripts.
• Written Hive ETL scripts, to persist data into external tables.
• Wrote MapReduce job using Java API for data Analysis and data cleanse.
• Developed Scripts and Batch Job to schedule various Hadoop Program.
• Performed data analysis in Hive by creating tables, loading it with data and writing hive queries which will run internally in a MapReduce way.
• Writing Hive queries for joining multiple tables based on business requirement.
• Implemented Hive Generic UDF's to in corporate business logic into Hive Queries.
• Used TEZ engine for interactive HIVE queries.
• Used Google places Web API’s for getting the details of each store by brand.
• Used zookpeer, for handling the operation on HBase tables.
• Aggregated process handled using HBase.
• Implemented Hbase API to store the data into Hbase table from hive tables.
• Developed Oozie workflow scripts.
• Generated reports, for analyzed data from the HBASE tables.
• Connected Tableau for visualization
• Involved in Agile methodologies, daily scrum meetings, sprint planning.

Environment: Hive, Pig, Sqoop, Hbase, Map Reduce, Java, Python, shell scripts, Maven, HDP 2.3, Ambari, Oozie, Zookeeper, WEB API’s, Tableau

Confidential

Hadoop Developer

Responsibilities:

• Participated in Full software cycle development and delivery of the Project
• Involved in Data Sourcing, Data Preparation, Data Ingestion, Data Staging, Data manipulation and Processing, Staging Analytical data in Postgresql, BI and Data Visualization.
• Understanding the given Wireframes, gathering the required data to build the frames.
• Worked on Data Sourcing, getting the CDR, telemetry, web data and demographics data from third party.
• Sourced data from Web Scraping about the games and events for particular time period.
• Parsed XML, for the demographic data given by the third party into HIVE tables
• Ingested data from different sources to Hadoop cluster using Sqoop
• Wrote pig scripts, for formatting the data as per the business requirement.
• Worked on pig scripts for transformation of data and join multiple tables.
• Created UDF’s for handling the date formats conversations.
• Wrote Map Reduces programs for Data manipulations and processing.
• Performed data analysis in Hive by creating tables, loading it with data and writing hive queries which will run internally in a MapReduce way.
• Developed Map Reduce program for data processing.
• Implemented Hive Generic UDF's to in corporate business logic into Hive Queries.
• Developed Scripts and Batch Job to schedule using Oozie workflow
• Staged Analytical data in Postgresql, BI and Data Visualization.
• Worked on Data visualization using Tableau.
• Involved in Agile methodologies, daily scrum meetings, spring planning.

Environment: Hive, Pig, Sqoop, Hbase, Map Reduce, Java, Python, shell scripts, Maven, HDP 2.3, Ambari, Oozie, Zookeeper, WEB API’s, Tableau, XML

Confidential

Hadoop Developer

Responsibilities:

• Involved in designing and building the Hadoop cluster.
• Ingested data using Sqoop, from different sources.
• Worked on creating hive tables for structured data and storing effectively by partitions.
• Worked on pig scripts, by creating UDF for handling the unstructured data.
• Worked on connecting the existing Java application with HIVE using thrift server.
• Been a part of Hadoop cluster monitoring team.
• Build UDFs for HIVE and PIG using Java.

Environment: Hive, Pig, Sqoop, Hbase, Map Reduce, Java, Python, shell scripts, Maven, HDP, Ambari, Oozie, Zookeeper

Java Developer

Responsibilities:

• Involved in various SDLC phases like Design, Development and Testing.
• Involved in developing JSP pages using Spring, JQuery Framework.
• Developed web pages using HTML, JavaScript, JQuery and CSS.
• Used various Core Java concepts such as Exception Handling, Collection APIs to implement various features and enhancements.
• Involved in coding, maintaining, and administering Servlets and JSP components to be deployed on a Tomcat application server.
• Used automated test scripts and tools to test the application in various phases. Coordinated with Quality Control teams to fix issues that were identified
• Worked with Complex SQL queries, Functions and Stored Procedures.
• Involved in developing spring web MVC framework for portals application.
• Implemented the logging mechanism using log4j framework.
• Developed REST API, Web Services.
• Performed Unit testing using Junit.

Environment: JDK, Spring Framework, XML, HTML, JSP, Hibernate,Maveen, Java Script, Jquery, Web Services, Junit, Log4j, Shell scripting, UNIX

Confidential

Java Developer

Responsibilities:

• Participated in requirement gathering and converting the requirements into technical specifications.
• Developed UI using HTML, JavaScript, and JSP, and developed Business Logic and Interfacing components using Business Objects, XML, and JDBC .
• Involved in setting up QA environment using Junit unit testing framework.
• Provided Technical support for production environments resolving the issues, analysing the defects, providing and implementing the solution defects.

Environment: Java, Spring, JSP, Hibernate, XML, HTML, JavaScript, JDBC, CSS, SOAP Web services.

Confidential

Jr.Java Developer

Responsibilities:

• Developed front-end screens using JSP, HTML and CSS.
• Developed server side code using Struts and Servlets framework.
• Developed core java classes for exceptions, utility classes, business delegate, and test cases.
• Developed SQL queries using MySQL and established connectivity.
• Worked with Eclipse using Maven plugin for Eclipse IDE.
• Designed the user interface of the application using HTML, CSS3, Java Server Faces 2.0 (JSF 2.0), JSP and JavaScript.
• Tested the application functionality with JUnit Test Cases.
• Developed all the User Interfaces using JSP and Struts framework.
• Writing Client Side validations using JavaScript.
• Extensively used JQuery for developing interactive web pages.
• Developed the DAO layer using hibernate and for real time performance used the caching system for hibernate.
• Experience in developing web services for production systems using SOAP.
• Developed the user interface presentation screens using HTML, XML, and CSS.
• Developed the Shell scripts to trigger the Java Batch job, Sending summary email for the batch job status and processing summary.
• Co-ordinate with the QA lead for development of test plan, test cases, test code and actual testing responsible for defects allocation and those defects are resolved.
• The application was developed in Eclipse IDE and was deployed on Tomcat server.
• Involved in scrum methodology.
• Supported for bug fixes and functionality change.

Environment: Java, JSP, JQuery, HTML, Maveen, MYSQL, Eclipse, Tomcat server.