SUMMARY:

• 7 Years of extensive experience including Four and a half years of BigData and BigData analytics
• Strong Knowledge of Hadoop and Hive and Hive's analytical functions.
• Hands on experience in installing, configuring and using ecosystem components like Hadoop MapReduce, HDFS, Hbase, Zoo Keeper, Oozie, Hive, Sqoop,Pig, Flume
• Hands on Experience in working with ecosystems like Hive, Pig, Sqoop, Map Reduce.
• Efficient in building hive, pig and Map Reduce scripts.
• Experience in writing Map Reduce programs using Java to perform Data processing and analysis.
• Experience in understanding Big Data business requirements and providing them Hadoop based solutions.
• Experience in Importing and exporting data from different databases like MySQL, Oracle, Netezza, Teradata, DB2 into HDFS using Sqoop.
• Experience in supporting analysts by administering and configuring HIVE.
• Experience in providing support to data analyst in running Pig and Hive queries.
• Developed Map Reduce programs to perform analysis.
• Implemented Proofs of Concept on Hadoop stack and different big data analytic tools, migration from different databases (i.e., Teradata, Oracle, MySQL) to Hadoop.
• Successfully loaded files to Hive and HDFS from HBase
• Loaded the dataset into Hive for ETL Operation.
• Good knowledge on Hadoop Cluster architecture and monitoring the cluster.
• In - depth understanding of Data Structure and Algorithms.
• Experience in implementation of Open-Source frameworks like Struts, Spring, Hibernate, Web Services etc.
• Experience in deploying applications in heterogeneous Application Servers TOMCAT, WebLogic and Oracle Application Server.
• Strong Communication skills of written, oral, interpersonal and presentation
• First point of contact for any R&D activities and critical problems.
• Implemented Unit Testing using JUNIT testing during the projects.
• Ability to perform at a high level, meet deadlines, adaptable to ever changing priorities.
• Excellent communication skills, interpersonal skills, problem solving skills a very good team player along with a can do attitude and ability to effectively communicate with all levels of the organization such as technical, management and customers.

TECHNICAL SKILLS:

Big Data: Hadoop, MapReduce, HDFS, HBase, Zookeeper, Hive, Pig, Sqoop, Oozie, Flume

Java Technologies: Java 6, JFC Swing, Log4j, Java Help API

J2EE Technologies: JSP 2.1 Servlets 2.3, JDBC 2.0,JNDI, XML, JAXP, Java Beans

Methodologies: Agile, UML, Design Patterns

Framework: Struts, Hibernate

Database: Oracle 10g, DB2,MySQL

Application Server: Apache Tomcat 5.x 6.0, Jboss 4.0

Web Tools: HTML, Java Script, XML, DTD, Schemas, XSL, XSLT, XPath, DOM, XQuery

Tools: SQL developer, DB visualize

IDE / Testing Tools: NetBeans, Eclipse

Operating System: Windows. Linux

Scripts: Bash, Python, ANT

Testing API: JUNIT

PROFESSIONAL EXPERIENCE:

Confidential, CA

Hadoop Consultant

Responsibilities:

• All the fact and dimension tables were imported from sql server into Hadoop using Sqoop.
• Used Sqoop to import the history data from Teradata and loaded into hive tables which are partitioned on yearly-month basis (YYYYMM) in Avro file format. Data was loaded into HDFS from the year 2000.
• Developed Hive queries for building merged/flattened view of the history data.
• Developed Pig scripts for replacing the existing legacy process to the Hadoop and the data is back fed to legacy mainframes systems using NDM process.
• Developed Java map-reduce programs for to encapsulate transformations.
• Developed Java utility class for converting fixed length data to delimited data, for converting the flattened data to the fixed length before sending it to the mainframes retail legacy process.
• Developed Oozie workflows and sub workflows to orchestrate the Sqoop scripts, pig scripts, hive queries and the Oozie workflows are scheduled through Autosys.
• Worked with DevOps team in Hadoop cluster planning and installation.
• Worked on Hadoop cluster maintenance including data and metadata backups, file system checks, commissioning and decommissioning nodes and upgrades.

Environment: Hadoop, HDFS, Map Reduce, Sqoop, Hive, Pig, Oozie, NDM, Cassandra, SVN, CDH4, Cloudera Manager, MySQL, Eclipse

Confidential, Cupertino - CA

Hadoop Developer

Responsibilities:

• Worked on the Hadoop File System Java API to develop or Compute the Disk Usage Statistics.
• Experience in Developing the Hive queries for the transformations, aggregations and Mappings on the Maps Data.
• Developed map reduce programs for applying business rules on the data
• Developed and executed Hive Queries for denormalizing the data.
• Automated workflow using Shell Scripts.
• Performance Tuning on Hive Queries.
• Involved in migration of data from Hadoop Cluster to the Hadoop Cluster.
• Worked on configuring multiple Map Reduce Pipelines, for the new Hadoop Cluster.
• Worked on Configuring the New Hadoop Cluster.

Environment: CDH 3.x and 4.x, Java, CDH, Hadoop, HDFS, Map Reduce, Hive and Sqoop

Confidential, Durham, NC

Hadoop Developer / Independent Contractor

Responsibilities:

• Analysis on the existing transformations that happens before loading into database.
• Implemented Session Flagging logic using Hive Queries and Hive UDF
• Used Sqoop to send the feeds to the partnering teams for analysis.
• Prepared the final table in the WDCC project, which will be used by data scientists for analysis
• Participated in discussion with Clients and other Big Data Consultants on the design implementation
• Helped peers and offshore team during the analysis and development
• Prepared documentation on the logic involved in transformation like fixing the url,SessionFlagging process in proper format
• Delivered modules on time.
• Prepared Java, Hive UDF Coding Standards for the team to follow.
• Took the responsibility of Integration testing.
• Created job flow for the modules to run through Ctrl-M
• Prepared op-docs for the module
• Took the responsibility of creating and set up of jobs in Ctrl-M
• Successfully ran the WDCC cycle in production.

Environment: Cloudera 3.x, Ctrl-m 8.0, Clear Case, Toad, Pig 0.10.0, hive 0.10.0, Sqoop 1.x

Confidential

Java Developer

Responsibilities:

• Generated the classes and interfaces from the designed UML sequence diagrams and coded as per those plans along with the team.
• Developed user interfaces for policy owner module using JSPs, Struts Tag Library, and Tiles framework.
• Developed necessary DAOs (Data Access Objects) for policy owner module.
• Application was built on MVC architecture with JSP, CSS, HTML and DHTML acting as presentation layer, Struts framework as business layer.
• Performed client side and server side validations using Struts validations. Created Action Form beans and performed validation by configuring the Struts Validator.
• Used Dispatch Action to group related actions into a single class.
• Developed Business tier and Presentation tier using Struts, JSP. Coding using JSP, HTML, and CSS JavaScript for validation, Servlets using STRUTS framework, JDBC.
• Wrote JDBC class to interact with Database.
• Created database tables for the application on a DB2 database.
• Created data model, SQL scripts for the application.
• Build the applications using ANT tool. Also used Eclipse as the IDE.
• Actively involved in testing, debugging and deployment of the application on Weblogic Application server. Developed test cases and performed unit testing using JUnit.
• Participated in design session and design reviews.

Environment: Java1.5, JDBC, JUnit, Struts 1.1, Tiles, HTML, CSS, JSP, JavaScript, DAO, Eclipse, Web logic, UML.