SUMMARY

• 7 years of professional experience in IT and Enterprise Application Development in multiple business domains ranging from Finance, Health Care and Insurance, which includes hands on experience in Big Data/Hadoop ecosystem and related technologies.
• Around 4 years of experience exclusively on BIG DATA ECOSYSTEM using HADOOP framework and related technologies such as HDFS, YARN, HBASE, MapReduce, HIVE, PIG, FLUME, OOZIE, SQOOP, and ZOOKEEPER.
• Good Understanding of the Hadoop Distributed File System and Eco System (MapReduce, Pig, Hive, Sqoop, Oozie, Spark and HBase).
• Experience in using Cloudera Manager for installation and management of single - node and multi-node Hadoop cluster (CDH3&CDH4).
• Hands-on experience to setup node clusters.
• Experience in setting up and managing Kafka Cluster.
• Expertise in writing Map Reduce jobs using Java native code, Pig, Hive for data Processing.
• Worked on Importing and Exporting data into HDFS and Hive using Sqoop.
• Wrote Hive queries for data analysis to meet the requirements.
• Created Hive tables to store data into HDFS and processed data using HiveQL.
• Experience in developing e-commerce applications, highly distributed applications using Java, J2EE, Servlets, JSP, Struts, Spring, JDBC, Apache Tomcat Server, JavaScript, HTML, XML, XSL, SQL, Oracle 11g, 9i/8i/7.x under Unix and Windows NT/XP. Distributed Object Oriented Component analysis and Design according to industry leading J2EE platforms.
• Highly experienced in Server side development using Java/J2EE Technologies and ORM tools such as Hibernate 3.0, Spring 2.5, Struts 1.x/Tiles Frameworks.
• Highly Working experience with multiple Web/Application Servers like WebSphere 6.0/5.1, Weblogic 10g/8.1/6.1, Oracle App Server 10, Tomcat 4.X.
• Experience of writing client side web technologies including using XML 1.0, XSL, HTML, DHTML, CSS and JavaScript, JQuery. Experienced in parsing (DOM and SAX) XML using JAXB 2.0 API
• Highly proficient in developing SQL, PL/SQLs. Experienced with RDBMS implementation and development using Oracle 8/8i/9i, MySQL, SQL Server 2000 and DB2.
• Expertise in PL/SQL programming in Oracle.
• Design and deployment in Web Technologies with JSP, HTML, XML, JavaScript, AJAX, Active Widgets.
• An excellent team player and self-starter with good communication skills and proven abilities to finish tasks before target deadlines.
• Developed UI for web applications using HTML.
• Worked on front-end technologies like JSP, HTML, JavaScript and Ajax.
• Worked with major RDBMS such as Oracle and also have hands-on with MySQL.
• Experience in developing software build/deployment descriptors using Maven.
• Design and deployment in Web Technologies with JSP, HTML, XML, JavaScript, AJAX, Active Widgets.
• A well-organized, goal-oriented, highly motivated and TEMPeffective team player with excellent analytical, troubleshooting, and problem solving skills.
• Good problem solving, communication and documentation skills.
• Ability to learn quickly in work environment, excellent interpersonal and communication skills with ability to co-operate in group environments.
• Solid Understanding of OOPS and RDBMS concepts.
• An excellent team player and self-starter with good communication skills and proven abilities to finish tasks before target deadlines.

TECHNICAL SKILLS:

Big Data: Hadoop, YARN, Hive, Sqoop, Pig, Puppet, Ambari, HBase, MongoDB, Cassandra, spark, Flume, Parquet files

Operating Systems: Windows, Ubuntu, Red Hat Linux, Linux, UNIX

Project Management: Plan View, MS-Project

Programming or Scripting Languages: Java, SQL, Unix Shell Scripting, C, Scala, Python, C#, C++

Java Technologies: Core Java, JDBC, Hibernate, J2EE, JSP, Servlets, JavaBeans, Log4j

Modelling Tools: UML, Rational Rose

IDE/GUI: Eclipse, NetBeans, Intellij, RAD 6.0

Framework: Spring, Struts, Hibernate

Web Services: SOAP, Restful, LAX-WS, JAR-RS

Database: Oracle, MS SQL Server and MySQL, MSFT SQL, MSFT SSIS.

Testing: Quality Center, Win Runner, Load Runner, QTP

PROFESSIONAL EXPERIENCE:

Java/Hadoop Developer

Confidential, Dallas

Responsibilities:

• Developed data pipeline using Flume, Sqoop, Pig and Java map reduce to ingest customer behavioral data and financial histories into HDFS for analysis.
• Worked on importing and exporting data from Oracle and DB2 into HDFS and HIVE using Sqoop for analysis, visualization and to generate reports.
• Developed multiple MapReduce jobs in java for data cleaning.
• Developed Hive UDF to parse the staged raw data to get the Hit Times of the claims from a specific branch for a particular insurance type code.
• Schedule these jobs with workflow engine like Oozie. Actions can be performed both sequentially and parallely using Oozie.
• Built wrapper shell scripts to hold dis Oozie workflow.
• Involved in collecting and aggregating large amounts of log data using Apache Flume and staging data in HDFS for further analysis.
• Involved in creating Hadoop streaming jobs using Python.
• Used Ganglia to Monitor and Nagios to send alerts about the cluster around the clock
• Provided ad-hoc queries and data metrics to the Business Users using Hive, Pig.
• Developed PIG Latin scripts to extract the data from the web server output files to load into HDFS.
• Used Pig as ETL tool to do transformations, event joins and some pre-aggregations before storing the data onto HDFS.
• Worked on MapReduceJoins in querying multiple semi-structured data as per analytic needs.
• Used Hive to analyze the partitioned and bucketed data and compute various metrics for reporting.
• Created many Java UDF and UDAFs in hive for functions that were not preexisting in Hive like the rank, Csum, etc.
• Used Hive and created Hive tables and involved in data loading and writing Hive UDFs.
• Developed POC for Apache Kafka.
• Worked on various performance optimizations like using distributed cache for small datasets, partition and bucketing in hive, doing map-side joins etc..
• Storing and loading the data from HDFS to Amazon S3 and backing up the Namespace data into NFS Filers.
• Worked on SPARK to retrieve data by using SCALA.
• Worked on executors on each assigned cluster nodes-work processes to run computations and store data using spark context
• Created concurrent access for hive tables with shared and exclusive locking that can be enabled in hive with the halp of Zookeeper implementation in the cluster.
• Wrote the shell scripts to monitor the health check of Hadoop daemon services and respond accordingly to any warning or failure conditions.
• Familiarity with NoSQL databases including HBase, MongoDB.
• Wrote shell scripts for rolling day-to-day processes and it is automated.
• Involved in story-driven agile development methodology and actively participated in daily scrum meetings.

Environment:Hadoop, MapReduce, Hive, HDFS, PIG, Sqoop, Oozie, Cloudera, Flume, HBase, ZooKeeper, spark, Parquet Files, CDH3, MongoDB, Cassandra, Oracle, Rally, MSFT SSIS and Unix/Linux, Kafka, Amazon web services.

Java/Hadoop Developer

Confidential, CA

Responsibilities:

• Used JSP, Servlets and JDBC to develop web components.
• Developed templates and screens in HTML and JavaScript.
• Worked with EJBs to code reusable components and business logic.
• Handled data coming from different sources.
• Installed and configured HDFS and developed multiple Map Reduce jobs in java for data cleaning and pre-processing.
• Implemented Map Reduce to perform analytics on Cassandra data.
• Implemented thrift API for Real time analytics on Cassandra data.
• Implemented Hibernate with Spring framework for data persistence.
• Worked in loading data from UNIX file system to HDFS.
• Loaded and transformed large datasets into HDFS using Hadoop fs commands.
• Participated in setting up updating configurations for implementing scripts with Pig and Sqoop.
• Migrated existing SQL queries to HiveQL queries to move to big data analytical platform.
• Used test cases in Junit for unit testing.
• Worked on capacity planning, node recovery and slots configuration.

Environment: JDK, J2EE, UML, Servlet, JSP, JDBC, Struts, XHTML, JavaScript, MVC, XML, XML, Schema, Tomcat, Eclipse, CDH, Hadoop, HDFS, Cassandra, HiveQL, Sqoop, Pig, MYSQL and MapReduce

Hadoop Developer

Confidential, Charlotte, NC

Responsibilities:

• Experience in Importing and exporting data into HDFS and Hive using Sqoop.
• Developed Pig program for loading and filtering the streaming data into HDFS using Flume.
• Experienced in handling data from different data sets, join them and preprocess using Pig join operations.
• Moving Bulk amount data into HBase using Map Reduce Integration.
• Developed Map-Reduce programs to clean and aggregate the data
• Developed HBase data model on top of HDFS data to perform real time analytics using Java API.
• Developed different kind of custom filters and handled pre-defined filters on HBase data using API.
• Strong understanding of Hadoop eco system such as HDFS, MapReduce, HBase, Zookeeper, Pig, Hadoop streaming, Sqoop, Oozie and Hive
• Implement counters on HBase data to count total records on different tables.
• Experienced in handling Avro data files by passing schema into HDFS using Avro tools and Map Reduce.
• Experienced import/export data into HDFS/Hive from relational database and Teradata using Sqoop.
• Handling continuous streaming data comes from different sources using flume and set destination as HDFS.

Environment: Hadoop Framework, HDFS, Map Reduce, Hive, Pig, Hbase, Sqoop, RDBMS/DB, MySQL.

Java Developer

Confidential

Responsibilities:

• Involved in writing Spring Configuration XML file that contains declarations and other dependent objects declaration.
• Developed user interface using BOOTSTRAP UI, third party libraries AT task and Angular JS to simplify the complexities of the application.
• Inserted Dependency Injection between components using Spring (IoC) concept.
• Implemented Asynchronous messaging between System Integration components using JMS Spring JMS Template .
• Developed various Java beans for performance of business processes and TEMPeffectively involved in Impact analysis.
• Developed Web Service client interface with JAX -RPC from WSDL files for invoking the methods using SOAP.
• Developed SOAP web services for the Downstream Systems
• Extensively worked on SOA and web services to get the data from third party systems MDM and configured JMS queues on server.
• Back-end Java developer for Data Management Platform (DMP). Building RESTful APIs in front of different types of NoSQL storage engines allowing other groups to quickly meet their requirements.
• Integrated Hibernate ORM with Spring-Hibernate framework to facilitate DML and DQL queries and represent object-database mapping.
• Developed application service components and configured beans using Spring IoC, creation of Hibernate mapping files and generation of database schema.
• Worked on parsing the XML files using DOM/SAX parsers.
• Used Mongo DB to perform Delta
• Used Apache Maven as build tool.
• Worked with NoSQL database Mongo DB and worked with it to perform many different operations
• Involved in creating various Data Access Objects (DAO) for addition, modification and deletion of records using various specification files.
• Created tables, triggers, stored procedures, SQL queries, joins, integrity constrains and views for multiple databases, Oracle 10g using Toad tool.
• Involved in Unit Testing of various modules by generating the Test Cases.
• Developed Maven Profiles for the build process and deployed in the server.
• Developed logging aspects using Spring AOP.
• Involved in Bug fixing of various modules that were raised by the testing teams in the application during the Integration testing phase.
• Prepared technical reports & documentation manuals during the program development.
• Used Rational ClearCase for version control and ClearQuest for bug tracking.
• Performed deployment of applications on Unix box.

Environment: JDK, Bootstrap UI, Spring, Hibernate, XML, XML Schemas, XSLT, SOAP-UI, WSDL, JMS, Oracle 10g, SOAP, SIF, MDM, JBOSS Application Server, IBM Clear Quest.

Java Developer

Confidential

Responsibilities:

• Developed the web application from the scratch. EXTJS, JSON, AJAX, Struts, Java, JSP’s, Servlets, JPA.
• Integrated the client proprietary framework with the application
• Designing and implementing the MVC design pattern using Struts framework
• Developed the product UI using EXTJS, Javascript, HTML, JSP, CSS, AJAX, JSON, JPA
• Developed the product server side components in using Java, Struts, Client Proprietary framework, JDBC
• Extensively worked on Oracle PL/SQL, Stored Procedures, Functions and sub programs and have written complex SQL queries for performing transactions with the Oracle DB.
• Built programs to consume various SOAP based web-services. Java, WebLogic, JAX-WS, XML, JAXP, UDDI.
• Developed the Use Cases, Activity, Sequence and Class diagrams using Rational Rose Enterprise.
• Developed automated Build files using ANT.

Environment: Java, JSP/Servlets, HTML, EXTJS, CSS, AJAX, JSON, Javascript, XML, Web Services, SOAP, WSDL, UDDI, Oracle, PL/SQL, Struts, Weblogic 8.1/10, Rational Clear case, Oracle Work show IDE, MS Visio, JPA, ANT, JProfile.