SUMMARY

• Over 7 years of IT experience which includes close to 4 years of work experience in Big Data, Hadoop ecosystem related technologies.
• Excellent understanding/knowledge of Hadoop Ecosystem including HDFS, MapReduce, Hive, Pig, HBase, Oozie, ZooKeeper, Flume and Sqoop based Big Data Platforms
• Expertise in design and implementation of Big Data solutionsin Banking, Retail and E - commerce domains
• Expereienced with NoSQL databases like HBase.
• Comprehensive experience in building Web-based applications using J2EE Frame works like Spring, Hibernate, EJB, Struts and JMS
• Excellent ability to use analytical tools to mine data and evaluate teh underlying patterns
• Assisted in Cluster maintenance, Cluster Monitoring and Troubleshooting, Managing and Reviewing data backups and log files
• Good working Experience in client-side development with HTML, XHTML, CSS, JavaScript, JQuery, JSON and AJAX
• Good understanding of application servers WebLogic, WebSphere and XML methodologies (XML, XSL, XSD) including Web Services like SOAP and REST.MapReduce
• Hands on experience in developing MapReduce programs using Apache Hadoop for analyzing teh Big Data
• Expertise in optimizing traffic across network using Combiners, joining multiple schema datasets using Joins and organizing data using Partitioners and Buckets
• Experience in writing Custom Counters for analysing teh data and testing using MRUnit framework
• Experienced in writing complex MapReduce programs dat work with different file formats like Text, Sequence, Xml and Avro
• Expertise in composing MapReduce Pipelines with many user-defined functions using Apache CrunchPIG
• Expertise in writing ad-hoc MapReduce programs using Pig Scripts
• Used Pig as ETL tool to do transformations, event joins, filter and some pre-aggregations
• Implemented business logic by writing Pig Latin UDFs in Java and used various UDFs from Piggybanks and other sources.HIVE
• Expertise in Hive Query Language(HiveQL), Hive Security and debugging Hive issues
• Responsible for performing extensive data validation using HIVE Dynamic Partitioning and Bucketing
• Experience in developing custom UDFs for Pig and Hive to incorporate methods and functionality of Python/Java into Pig Latin and HQL (Hive QL)
• Worked on different set of tables like External Tables and Managed Tables
• Experiences with working different Hive SerDe's dat handle file formats like avro, xml
• Analyzed teh data by performing Hive queries and used HIVE UDFs for complex querying.NoSQL
• Expert database engineer, NoSQL and relational data modeling
• Expertise in HBase Cluster Setup, Configurations, HBase Implementation and HBase Client API
• Worked on importing data into HBase using HBase Shell and HBase Client API
• Expertise in performing large-scale web crawling with Apache Nutch using a Hadoop/HBase clusterJava/J2EE
• Expertise in several J2EE technologies like JDBC, Servlets, JSP,Struts, Spring, Hibernate, JPA, JSF, EJB, JMS, JAX-WS, SOAP, JQuery, AJAX, XML, JSON, HTML5/HTML, XHTML, Maven, and Ant
• Expert knowledge over J2EE Design Patterns like MVC Architecture, Front Controller, Session Facade, Business Delegate and Data Access Object for building J2EE Applications
• Thorough knowledge on JAX-WS to access teh external Web Services, get teh xml response and convert it back to java objects
• Experience in using Jenkins for Continuous Integration and Sonar jobs for java code quality
• Extensive experience in developing Internet and Intranet related applications using J2EE, Servlets, JSP, Jboss, WebLogic, Tomcat, and Struts Frame Work.SQL, Script & Oracle Database
• Extensive experience with database DB2, Oracle9i/10g/11g (Database Design, and SQL Queries)
• Good experience in SQL, PL/SQL, Perl Scripting, Shell Scripting, Partitioning, Data modeling, OLAP, Logical and Physical Database Design, Backup and Recovery procedures.
• Experienced with build tool Maven, Ant and continuous integrations like Jenkins
• Experience in Administering, Installation, Configuration, Troubleshooting, Security, Backup, Performance Monitoring and Fine-tuning of Linux Red Hat
• Developed Unit test cases using JUnit, Easy Mock and MRUnit testing frameworks
• Experienced in Agile SCRUM, RUP (Rational Unified Process) and TDD (Test Driven Development) software development methodologies

TECHNICAL SKILLS

Hadoop/Big Data/NoSql Technologies: HDFS, MapReduce, Hive, Pig, Sqoop, Flume, Oozie, Avro, Hadoop Streaming, YARN, Crunch, Zookeeper, HBase

Programming Languages: Java, Python, C, SQL, PL/SQL, Shell Script

IDE Tools: Eclipse, Rational Team Concert, NetBeans

Framework: Hibernate, Spring, Struts, JMS, EJB, JUnit, MRUnit, JAXB

Web Technologies: HTML5, CSS3, JavaScript, JQuery, AJAX, Servlets, JSP,JSON, XML, XHTML, Rest Web Services

Application Servers: Jboss, Tomcat, Web Logic, Web Sphere

Databases: Oracle 11g/10g/9i, MySQL, DB2, Derby, MS-SQL Server

Operating Systems: LINUX,UNIX, Windows

Build Tools: Jenkins, Maven, ANT

Reporting/BI Tools: Jasper Reports, iReport, Tableau

PROFESSIONAL EXPERIENCE

Confidential, Manhattan, NY

Sr Hadoop Developer

Responsibilities:

• Developed simple and complex MapReduce programs in Java for Data Analysis on different data formats
• Developed MapReduce programs dat filter bad and un-necessary claim records and find out unique records based on account type
• Processed semi, unstructured data using Map Reduce programs
• Implemented Daily Cron jobs dat automate parallel tasks of loading teh data into HDFS and pre-processing with Pig using Oozie co-ordinator jobs
• Implemented custom DataTypes, InputFormat, RecordReader, OutputFormat, RecordWriter for MapReduce computations
• Worked on CDH4 cluster on CentOS.
• Successfully migrated Legacy application to Big Data application using Hive/Pig/HBase in Production level
• Transformed date related data into application compatible format by developing apache Pig UDFs
• DevelopedMapReducepipeline for feature extractionand tested teh modules using MRUnit
• Optimized MapReduce jobs to use HDFS efficiently by using various compression mechanisms
• Creating Hive tables, loading with data and writing Hive queries which will run internally in MapReduceway
• Responsible for performing extensive data validation using Hive
• Implemented Partitioning, Dynamic Partitions and Bucketing in Hive for efficient data access
• Worked on different set of tables like External Tables and Managed Tables
• Used Oozie workflow engine to run multiple Hive and Pig jobs
• Involved in installing and configuring Hive, Pig, Sqoop, Flume and Oozie on teh Hadoop cluster.
• Involved in designing and developing non-trivial ETL processes within Hadoop using tools likePig, Sqoop, Flume, and Oozie
• Used DML statements to perform different operations on Hive Tables
• Developed Hive queries for creating foundation tables from stage data
• Used Pig as ETL tool to do transformations, event joins, filter and some pre-aggregations
• Analyzed teh data by performing Hive queries and running Pig scripts to study customer behavior

Environment: Apache Hadoop, HDFS, MapReduce, Apache Crunch, Java (jdk1.6), MySQL, DB Visualizer, Linux, Sqoop, Apache Hive, Apache Pig

Confidential, Memphis,TN

Hadoop Developer

Responsibilities:

• Installed, configured, and maintained Apache Hadoop clusters for application development and major components of Hadoop Ecosystem: Hive, Pig, HBase, Sqoop, Flume, Oozie and Zookeeper
• Implemented six nodes CDH4 Hadoop Cluster on CentOS
• Importing and exporting data into HDFS and Hive from different RDBMS using Sqoop
• Experienced in defining job flows to run multiple MapReduce and Pig jobs using Oozie
• Importing log files using Flume into HDFS and load into Hive tables to query data
• Used HBase-Hive integration, written multiple Hive UDFs for complex queries
• Involved in writing APIs to ReadHBasetables, cleanse data and write to anotherHBasetable
• Created multiple Hive tables, implemented Partitioning, Dynamic Partitioning and Buckets in Hive for efficient data access
• Responsible for architecting Hadoop clusters with CDH4 on CentOS, managing with Cloudera Manager
• Written multiple MapReduce programs in Java for data extraction, transformation and aggregation from multiple file formats including XML, JSON, CSV and other compressed file formats
• Experience working with Apache SOLR for indexing and querying
• Knowledge on Zookeeper internals
• Experienced in running batch processes using Pig Scripts and developed Pig UDFs for data manipulation according to Business Requirements
• Experienced in writing programs using HBase Client API
• Involved in loading data into HBase using HBase Shell, HBase Client API, Pig and Sqoop
• Experienced in design, development, tuning and maintenance of NoSQL database
• Written MapReduce program in Python with teh Hadoop streaming API
• Developed unit test cases for Hadoop MapReduce jobs with MRUnit
• Excellent experience in ETL analysis, designing, developing, testing and implementing ETL processes including performance tuning and query optimizing of database
• Experience in using Pentaho Data Integration tool for data integration, OLAP analysis and ETL process
• Experience integrating R with Hadoop with RHadoop for statistical analysis and predictive modelling

Environment: Apache Hadoop1.0, Hive, Pig, HBase, Sqoop, Flume, Java, Linux, MySQL Server5.155, MS SQL Server 2012, SQL, PL/SQL, SQL Server Data Tools, SQL Server Business Intelligence Development Studio (SSAS, SSIS, SSRS)

Confidential, Woodcliff Lake, NJ

Hadoop Developer

Responsibilities:

• dis is an initiative from Citibank to move its disconnected legacy billing & monitoring systems to a consolidated platform
• Consolidating customer data from Lending, Insurance, Trading and Billing systems into warehouse and mart subsequently for business intelligence reporting
• Providing improved revenue capture through leakage elimination, Assessing risk score more accurately in its customer portfolios, having better exposure and to offer each customer better products and advice
• Experience working with JIRA for project management, GIT for source code management, JENKINS for continuous integration and Crucible for code reviews
• Transferring and exporting data into HDFS and Hive, MySQL and DB2 using Sqoop
• Implementing MapReduce programs to analyze large datasets in warehouse for business intelligence purpose
• Used default MapReduce Input and Output Formats
• Developed HQL queries to implement teh select, insert, update and operations to teh database by creating HQL named queries
• Based on user usage identifying teh customer potentiality using MapReduce Programs.
• Using Oozie in your environment to schedule Hadoop jobs and would like to call Sqoop from within your existing workflows
• Automatically Importing data regular basis using sqoop to into teh Hive partition by using apache Oozie
• Clustering customers category based on dat providing offers using Apache Hive
• Experienced in managing and reviewing Hadoop log files Load and transform large sets of data
• Grouping, Aggregation and Sorting are done by using Pig and Hive which are higher-level abstractions of MapReduce
• Conducted data extraction dat may include analyzing, reviewing, modeling based on requirements using higher Level Tools such as Hive and Pig
• Supported MapReduce Programs those are running on teh cluster
• Involved in creating Hive tables, loading with data and writing Hive queries
• Created data-models for customer data using theCassandraQuery Language
• Ran many performance tests using theCassandra-stress tool in order to measure and improve teh read and write performance of teh cluster
• Queried and analyzed data from DatastaxCassandrafor quick searching, sorting and grouping

Environment: Apache Hadoop (Cloudera), Java (jdk1.6), Teradata, Redhat Linux, Sqoop, Hive, DB visualizer, Oozie.

Confidential, San Antonio, TX

J2EE Software Developer

Responsibilities:

• Application was developed using teh Struts MVC architecture
• Developed action and form classes based on Struts framework to handle teh pages
• Developed a web-based reporting for credit monitoring system with HTML5, XHTML, JSTL, custom tags and Tiles using Struts framework
• Developed Servlets and JSPs based on MVC pattern using Struts framework and Spring Framework
• Developed web-based customer management software using Facelets, Icefaces and JSF
• Implemented Ajax Frame works, jQuery tools examples like Auto Completer, Tab Module, and Calendar and Floating windows
• Configured Struts-Config file for form-beans, global forwards, error forwards and action forwards
• Designed and implemented Report Module (using Jasper Report framework)
• Developed Message-Driven beans in collaboration with Java Messaging Service (JMS)
• Developing Web Services using Apache Axis 2 to retrieve data from legacy systems
• Developed Servlets, Action classes, Action Form classes and configured teh struts-config.xml file
• Used XML parser APIs such as JAXP and JAXB in teh web service's request response data marshalling as well as unmarshalling process
• Developed UI components for email and link sharing of documents and files for a Content Management System using BackBone.js and JQuery
• Planned and implemented various SQL, Stored Procedure, and triggers

Environment: J2EE, Java 1.4.2, Servlets, JSP, JDBC, EJB 3, JMS, JQuery, backbone.js, HTML5, JSTL, Icefaces, XML, Spring, Struts, Hibernate, Web Services, Apache Tomcat Server, JSF, EXT JS, JAXB, Jasper Report, JUnit, SOAP, SOAPUI, XML, JavaScript, UML, Apache Axis 2, ANT, SVN, MySQL.

Confidential

Java Developer

Responsibilities:

• Worked on Requirement analysis, gatheird all possible business requirements from end users and business Analysts
• Involved in creation of UML diagrams like Class, Activity, and Sequence Diagrams using modelling tools of IBM Rational Rose
• Worked with coreJavacode extensively using interfaces and multi-threading techniques
• Involved in production support and documenting teh application to provide training and knowledge transfer to teh user
• Used Log4j for logging mechanism and developed wrapper classes to configure teh logs
• Used JUnit and Test cases for testing teh application modules
• Developed and configured theJavabeans using SpringMVC framework
• Developed teh application using Rational Team Concert and worked under Agile Environment
• Developed SQL stored procedures and prepared statements for updating and accessing data from database
• Also used C++ to create some libraries used in teh application

Environment: C++,Java, JDBC, Servlets, JSP, Struts, Eclipse, Oracle 9i, Apache Tomcat, CVS, JavaScript, Log4J.