SUMMARY

• Over 7 years of experience in software architecture, design, development, testing and maintenance of web and enterprise applications using Hadoop, Java, J2EE technologies.
• Extensive experience as a Hadoop Developer and four years of java application development.
• Experience in installation, configuration, supporting and managing Hadoop clusters.
• Implemented in setting up standards and processes for Hadoop based application design and implementation.
• Responsible for writing Map Reduce programs.
• Logical Implementation and interaction with HBase.
• Developed Map Reduce jobs to automate transfer of data from HBase.
• Perform data analysis using Hive and Pig.
• Load log data into HDFS using Flume.
• Gained good knowledge on creating strategies on risky transactions.
• Successfully loaded files to Hive and HDFS from MongoDB.
• Assist with the addition of Hadoop processing to the IT infrastructure.
• Worked in Multiple Environment in installation and configuration.
• Document and explain implemented processes and configurations in upgrades.
• Support development, testing, and operations teams during new system deployments.
• Evaluate and propose new tools and technologies to meet the needs of the organization.
• Experience in using Sqoop, ZooKeeper and Cloudera Manager.
• Good Knowledge on Hadoop Cluster architecture and monitoring the cluster.
• 24/7 operational support to production servers and related infrastructure clusters.
• Experience in Administering, Installation, configuration, troubleshooting, Security, Backup, Performance Monitoring and Fine - tuning of Linux Redhat.
• Implemented stand-alone installation, file system management, backups, process control, user administration and device management in a networked environment.
• Worked on debugging tools such as Dtrace, Struss and Top. Expert in setting up SSH, SCP, SFTP connectivity between UNIX hosts.
• An excellent team player and self-starter with good communication skills and proven abilities to finish tasks before target deadlines.

TECHNICAL SKILLS

• Java
• J2EE
• C
• C++
• SQL
• PL/SQL
• HTML
• DHTML
• Java Script
• XML
• UML
• Cold Fusion.JSP
• Servlets
• Tag Libraries
• JSTL
• EJB
• JNDI
• JDBC
• JMS.Apache Struts
• Spring AOP
• Hibernate
• Junit
• Apache Axis
• JSF using ICEFacesIBM Web Sphere
• Apache Jakarta Tomcat
• BEA Weblogic
• JEE5 Web services.XML
• XHTML
• XSL
• XSLT
• CSS
• SOAP
• WSDL
• SAX and DOM parsers
• SOA.IBM Web Sphere Studio Application DeveloperWSAD 5.1.2
• RAD 6.1/7
• EclipseHBase
• Oracle
• DB2
• SQL server 2000
• MysqlHDFS
• MapReduce
• Hive
• Pig
• Sqoop
• Flume
• Oozie and ZooKeeperRational Clear Case
• Visual Source Safe
• CVSAjile and Test Driven Development
• SCRUM

PROFESSIONAL EXPERIENCE

Confidential, Chevy chase, Maryland

Hadoop Developer

Responsibilities:

• Worked on analyzing Hadoop cluster and different big data analytic tools including Pig, Hbase database and Sqoop.
• Responsible for building scalable distributed data solutions using Hadoop.
• Implemented nine nodes CDH3 Hadoop cluster on Red hat LINUX.
• Involved in loading data from LINUX file system to HDFS.
• Worked on installing cluster, commissioning & decommissioning of data node, name node recovery, capacity planning, and slots configuration.
• Created HBase tables to store variable data formats of PII data coming from different portfolios.
• Implemented a script to transmit sysprin information from Oracle to Hbase using Sqoop.
• Implemented best income logic using Pig scripts and UDFs.
• Implemented test scripts to support test driven development and continuous integration.
• Worked on tuning the performance Pig queries.
• Worked with application teams to install operating system, Hadoop updates, patches, version upgrades as required.
• Responsible to manage data coming from different sources.
• Involved in loading data from UNIX file system to HDFS.
• Load and transform large sets of structured, semi structured and unstructured data
• Cluster coordination services through Zookeeper.
• Experience in managing and reviewing Hadoop log files.
• Job management using Fair scheduler.
• Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
• Responsible for cluster maintenance, adding and removing cluster nodes, cluster monitoring and troubleshooting, manage and review data backups, manage and review Hadoop log files.
• Installed Oozie workflow engine to run multiple Hive and pig jobs.
• Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
• Supported in setting up QA environment and updating configurations for implementing scripts with Pig and Sqoop.

Environment: Hadoop, HDFS, Pig, Sqoop, HBase, Confidential Scripting, Ubuntu, Linux Red Hat.

Confidential, Bloomington, IL

Hadoop Developer

Responsibilities:

• Involved in creating data ingestion plans for loading data into HDFS and Hive.
• Responsible for building scalable distributed data solutions using Hadoop
• Installed and configured Hive, Pig, Sqoop, Flume and Oozie on the Hadoop cluster
• Setup and benchmarked Hadoop/HBase clusters for internal use
• Developed Simple to complex Map/reduce Jobs using Java.
• Performed data summarizations using Hive and Pig
• Optimized Map/Reduce Jobs to use HDFS efficiently by using various compression mechanisms
• Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and Extracted the data from MySQL, Oracle into HDFS using Sqoop
• Analyzed the data by performing Hive queries and running MR and Pig scripts to study customer behavior
• Used UDF's to implement business logic in Hive.
• Implemented business logic by writing UDFs in Java and used various UDFs from Piggybanks and other sources.
• Continuous monitoring and managing the Hadoop cluster using Cloudera Manager.
• Worked with application teams to install operating system, Hadoop updates, patches, version upgrades as required.
• Used Oozie workflow engine to run multiple Sqoop, MR, Hive and Pig jobs.
• Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team

Environment: Hadoop, MapReduce, HDFS, Hive, Pig, Java, SQL, Cloudera Manager, Sqoop, Flume, Oozie, Java (jdk 1.6), Eclipse

Confidential, Houston, TX

Hadoop Developer

Responsibilities:

• Involved in review of functional and non-functional requirements.
• Facilitated knowledge transfer sessions.
• Installed and configured Hadoop Mapreduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing.
• Importing and exporting data into HDFS and Hive using Sqoop.
• Experienced indefining jobflows.
• Experienced in managing andreviewingHadooplog files.
• Experienced in runningHadoopstreaming jobs to process terabytes of XML format data.
• Load and transform large sets of structured, semi structured and unstructured data.
• Responsible to manage data coming from different sources.
• Got good experience with NOSQL database.
• Supported Map Reduce Programs those are running on the cluster.
• Involved in loading data from UNIX file system to HDFS.
• Installed and configured Hive and also written Hive UDFs.
• Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
• Gained very good business knowledge on health insurance, claim processing, fraud suspect identification, appeals process etc.
• Developed a custom File System plug in for Hadoop so it can access files on Data Platform.
• This plugin allows Hadoop MapReduce programs, HBase, Pig and Hive to work unmodified and access files directly.
• Designed and implemented Mapreduce-based large-scale parallel relation-learning system
• Extracted feeds form social media sites such as Facebook, Twitter using Python scripts.
• Setup and benchmarked Hadoop/HBase clusters for internal use.
• Setup Hadoop cluster on Amazon EC2 using whirr for POC.
• Wrote recommendation engine using mahout.

Environment: Java 6, Eclipse, Oracle 10g, Sub Version, Hadoop, Hive, HBase, Linux,, MapReduce, HDFS, Hive, Java (JDK 1.6),HadoopDistribution of Horton Works, Cloudera, MapReduce, Data Stax, IBM Data Stage 8.1, Oracle 11g / 10g, PL/SQL, SQL*PLUS, Toad 9.6, Windows NT, UNIX Confidential Scripting.

Confidential, Moline, IL

Java/J2EE Developer

Responsibilities:

• Involved in Presentation Tier Development using JSF Framework and ICE Faces tag Libraries.
• Involved in business requirement gathering and technical specifications.
• Implemented J2EE standards, MVC2 architecture using JSF Framework.
• Implementing Servlets, JSP and Ajax to design the user interface.
• Extensive experience in building GUI (Graphical User Interface) using JSF and ICE Faces.
• Developed Rich Enterprise Applications using ICE Faces and Portlets technologies.
• Experience using ICE Faces Tag Libraries to develop user interface components.
• Used JSF, JSP, Java Script, HTML, and CSS for manipulating, validating, customizing, error messages to the User Interface.
• Used EJBs(Session beans) to implement the business logic, JMS for communication for sending updates to various other applications and MDB for routing priority requests.
• All the Business logic in all the modules is written in core Java.
• Wrote WebServices using SOAP for sending and getting data from the external interface.
• Developed a web-based reporting for monitoring system with HTML and Tiles using Struts framework.
• Middleware Services layer is implemented using EJB (Enterprise Java Bean - stateless) in WebSphere environment.
• Used Design patterns such as Business delegate, Service locator, Model View Controller, Session façade, DAO.
• Funds Transfers are sent to another application using JMS technology asynchronously.
• Involved in implementing the JMS (Java messaging service) for asynchronous communication.
• Involved in writing JMS Publishers to post messages.
• Involved in writing MDB(Message Driven Beans) as subscribers.
• Created Stored procedures using PL-SQL for data modification (Using DML insert, update, delete) in Oracle
• Interaction with Oracle database is implemented using Hibernate.

Environment: J2EE, EJB,, JSF, ICE Faces, EJB, WebServices, XML, XSD, Agile, Microsoft Visio, Clear Case, Oracle 9.i/10.g, Weblogic8.1/10.3,RAD, LOG4j,Servlets, JSP, Unix.

Confidential

Java Developer

Responsibilities:

• Involved in Requirement Analysis, Development and Documentation.
• Used MVC architecture (Jakarta Struts framework) for Web tier.
• Participation in developing form-beans and action mappings required for struts implementation and validation framework using struts.
• Development of front-end screens with JSP Using Eclipse.
• Involved in Development of Medical Records module. Responsible for development of the functionality using Struts and EJB components.
• Coding for DAO Objects using JDBC (using DAO pattern).
• XML and XSDs are used to define data formats.
• Implemented J2EE design patterns value object singleton, DAO for the presentation tier, business tier and Integration Tier layers of the project.
• Involved in Bug fixing and functionality enhancements.
• Designed and developed excellent Logging Mechanism for each order process using Log4J.
• Involved in writing Oracle SQL Queries.
• Involved in Check-in and Checkout process using CVS.
• Developed additional functionality in the software as per business requirements.
• Involved in requirement analysis and complete development of client side code.
• Followed Sun standard coding and documentation standards.
• Participation in project planning with business analysts and team members to analyze the Business requirements and translated business requirements into working software.
• Developed software application modules using disciplined software development process.

Environment: Java, J2EE, JSP, EJB, ANT, STRUTS1.2, Log4J, Weblogic 7.0, JDBC, My Eclipse, Windows XP, CVS, Oracle.

Confidential

Java Developer

Responsibilities:

• Extensively involved in the design of JSP screens for the Public Provident Fund and Bond modules.
• Developed the user interface screens for the above modules.
• Worked with the front-end applications using HRML, XML.
• Developed the business components (in core Java) used in the JSP screens.
• Implemented Delegate, Façade, DAO patterns for building the application.
• Written Ant scripts for build, unit testing, deployment, check styles etc.
• Used JUnit for unit testing.
• I was part of all testing phases. Provided UAT support.
• Created war files and deployed in Web Logic and WebSphere Application Server.
• Created tables, stored procedure, fulfills the requirements and accommodate the business rules in Oracle 8i database.
• Delivered Zero defects in UAT.

Environment: Java, JSP, XML, HTML, Servlets, SQL, PL-SQL, JDK JDBC, Web Logic 6.1, Websphere, EJB, JNDI, Eclipse, Ant.