SUMMARY

• Certified Cloudera developer with over 7 years of experience in Designing, Developing, and integrating applications using Hadoop, Hive, PIG, Java, and J2EE technologies.
• Experience in writing Map Reduce programs using Apache Hadoop for analyzing Big Data.
• Hands on experience in writing Ad - hoc Queries for moving data from HDFS to HIVE and analyzing the data using HIVE QL.
• In depth knowledge of Hadoop Architecture and Hadoop daemons such as Name Node, Secondary Name Node, Data Node, Job Tracker and Task Tracker.
• In depth knowledge of analyzing data using Hive and Pig.
• Expertise in developing UDFs to extend the Hive and PIG functionality using Java.
• Experience in importing and exporting data using Sqoop from Relational Database Systems to HDFS.
• Good Knowledge in Amazon AWS concepts like EMR and EC2 web services which provides fast and efficient processing of Big Data.
• Hands on experience in installing, configuring and using Apache Hadoop ecosystems such as Map Reduce, HIVE, PIG, SQOOP, FLUME and OOZIE.
• Experience loading data to Hive partitions and creating buckets in Hive.
• Logical Implementation and interaction with HBase.
• Worked in Multiple Environment in installation and configuration.
• Strong understanding of NoSQL databases like HBase, MongoDB & Cassandra.
• Experience with handling complex data processing workflows using Oozie.
• Expertise in scheduling all Hadoop/hive/Sqoop/Map Reduce jobs using Oozie.
• Extensive Knowledge in Java, J2ee, Servlets, JSP, JDBC, Struts and Spring Framework.
• Background with traditional databases such as Oracle, SQL Server, Teradata and ETL tools / processes.
• Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
• Fluent with the core Java concepts like I/O, Multi-threading, Exceptions, Regular Expressions, Collections, Data-structures and Serialization.
• Expert in setting up SSH, SCP, SFTP connectivity between UNIX hosts.
• Experience in using version control management tools like CVS, SVN and Rational Clear Case.
• Good understanding of Scrum methodologies, Test Driven Development and continuous integration.

TECHNICAL SKILLS

Hadoop/Big Data: HDFS, MapReduce, Hive, Pig, Sqoop, Flume, Oozie, and ZooKeeper.

No SQL Databases: HBase,Cassandra, MongoDB

Languages: Java, PL/SQL, Pig Latin, HiveQL, UNIX shell scripts

Java/J2EE Technologies: JDBC, JNDI, JSON, JSTL, JMS, Java Script, JSP, ServletsEJB, JSF, JQuery

Frameworks: MVC, Struts, Spring, Hibernate

Operating Systems: HP-UNIX, RedHat Linux, Ubuntu Linux and Windows XP/Vista/7/8

Web Technologies: HTML, DHTML, XML, AJAX, WSDL, SOAP

Web/Application servers: Apache Tomcat, WebLogic, JBoss

Databases: Oracle 9i/10g/11g, DB2, SQL Server, MySQL, Teradata

Tools: and IDE Eclipse, NetBeans, Toad, Maven, ANT, JDeveloper, DB Visualizer

Version Controls: CVS, Tortoise SVN, Rational ClearCase

PROFESSIONAL EXPERIENCE

Confidential, PA

Hadoop Developer

Responsibilities:

• Responsible for requirements gathering and analyzing the data sources.
• Responsible for building scalable distributed data solutions using Hadoop.
• Worked very closely with the Hadoop Administrator to set up the Hadoop cluster.
• Involved in setting up a nine node Hadoop cluster on Red hat LINUX.
• Involved in loading data from LINUX file system to HDFS.
• Worked on installing cluster, commissioning & decommissioning of datanode, namenode recovery, capacity planning, and slots configuration.
• Created Hive tables to store variable data formats of PII data coming from different portfolios.
• Implemented a script to transmit sysprin information from Oracle to Hive using Sqoop.
• Designed and developed MapReduce jobs to analyze the data.
• Implemented best income logic using Pig scripts and UDFs.
• Implemented Test scripts to support Test Driven development and continuous integration.
• Worked on tuning the performance Pig queries.
• Worked with application teams to install operating system, Hadoop updates, patches, version upgrades as required.
• Responsible to manage data coming from different sources.
• Involved in loading and transforming large sets of structured, semi structured and unstructured data.
• Cluster coordination services through Zookeeper.
• Experience in managing and reviewing Hadoop log files.
• Job management using Oozie scheduler.
• Exported the analyzed data to the relational databases using Sqoop for visualization and to generate reports for the BI team.
• Responsible for cluster maintenance, cluster monitoring and troubleshooting, manage and review data backups, manage and review Hadoop log files.
• Installed Oozie workflow engine to run multiple Hive and pig jobs.
• Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
• Supported in setting up QA environment and updating configurations for implementing scripts with Pig and Sqoop.

Environment: Cloudera, Hadoop, HDFS, MapReduce, Hive, Pig, Sqoop, HBase, Shell Scripting, Linux Red Hat.

Confidential, Manhattan, NY

Java Developer

Responsibilities:

• Involved in analysis, requirement gathering and designing of application.
• Developed the user interface presentation screens using HTML, JSP XML,CSS
• Developed the DAO layer using the Hibernate and for real time performance used the caching system for Hibernate
• Used Eclipse as IDE tool to develop the spring framework based application.
• Designed class and sequence diagrams to Modify and Add modules.
• Wrote SQL queries and created DDL scripts for interacting with the Oracle database.
• Maintained the existing code base developed in the Struts, Spring and Hibernate framework by incorporating new features and doing bug fixes.
• Utilized Spring IOC and Dependency Injection to integrate Hibernate framework
• Involved in fixing bugs and involved in developing batch processing.
• Involved in developing Stored Procedures and database connectivity to DB2.
• Used Junit framework for writing Test Classes.
• Used Log4J logging framework to write Log messages with various levels.
• Used SVN for source control.
• Worked in Agile methodology.
• Used Maven for application life cycle management.
• Worked with Unix for extracting logs of daily batch run.

Environment: Java, JDK1.6, Struts, Spring, Hibernate, JSP, HTML, JavaScript, Maven, Junit, Log4j, Unix, DB2.

Confidential, San Jose, CA

Java/J2EE Developer

Responsibilities:

• Created design documents and reviewed with team in addition to assisting the business analyst / project manager in explanations to line of business.
• Responsible for understanding the scope of the project and requirement gathering.
• Involved in analysis, design, development and testing of the application
• Developed the web tier using JSP, Struts MVC to show account details and summary.
• Used Struts Tiles Framework in the presentation tier.
• Designed and developed the UI using Struts view component, JSP, HTML, CSS and JavaScript.
• Used AJAX for asynchronous communication with server
• Utilized Hibernate for Object/Relational Mapping purposes for transparent persistence onto the Oracle database.
• Used Spring framework for dependency injection/Inversion of control (IOC), and integrated Struts and Hibernate frameworks.
• Involved in writing Spring Configuration XML files that contains declarations and other dependent objects declaration.
• Used Tomcat web server for development purpose.
• Involved in creating and running of Test Cases for JUnit Testing.
• Used Oracle as Database and used Toad for queries execution and also involved in writing SQL scripts, PL/SQL code for procedures and functions.
• Used CVS for version controlling.
• Developed application using Eclipse and used build and deploy tool as Maven.
• Used Log4J to print the logging, debugging, warning, info on the server console.

Environment: Java, J2EE, JUnit, AJAX, XML, JavaScript, Spring, Struts, Hibernate, Log4j, CVS, Maven, Eclipse, Apache Tomcat, and Oracle.

Confidential

Java Developer

Responsibilities:

• Extensively involved in the design of JSP screens for the Public Provident Fund and Bond modules.
• Designed and developed the user interface screens for the above modules.
• Worked with the front-end applications using HRML, XML.
• Designed and developed Session beans to implement business logic (in core Java) used in the JSP screens.
• Implemented Delegate, Façade, DAO patterns for building the application.
• Developed Ant scripts for build, unit testing, deployment, check styles etc.
• Used JUnit for unit testing.
• Involved in all testing phases. Provided UAT support.
• Created war files and deployed in Web Logic Application Server.
• Created tables, stored procedure, fulfills the requirements and accommodate the business rules in Oracle 8i database.
• Delivered Zero defects in UAT.

Environment: Java, JSP, XML, HTML, SQL, PL-SQL, JDK JDBC, Web Logic 6.1, EJB, JNDI, Eclipse, Ant, Oracle 8i