SUMMARY:

• Result driven IT Professional with 7+ years of experience in the analysis, design, development, implementation and management of full life cycle of SDLC in Application Development
• Experience in different Hadoop distributions like Cloudera (Cloudera distribution CDH3, 4 and 5), Horton Works Distributions (HDP).
• Experience in configuring and using Apache Hadoop/Cloudera ecosystem components like Hadoop Distributed File System (HDFS), MapReduce, Pig, Hive, Impala, YARN, Flume, Zookeeper, Sqoop, HUE, Oozie, and Azkaban.
• Experience in Handling and further processing schema oriented and non - schema oriented data using Pig.
• Experience in Elastic Search and Elastic path.
• Experience in working with Flume/Kafka to load the log data from different sources into HDFS.
• Experience in developing real time data streaming solutions using Apache Spark/Spark Streaming, Kafka and Flume.
• Experienced in developing applications using all Java/J2EE technologies like Servlets, JSP, EJB, JDBC, JNDI, JMS etc.
• Experience in handling different file formats like Sequential files, Text files, XML, JSON, AVRO and PARQUET.
• Skilled in handling messaging services using Apache Kafka.
• Experienced with the Spark improving the performance and optimization of the existing algorithms in Hadoop using Spark Context, Spark-SQL, Data Frame, and Pair RDD's.
• Experience in both Map Reduce framework MRv1 and YARN.
• Experienced in NoSQL databases such as HBase, and MongoDB
• Experienced in job workflow scheduling and monitoring tools like Oozie and Zookeeper
• Skilled in database connectivity (JDBC) for databases like Oracle, DB2, SQL Server, MySQL, MS Access.
• Experienced in coding SQL, Procedures/Functions, Triggers and Packages on database (RDBMS) packages like Oracle.
• Experience in Message based systems using JMS, TIBCO & MQ Series.
• Experience in Data Warehousing and ETL processes.
• Good knowledge of Star Schema Modeling, and Snowflake modeling, FACT and Dimensions tables, physical and logical modeling.
• Strong knowledge on HBase.
• Experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems/mainframe and vice-versa.
• Skilled in application development using Java, RDBMS, and Linux shell scripting.
• Experienced in developing stored procedures and queries using SQL .
• Experience in Agile methodology, SOA for many of the applications.
• Experienced in using CVS, SVN and Share point as version manager.
• Proficient in unit testing the application using Junit, MR Unit and logging the application using Log4J.
• Skilled in Hadoop QA team to develop test plans, test scripts and test environments and to understand and resolve defects.
• Experience in creating and integrating Reports and Objects in MicroStrategy (Attributes, Filters, Metrics, Facts, Prompts, Templates, Consolidation and Custom Groups) in the data warehouse
• Intensive experience in developing enterprise solutions using Java, J2EE, Agile, Servlets, JSP, JDBC, Struts, spring, Hibernate, JavaBeans, JSF, MVC, JMS.
• Good organizational skills and ability to multi-task, work independently. Excellent written and verbal communication skills including experience in proposal and presentation.

TECHNICAL SKILLS:

Big data/Hadoop: HDFS, Map Reduce, HIVE, PIG, HBase, Flume and Sqoop

Java Technologies: Core Java, I8N, JFC, Swing, Beans, Log4j, Reflection

J2EE Technologies: Servlets, JSP, JDBC

Methodologies: Agile, UML, Design Patterns (Core Java and J2EE)

Web Design Tools: HTML, CSS, DHTML, AJAX, JavaScript

Frameworks: Struts 1.1/2.0, Spring 2.5, Hibernate 3.0

Database: Oracle 11g/10g/9i, MySQL, DB2, MS-SQL Server, Pl/SQL

Programming Languages: C, C++, Java, Linux Shell Scripts

Web Servers: WebLogic, WebSphere, Apache Tomcat

Network Protocols: TCP/IP, UDP, HTTP, DNS, DHCP

PROFESSIONAL EXPERIENCE:

Confidential - Irvine, CA

Sr. Hadoop, BigData Engineer

Roles & Responsibilities:

• Installed and configured Hadoop MapReduce, HDFS, Developed multiple MapReduce jobs in java for data cleaning and preprocessing.
• Worked on loading the customer profiles data, customer spending data, credit from legacy warehouses onto HDFS using Sqoop.
• Built data pipeline using Pig and Java MapReduce to store onto HDFS.
• Worked on Oozie to orchestrate the map reduce jobs that extract the data on a timely manner.
• Worked on Applied transformations and filtered both traffic using Pig.
• Worked on Pattern matching algorithms to recognize the customer across different sources and built risk profiles for each customer using Hive and stored the results in HBase.
• Worked on Maven to build the application.
• Performed unit testing using MRUnit.

Environment: JDK1.6, Red Hat Linux, HDFS, Map-Reduce, Hive, Pig, Sqoop, Flume, Oozie, DB2, HBase, Mahout

Confidential - Raleigh, NC

Hadoop Developer

Roles & Responsibilities:

• Worked on the proof-of-concept for Apache Hadoop framework initiation.
• Installed and configured Cloudera Hadoop on a raw cluster.
• Good knowledge Loaded data from Oracle database into HDFS.
• Developed MapReduce pipeline jobs in Apache Crunch to process the data and create necessary HFiles.
• Loaded the created HFiles into HBase for faster access of large customer base without taking performance hit.
• Worked on Apache Maven for project build.
• Worked on unit testing of MapReduce jobs on cluster using MRUnit.
• Worked on Oozie Scheduler system to automate the pipeline workflow.
• Actively participated in software development lifecycle (scope, design, implement, deploy, test), including design and code reviews, test development, test automation.
• Followed story-driven Agile development methodology and actively participated in daily scrum meetings.

Environment: Cloudera Hadoop, MapReduce, HDFS, Crunch, HBase, Oozie, Java (jdk1.6).

Confidential - Boston, MA

Hadoop Developer

Roles & Responsibilities:

• Main aim of the project is to centralize the source of data for audit/legal report generation using historical database which otherwise are generated from multiple sources .
• Developed multiple MapReduce Jobs in java for data cleaning and pre-processing.
• Analyzed large data sets by running Hive queries and Pig scripts.
• Worked on the Proof-of-concept for Apache Hadoop Framework.
• Developed Simple to complex MapReduce Jobs using Hive and Pig.
• Created Hive tables, loading and analyzing data using hive queries.
• Ran Hadoop jobs for processing millions of records of text data.
• Worked on application teams to install operating system, Hadoop updates, patches, Version upgrades as required.
• Worked on loading data from LINUX file system to HDFS.
• Managed data from multiple sources.
• Ran Hadoop streaming jobs to process terabytes of xml format data.
• Worked on Load and transform large sets of structured, semi structured and unstructured data.
• Assisted in exporting analyzed data to relational databases using Sqoop.
• Created and maintained Technical documentation for launching HADOOP Clusters and for
• Executed Hive queries and Pig Scripts.

Environment: Hadoop, HDFS, pig, Hive, MapReduce, Sqoop, Linux and Big Data.

Confidential - Herndon, VA

Java J2EE Developer

Roles & Responsibilities:

• The project mainly consists of developing secure and safe login page from where users can view there account information. Manage their account related functions safely and securely.
• Implemented the Spring Acegi Security for authenticating the customers.
• Worked on security framework with ACL in declarative manner.
• Worked on web tier using Spring MVC and all components therein, SimpleFormController, ParametrizableViewController, and so on AJAX was used to perform simple XMLHttpRequest callbacks for retrieving data dynamically into the client pages.
• Worked on pre-interceptor and post interceptor for writing aspects to manage business and state rules to isolate the logic in a central place to reduce code duplication.
• Designed the data model from scratch capturing best practices for ORM as it applied to the problem at hand.
• Worked on Interfaced with the data architect and provided direction to the approach and the solution.
• Persistence mechanism implemented using Hibernate utilizing Table per subclass inheritance based mapping, component mapping and other association mapping.
• Oracle is used as the relational backend.
• Designed and developed several SQL Scripts, Stored Procedures and Triggers for Oracle 10g Database.
• Designed user interface layout using CSS, HTML, and JSP.
• Tested Service and data access tier using JUnit in TDD methodology
• Organized Spring Beans and Java packages to separate business services, persistence, and presentation layers, and to ease maintenance and promote database flexibility
• Involved in developing UML Diagrams like Use Case, Class, Sequence diagrams.

Environment: Java, J2ee, design patterns, multi-threading, object oriented programming, Spring 2.5, Spring Acegi Security 2.0, Hibernate 3.x, XML, Spring MVC, WSDL, SOAP, Web Service, Axis, AJAX, PL/SQL, Eclipse 3.x, Oracle10g, WebLogic Application Server 9.0

Confidential

Java Developer

Roles & Responsibilities:

• Worked on Member Statement Application to send Email alerts to members about new statements and wrote queries to generate details about the statements.
• Worked on support to the QA team by fixing defects in the Member Statement application.
• Worked on Single Sign On application to accommodate new sponsors and created keys for the SSO application using the Java security framework.
• Followed Consumer Driven Workflow application to accommodate new business requirements.
• Deployed applications in Web Logic Application Server and configured and integrated J2EE applications with the same.
• Developed persistent Java Classes implementing the Spring framework, implemented the Test-driven methodology by performing unit testing using JUnit, configured the Web Logic Server and wrote queries using PL/SQL.
• Used Hibernate framework to map Java classes to database tables and wrote queries in PL/SQL.
• Involved in Business Research and Development meetings, requirements gathering using Use Case diagrams and provided support to the Quality team.

Environment: Java 1.4.2 and 1.5, JSP 2.0, JDBC, SSO, SQL, PL/SQL 5.1.6, SQL Plus, XML 1.0, Windows XP, JUnit 3.7, Apache Ant 1.6.5, Eclipse 3.2, Spring, SVN, JScript, Log4j, Hibernate, EJB, JMS and Use Case