PROFESSIONAL SUMMARY:

• Software professional over 6+yearsof experience in teh IT industry including 2.5+ years of experience in implementing Big data solutions using Cloudera Apache Hadoop distributing systemand good communication skills.
• Experience in analyzing data using Hadoop Ecosystem, handling with elements based onMap Reduce, HIVE, HBase, HBase - Hive Integration, PIG, HDFS,Zookeeper, Sqoop, Oozie and Flume.
• In depth knowledge of Hadoop Architecture (YARN).
• Involved in full Software Development Life Cycle of projects including design, development, testing and implementation of Client Server and Web applications,experience in understanding Data Quality processes, methods.
• Experience in Object Oriented Analysis, Design (OOAD) and development of software using all of teh SDLC Methodologies, good knowledge of J2EE design patterns and Core Java design patterns.
• Good Understanding on teh MVC Architecture (Struts, spring) and building up teh Applications likewise.
• Working experience in developing Enterprise Applications using Java, JSP, Servlets, Hibernate, JBoss, JDBC, EJB, Web Logic, Web Sphere, JQuery, XML, HTML, RMI, Java Script and Ajax.
• Hands on experience in application development using RDBMS, and UNIX Linux shell scripting.
• Extension of Custom User Defined function’s (UDF’s) using PIG and HIVE core functionalities.
• Experience in stacking Unstructured, Structured Data from unique sources into HDFS.
• Robust experience in NOSQL databases such as HBaseandMongoDB.
• Experience in debugging Hadoop component, stability, and performance issues.
• Good Knowledge on Apache Spark open-source data analytics cluster computing framework.
• Expertise in importing and exporting data using Sqoop from Relational Database Systems to HDFS and vice-versa.
• Experience in workflow management using Oozie.
• Knowledge on understanding teh elements of Data Mining and techniques of Machine Learning.
• Good knowledge on integrating teh BI tools like Tableau with teh Hadoop stack and extracting teh required Data.
• Used HBasewith Hive for real time low latency queries.
• Experience in creating Map Reduce jobs in Java as per teh business requirements.
• Good experience in Oozie Framework and Automating daily import jobs.
• Knowledge in Talendopen source ETL tool.
• Worked with Tableau for report, DASHBOARDcreation and further analysis from teh front end.
• Proficient in Optimization of SqlQueriesand concepts of Database.
• Experience in using teh version control tools like SVN and CVS.
• Potential to adapt dynamically to teh team environment with teh capability to increase productivity and follow administrative governance instructions in creating better value to teh project.
• Ability to perform at a high level, meet deadlines, adaptable to ever changing priorities.
• Experience in AGILE Methodology /SCRUM Framework.

TECHNICAL SKILLS:

Big data/Hadoop Ecosystem: Map Reduce, HDFS, YARN, HIVE, PIG, HBase,Sqoop, Oozie, Flume, Kafka

Programming Languages: Linux shell scripts, C,C++, Java, Scala, SQL, PL/SQL

NoSQL Databases: HBase, MongoDB

Relational Database: Mysql, Oracle 11g/10g, MS-SQL Server, Teradata

Web Technologies: JDBC, JSP, JavaScript, AJAX, SOAP, HTML, XML

Web Servers: Web logic 10.3, Web Sphere 6.1, Apache Tomcat 6.0

Frameworks: MVC, Struts 2/1, Hibernate 3, Spring 3/2.5/2

Tools Used: SQL Developer, Eclipse, Putty, cygwin, Win SCP, SVN

Operating System: Ubuntu (Linux), Win 95/98/2000/XP, Red Hat, Mac OS

ETL Tools: Talend, Informatica

Monitoring Tools: Ganglia, Nagios

Reporting Tools: Tableau

Methodologies: UML, Design Patterns, Agile

PROFESSIONAL EXPERIENCE

Big Data Developer

Confidential, Denver, CO

Responsibilities:

• Loaded Structured data using SQOOP, Unstructured data using FLUME from multiple sources ingesting into HDFS.
• DevelopedMap Reduce programs to parse teh raw data, populate staging tables and storethe refined data in partitioned tables in teh EDW.
• Created Hive queries that helped market analysts spot emerging trends by comparing fresh data with EDW reference tables and historical metrics.
• Worked on analysing Hadoop cluster using different big data analytic tools including Pig, Hive and Sqoop.
• Worked on Ingestion of data from various RDBMS Systems to HDFS through sqoop and vice-versa.
• Created Hive external tables for teh data in HDFS and moved data from archive layer to business layer with Hive transformations.
• Worked on Pig and hive scripts for data joins and experienced in writing PIG-UDF's for data cleansing.
• Supported in setting up QA environment and updating configurations for implementing scripts with Pig and Sqoop.
• Used Hbaseas NOSQL Data base for faster data access patterns.
• Worked on Talend ETL POC.

Environment: HDFS, CDH 5.3, Impala, Mahout, Map-Reduce, Apache Crunch, Hive, Pig, Sqoop, SQL server, Flume, Spark, Lambda, Zookeeper, Oozie, DB2, Hbase and Pentaho.

Big Data Developer

Confidential, Denver,CO

Responsibilities:

• Provided day to day development and production support in Hadoop platform.
• Manage and monitor Hadoop cluster and platform infrastructure, including recovering from node failures and troubleshooting Hadoop cluster issues.
• Loaded log files using Flume into HDFS and process teh data.
• Loaded files from MongoDB into HDFS using Sqoop.
• Load data from Mysql and Oracle RDBMS tables into HDFS using Sqoop.
• Tune HiveQL and Pig scripts for user reporting.
• Used Pig for data processing and data cleansing on teh data ingested.
• Involved in pushing teh cleansed dataset fromHDFS to HBASE using Map Reduce programs.
• Responsible to manage data coming from disparate sources.
• Supported Map Reduce Programs those are running on teh cluster.
• Used Oozie Scheduler system to automate teh pipeline workflow and orchestrate teh map reduces jobs that extract teh data on a timely manner.
• Experienced in running Hadoop streaming jobs to process terabytes of xml format data.
• Load and transform large sets of structured, semi structured and unstructured data.

Environment:Hadoop, MapReduce, Hive, HDFS, PIG, Impala, Sqoop, Oozie, lambda, Cloudera, Flume, Hbase, Zookeeper, CDH3, MongoDB, Oracle, NoSQL and Unix/Linux, Kafka.

Big Data Developer

Confidential, Oakland,CA

Responsibilities:

• Created HBase tables to load large sets of structured, semi structured and unstructured data coming from UNIX, NoSQL and a variety of portfolios.
• Created reports for teh BI team using Sqoop to export data into HDFS and Hive.
• Developed multiple Map Reduce jobs in Java for data cleaning and preprocessing.
• Worked on analyzing Hadoop cluster using different big data analytic tools including Pig, Hive, and Map Reduce on EC2.
• Collecting and aggregating large amounts of log data using Apache Flume and staging data in HDFS for further analysis.
• Gained experience in managing and reviewing Hadoop log and JSON files.
• Written HIVE UDF for Data Cleaning.
• ExperiencedinmanagingandreviewingHadooplogfiles.
• Responsibletomanagedatacomingfromdifferentsources.
• Assisted in monitoring teh hadoop cluster using Ganglia tool.
• Involved in developing PIG Scripts and Hive Reports.
• Created buckets and partitions using hive for data analysis.
• Load data into HDFS from RDBMS using Sqoop.

Environment:Apache Hadoop, RDBMS, HBase, HDFS, Map Reduce, Hive, Pig, Sqoop, Flume, Oozie, Ganglia, CoreJava, JSP, RMI, JNDI, JDBC, Hibernate, Shell Scripting, Webservices.

Java Developer

Confidential

Responsibilities:

• Worked on complete life cycle, Design, development and testing using OOA and OOD.
• Implemented teh presentation layer with HTML, XHTML, JavaScript, JSP, and CSS.
• Used JQUERY for UI and AJAX for reports display.
• Created teh web application using MVC pattern to manage runtime content, in teh form of POIs.
• Used Web Services to extract customer related product data from machines and servers using WSDL, XML, SOAP using Service Oriented Architecture.
• Used EJBs to develop business logic and coded reusable components in Java Beans.
• Played a crucial role in developing persistence layer.
• Developed and utilized J2EE Services and JMS components for messaging communication in Web Logic.
• Development of database interaction code to JDBC API making extensive use of SQL.
• Query Statements and advanced Prepared Statements.
• Involved in writing complex SQL queries to validate converted date.
• Responsible for Planning & tracking of teh enhancement.
• Responsible in deploying teh application into System Test Environment.
• Ensured seamless deployment of application into production.
• Developed application using Eclipse and used build and deploy tool as Maven.
• Deployed teh applications on multiple Web Logic Server and maintained Load balancing,
• Analyzed heap dumps to fix teh memory leaks.
• Implemented Unit Testing Framework Driven Using Junit.
• Prepared teh Installation, Customer guide and Configuration document which were delivered to teh customer along with teh product Involved in development, and Testing, phases of teh project by following Agile methodology.

Environment: Core Java, J2EE, EJB, JSP, Servlets, MVC, WebSphere 7.0, Hibernate, Web Services, ANT, SOAP, WSDL, JavaScript, PL/SQL, CVS, Oracle 10gi, JUnit, Unix.

Java Developer

Confidential

Responsibilities:

• Involved in teh analysis, design, and development and testing phases of application using SCRUM AGILE methodology.
• Created Use case, Sequence diagrams, functional specifications and User Interface diagrams using Star UML.
• Involved in complete requirement analysis, design, coding and testing phases of teh project.
• Developed teh Presentation Layer using SpringMVC Framework and also used Struts Tiles Layout for View Transactions and User Activity Monitoring module.
• Implemented teh Web Services functionality in teh application to allow external applications to access data.
• Implemented cross cutting concerns like business transactions, security, Logging and monitoring mechanism using Spring AOP.
• Developed user interfaces using JSP, HTML, XML and JavaScript.
• Generated XML Schemas and used XML Beans to parse XML files.
• Developed teh code which will create XML files and Flat files with teh data retrieved from Databases and XML files.
• Created Data sources and Helper classes which will be utilized by all teh interfaces to access teh data and manipulate teh data.
• Used JMS to communicate with teh Mainframe.
• Followed TDD Test Driven Development and developed test cases by using Junit for unit testing for each and every module developed.
• Web logic is used as teh application production server.

Environment:Java, JSP, Servlets, Spring AOP, Spring IOC, Spring ORM, Spring MVC, Hibernate, DAO, DTO, XML, JDBC, Transactions, JavaScript, JQuery, JSON, Apache Tomcat, WebSphere Application Server, SOAP, WSDL, JMS, Eclipse, Oracle, CVS, JUnit, log4j.