SUMMARY

• Experienced Software Developer with 7 years of experience in developing software applications and support with experience in developing strategic ideas for deploying Big Data technologies to efficiently solve Big Data processing requirements.
• Strong Understanding in distributed systems, RDBMS, large - scale & small-scale non-relational data stores, NoSQL map-reduce systems, database performance, data modeling, and multi-terabyte data warehouses.
• Real-time experience in Hadoop Distributed files system, Hadoop framework and Parallel processing implementation.
• Strong Knowledge in overall Hadoop eco-system. Hands on experience in HDFS, Map Reduce, Pig/Hive, Hbase.
• Experience in developing applications using Java, RDBMS, Linux/Unix shell scripting and Linux internals.
• Experience in writing UDF’s and map reduce programs in java for Hive and Pig.
• Procedural knowledge in cleansing and analyzing data using HiveQL, Pig Latin, and custom MapReduce programs in Java.
• Experienced in writing custom UDFs and UDAFs for extending Hive and Pig core functionalities.
• Ability to develop Pig UDF'S to pre-process the data for analysis.
• Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems (RDBMS), Teradata and vice versa.
• Hands-on experience on cloud computing platforms such as Amazon EC2 and Amazon S3.
• Worked extensively with Dimensional modeling, Data migration, Data cleansing, Data profiling, and ETL Processes features for data warehouses.
• Good experience working with Horton works Distribution and Cloudera Distribution.
• Implemented importing and exporting data into HDFS and Hive using Sqoop.
• Executed in Flume to load the log data from multiple sources directly into HDFS.
• Experience in designing both time driven and data driven automated workflows using Oozie.
• Experience in writing UNIX shell scripts.
• Experience working with JAVA, J2EE, JDBC, ODBC, JSP, Java Eclipse, Java Beans, EJB, Servlets, My SQL Server.
• Worked extensively on Soap UI and REST for functional API testing.
• Good Experience in developing software and designing e-commerce applications, highly distributed applications using Java, J2EE, Servlets, JSP, Java Beans, EJB, Struts, Spring, JDBC, Apache Tomcat Server, JavaScript, HTML5, XML, SQL.
• Distributed Object Oriented Component analysis and Design according to industry leading J2EE platforms
• Experience in Object Oriented Analysis Design (OOAD) and development of software using UML Methodology, good knowledge of J2EE design patterns and Core Java design patterns.
• Experience in all stages of SDLC (Agile, Waterfall), writing Technical Design document, Development, Testing and Implementation of Enterprise level Data mart and Data warehouses.
• Wide-ranging experience working in Oracle, DB2, SQL Server and My SQL database.Delivery Assurance - Quality Focused & Process Oriented:
• Ability to work in high-pressure environments delivering to and managing stakeholder expectations.
• Application of structured methods to: Project Scoping and Planning, risks, issues, schedules and deliverables.
• Strong analytical and Problem solving skills.
• Good Inter personnel skills and ability to work as part of a team. Exceptional ability to learn and master new technologies and to deliver outputs in short deadlines

TECHNICAL SKILLS

Technology: Hadoop Ecosystem/J2SE/J2EE/Oracle

Operating Systems: Windows Vista/XP/NT/2000 Series, UNIX/LINUX (Ubuntu, CentOS, Redhat)/AIX/Solaris.

DBMS/Databases: DB2, My SQL, PL/SQL

Programming Languages: C, C++, JSE, XML, JSP/Servlets, Struts, spring, HTML, JavaScript, jQuery, Web services.

Big Data Ecosystem: HDFS, Map Reduce, Oozie, Hive, Pig, Sqoop, Flume, Zookeeper and Hbase.

Methodologies: Agile, Water Fall

NOSQL Databases: Cassandra, MongoDb, Hbase

Version Control Tools: SVN, CVS, VSS, PVCS

ETL Tools: IBM data stage 8.1

PROFESSIONAL EXPERIENCE

Confidential, CA

Hadoop Developer

Responsibilities:

• Developed MapReduce jobs in java for data cleaning and preprocessing.
• Importing and exporting data into HDFS and Hive using Sqoop.
• Used Bash Shell Scripting, Sqoop, AVRO, Hive, HDP, Redshift, Pig, Java, Map/Reduce daily to develop ETL, batch processing, and data storage functionality.
• Responsible for developing data pipeline using Flume, Sqoop and Pig to extract the data from weblogs and store in HDFS.
• Worked on NoSQL databases including Hbase and Cassandra.
• Worked on loading all tables from the source database schema through Sqoop.
• Worked on designed, coded and configured server side J2EE components like JSP, AWS and JAVA.
• Collected data from different databases ( i.e. Oracle, My Sql) to Hadoop
• Used Oozie and Zookeeper for workflow scheduling and monitoring.
• Worked on Designing and Developing ETL Workflows using Java for processing data in HDFS/Hbase using Oozie.
• Experienced in managing and reviewing Hadoop log files.
• Involved in moving all log files generated from various sources to HDFS for further processing through Flume.
• Involved in loading and transforming large sets of structured, semi structured and unstructured data from relational databases into HDFS using Sqoop imports.
• Developed Sqoop scripts to import export data from relational sources and handled incremental loading on the customer, transaction data by date.
• Developed simple and complex MapReduce programs in Java for Data Analysis on different data formats.
• Optimized MapReduce Jobs to use HDFS efficiently by using various compression mechanisms.
• Worked on partitioning HIVE tables and running the scripts in parallel to reduce run-time of the scripts.
• Worked on Data Serialization formats for converting Complex objects into sequence bits by using AVRO, PARQUET, JSON, CSV formats.
• Responsible for analyzing and cleansing raw data by performing Hive queries and running Pig scripts on data.
• Created Hive tables, loaded data and wrote Hive queries that run within the map.
• Implemented business logic by writing Pig UDF's in Java and used various UDFs from Piggybanks and other sources.
• Used OOZIE Operational Services for batch processing and scheduling workflows dynamically.
• Extensively worked on creating End-End data pipeline orchestration using Oozie.
• Populated HDFS and Cassandra with huge amounts of data using Apache Kafka.
• Worked in a language agnostic environment with exposure to multiple web platforms such as AWS, databases like Cassandra.
• Processed the source data to structured data and store in NoSQL database Cassandra.
• Extracted files fromMySQLthroughSqoopand placed in HDFS and processed.
• Successfully loaded files to Hive and HDFS fromCassandra.Processed the source data to structured data and store in NoSQL databaseCassandra.Created alter, insert and delete queries involving lists, sets and maps inDataStaxCassandra.Worked in a language agnostic environment with exposure to multiple web platforms such as AWS, databases like Cassandra.
• Cassandra through Java services.
• Responsible for continuous monitoring and managing Elastic MapReduce cluster through AWS console.

Environment: Map Reduce, HDFS, Hive, Pig, HBase, SQL, Sqoop, Flume, Oozie, Apache Kafka, Zookeeper, J2EE, Eclipse, Cassandra.

Confidential, Minneapolis MN

Hadoop Developer

Responsibilities:

• Responsible for loading customer's data and event logs into HBase using Java API.
• Created HBase tables to store variable data formats of input data coming from different portfolios.
• Involved in adding huge volumes of data in rows and columns to store data in HBase.
• Responsible for architecting Hadoop clusters with CDH4 on CentOS, managing with Cloudera Manager.
• Involved in initiating and successfully completing Proof of Concept on FLUME for Pre-Processing, Increased
• Reliability and Ease of Scalability over traditional MSMQ.
• Use Flume to collect the log data from different resources and transfer the data type to hive tables using different Serde to store in JSON, XML and Sequence file formats.
• Used Hive to find correlations between customer's browser logs in different sites and analyzed them to build risk profile for such sites.
• End-to-end performance tuning of Hadoop clusters and Hadoop Map/Reduce routines against very large data sets.
• Created and maintained Technical documentation for launching HADOOP Clusters and for executing Hive queries and Pig Scripts.
• Created User accounts and given the users the access to the Hadoop Cluster
• Implemented the secure authentication for the Hadoop Cluster using Kerberos Authentication protocol.
• Developed Pig Latin scripts to extract the data from the web server output files to load into HDFS.
• Developed the Pig UDF'S to pre-process the data for analysis.
• Familiarity with a NoSQL database such as Mongo DB Solr.
• Experience in working with various kinds of data sources such as Mongo DB Solar and Oracle.
• Successfully loaded files to Hive and HDFS from Mongo DB Solr.
• Experience in managing development time, bug tracking, project releases, development speed, release forecast, scheduling and many more. Using a custom framework of Nodes and Mongo DB to take care of the back-end calls with a lightning fast speed.
• Monitored Hadoop cluster job performance and performed capacity planning and managed nodes on
• Hadoop cluster.
• Responsible for using Cloudera Manager, an end to end tool to manage Hadoop operations.

Environment: Hadoop, Big Data, HDFS, Pig, Hive, MapReduce, Sqoop, Cloudera manager, LINUX, CDH4, FLUME, HBase, Pig, Hive.

Confidential, Ohio

Hadoop Developer

Responsibilities:

• Developed and configured finely tuned the Cloudera Hadoop (CDH3 & CDH4) and other Hadoop ecosystem tools like Sqoop, Hive, Pig, Hbase, Zookeeper and Flume.
• As a team member was assigned to write MapReduce jobs using Java API.
• In the process of handling large sets of data extracted, loaded and transformed different structured, unstructured and semi-structured data.
• By using Sqoop, imported and exported data into HDFS and Hive.
• Installed and configured Hive and also wrote Hive UDFs in Java.
• Created several Hive tables, loaded with data and wrote Hive Queries in order to run internally in MapReduce.
• Actively involved in loading data from UNIX file system to HDFS.
• Involved in developing Hive queries in order to pre-process the data for analysis by imposing read only structure on the streamed data.
• Through Oozie, created workflows for automation.
• Also automated all jobs so that data can be pulled from FTP server and loaded into Hive tables using Oozie Workflows.
• As an active team member supported MapReduce programs which were running on the cluster.

Environment: Hadoop Framework, MapReduce, Hive, Sqoop, Flume, Oozie, Java (JDK1.6), UNIX Shell, Oracle 10g.

Confidential, San Francisco CA

Java/J2EE Developer

Responsibilities:

• Developed the application using Struts Framework that leverages classical Model View Layer (MVC)
• Architecture UML diagrams like use cases, class diagrams, interaction diagrams (sequence and collaboration) and activity diagrams were used
• Gathered business requirements and wrote functional specifications and detailed design documents
• Extensively used Core Java, Servlets, JSP and XML
• Designed the logical and physical data model, generated DDL scripts, and wrote DML scripts for Oracle 9i
• Database.
• Implemented Enterprise Logging service using JMS and apache CXF.
• Developed Unit Test Cases, and used JUNIT for unit testing of the application
• Implemented Framework Component to consume ELS service.
• Involved in designing user screens and validations using HTML, jQuery, Ext JS and JSP as per user requirements.
• Implemented JMS producer and Consumer using Mule ESB.
• Wrote SQL queries, stored procedures, and triggers to perform back-end database operations
• Designed Low Level design documents for ELS Service.
• Closely worked with QA, Business and Architect to solve various Defects in quick and fast to meet deadlines

Environment: Java, Spring core, JMS Web services, JMS, JDK, SVN, Maven, Mule ESB Mule, Junit, WAS7, Jquery, Ajax, SAX.

Confidential

Java Developer

Responsibilities:

• Designed and developed Web Services usingJava/J2EE in WebLogic environment. Developed web pages usingJavaServlet, JSP, CSS,JavaScript, DHTML, HTML5, and HTML. Added extensive Struts validation.
• Involve in the Analysis, Design, and Development and testing of business requirements.
• Developed business logic in JAVA/J2EE technology.
• Implemented business logic and generated WSDL for those web services using SOAP.
• Worked on Developing JSP pages
• Implemented Struts Framework
• Developed Business Logic using Java/J2EE
• Modified Stored Procedures in MYSQL Database.
• Developed the application using Spring Web MVC framework.
• Worked with Spring Configuration files to add new content to the website.
• Worked on the Spring DAO module and ORM using Hibernate. Used Hibernate Template and HibernateDaoSupport for Spring-Hibernate Communication.
• Configured Association Mappings such as one-one and one-many in Hibernate
• Worked with JavaScript calls as the Search is triggered through JS calls when a Search key is entered in the Search window
• Worked on analyzing other Search engines to make use of best practices.
• Collaborated with the Business team to fix defects.
• Worked on XML, XSL and XHTML files.
• Interacted with project management to understand, learn and to perform analysis of the Search Techniques.
• Used Ivy for dependency management.
• As part of the team to develop and maintain an advanced search engine, would be able to attain expertise on a variety of new software technologies.