SUMMARY

• 9 Years of extensive IT experience in Analysis, Design, Development, Implementation and Testing of software applications which includes 3+ Years of experience in Big Data using Hadoop, MapReduce, HDFS, Hive, Pig, Sqoop, Oozie, Kafka, Spark, Storm, NoSQL, CDH4.
• Capable of processing large sets of structured, semi - structured and unstructured data and supporting systems application architecture.
• Importing and exporting data into HDFS. Having experience in writing PIG Scripts.
• Involved in creating HIVE tables, loading with data and writing HIVE queries.
• Managing and Reviewing Hadoop Log Files, Deploy and Maintaining Hadoop Cluster.
• Excellent understanding of Hadoop architecture and its components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce programming paradigm.
• Experience in providing support to data analyst in running Pig and Hive queries.
• Experience in working with different data sources like XML, AVRO and JSON.
• Worked on Performance Tuning of Hadoop jobs by applying techniques such as Map Side Joins, Partitioning and Bucketing.
• Experience in performance tuning the Hadoop cluster by gathering and analyzing the existing infrastructure. Good Knowledge with messaging services using Apache Kafka.
• Good Knowledge with NoSql Databases - Cassandra, Mongo DB and HBase.
• Working experience on designing and implementing complete end-to-end Hadoop Infrastructure including PIG, HIVE, Sqoop, Oozie, Flume and zookeeper.
• Good Knowledge with flume to load the log data from multiple sources directly into HDFS
• Installed and configured Hive, Pig, Sqoop, Flume and Oozie on the Hadoop cluster.
• Adequate knowledge and working experience with Agile methodology.
• Experience utilizing Java tools in Business, Web, and Client-Server environments including Java, Jdbc, Servlets, Jsp, Struts Framework, Jasper Reports and Sql.
• I have worked primarily in the domains of banking and telecommunication and main area of experience has been involved in project development of web applications.

TECHNICAL SKILLS

Platforms: Windows (2000/XP), Linux

Big Data Ecosystems: Hadoop, MapReduce, HDFS, Hive, Pig, Sqoop, Flume, Oozie Kafka, Spark, Storm, CDH4, AVRO and JSON.

Programming Languages: Java

Scripting Languages: Jsp 2.0, Servlets 2.3, JavaScript, HTML

Databases: Oracle8.x/9i, NoSQL MangoDB, Cassandra

Frameworks: Struts 1.2

Tools: My Eclipse 5.1, iReport 3.0, QuickStartVM, Hortonworks

Servers: JBoss, Tomcat 5.0, BEA Web Logic 8.1, Web Sphere 6

Methodologies: UML, Design Patterns

Concepts: JMS, Magento, Jasper Reports

PROFESSIONAL EXPERIENCE

Confidential

Hadoop Developer

Responsibilities:

• Loaded the Customer profiles data, Customer claims information, Billing information etc. into HDFS.
• Designed and Implemented Hive and Pig UDF's for evaluation, filtering, loading and storing of data.
• Hands on experience in Installing and Configuring using Hadoop EcoSystems components like
• MapReduce, HDFS, Sqoop, Hive, Pig, Oozie.
• Involved in Importing and Exporting the data into HDFS and HIVE.
• Experienced in running Hadoop Streaming Jobs to process terabytes of xml format data.
• Performed data validation on the data ingested using MapReduce by building a custom model to
• Filter all the invalid data.
• Experience in working with different data sources like Avro Data Files, Json Files and Oracle to load data into Hive Tables.
• Developed workflow in Oozie to automate the tasks of loading the data into HDFS.
• Configured the Hadoop properties to achieve the high performance.
• Prepared Detailed Technical Design (DTD) Documents, Handled Deployment activities.
• Prepared UTPs, Test Cases & Reported bugs into QC, Internal and External Review Comments fixing.
• Preparing Release Documents such as Code Review Completion Report, Implementation Plan,
• Support Handover, Release Notes, TVR and Induction Kit Documents.

Environment: Hadoop, HDFS, HIVE, PIG, Map Reduce, Sqoop, Oozie.

Confidential

Hadoop Developer

Responsibilities:

• Responsible for building scalable distributed data solutions using Hadoop.
• Handled importing of data from various data sources, performed transformations using Hive, MapReduce, loaded data into HDFS and Extracted the data from MySQL into HDFS using Sqoop.
• Installed and configured Hive, Pig, Sqoop, Flume and Oozie on the Hadoop cluster.
• Setup and benchmarked Hadoop clusters for internal use.
• Developed Simple to complex Map/reduce Jobs using Java programming language that are implemented using Hive and Pig.
• Optimized Map/Reduce Jobs to use HDFS efficiently by using various compression mechanisms.
• Analyzed the data by performing Hive queries (HiveQL) and running Pig scripts (Pig Latin) to study customer behavior. Used UDF’s to implement business logic in Hadoop.
• Implemented business logic by writing UDFs in Java and used various UDFs from other sources.
• Experienced on loading and transforming of large sets of structured and semi structured data.
• Managing and Reviewing Hadoop Log Files, deploy and Maintaining Hadoop Cluster.

Environment: Hadoop, HDFS, HIVE, PIG, Map Reduce, Sqoop, Oozie, Eclipse, Java.

Confidential

Hadoop Developer

Responsibilities:

• Created Hive queries that helped market analysts spot emerging trends by comparing fresh data with EDW reference tables and historical metrics.
• Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System and PIG to pre-process the data.
• Provided design recommendations and thought leadership to sponsors/stakeholders that improved review processes and resolved technical problems.
• Managed and reviewed Hadoop log files. Tested raw data and executed performance scripts.
• Shared responsibility for administration of Hadoop, Hive and Pig.
• Installed and configured MapReduce, HIVE and the HDFS; implemented CDH3 Hadoop cluster on CentOS. Assisted with performance tuning and monitoring.
• Supported code/design analysis, strategy development and project planning.
• Created reports for the BI team using Sqoop to export data into HDFS and Hive.
• Developed multiple MapReduce jobs in Java for data cleaning and preprocessing.
• Assisted with data capacity planning and node forecasting.
• Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability.

Environment: Hadoop, HDFS, HIVE, PIG, Map Reduce, Sqoop, Oozie, Eclipse, Java.

Confidential

Java Developer

Responsibilities:

• Developed the presentation layer using JSP, HTML, CSS and client validations using JavaScript.
• Involved in designing and development of the ecommerce site using JSP, Servlet and JDBC.
• Used Eclipse 6.0 as IDE for application development.
• Validated all forms using Struts validation framework and implemented Tiles framework in the presentation layer.
• Configured Struts framework to implement MVC design patterns.
• Designed and developed GUI using JSP, HTML, DHTML and CSS.
• Worked with JMS for messaging interface.
• Detailed Technical Design (DTD) Document Preparation.
• Development and Deployment. UTP Preparation.
• Internal and External Review Comments fixing.
• Fixing the Bugs.
• Preparing release documents such as Code Review Completion Report, Implementation Plan, Support Handover, Release Notes, TVR, and Induction Kit.

Environment: Core Java, JSP, HTML, Struts framework, Java Script, JDBC, XML, JMS, UML, JUnit, Log4j.

Confidential

Java Developer

Responsibilities:

• Involved in discussions and workshops with Confidential business teams.
• Involved in Impact Analysis, Solution Design.
• A major role in deploying the application. Client side validations.
• Developing the required DB Objects to handle different validations.
• Design and development of the screens according to the business requirements using Servlets, JSP. Developed ANT script for compiling and deployment
• Performed unit testing using JUnit
• Extensively used Log4j for logging the log files
• Involved, supported and solved critical production issues, also involved in deploying applications in production environment.
• Followed a complete software development life cycle, gathered requirements from the Business, detail analysis, conceptual and detail design, development and testing.
• Used My Eclipse for complete development, debugging and deploying the application.

Environment: Core Java, JSP, HTML, Struts framework, Java Script, JDBC, Servlets, Log4j, SQL.

Confidential

Java Developer

Responsibilities:

• Designed and developed GUI using JSP, HTML, DHTML and CSS.
• Developed the presentation layer using JSP, HTML, CSS and client validations using JavaScript.
• Involved in designing and development of the site using JSP, Servlet, JavaScript and JDBC.
• Used Eclipse 6.0 as IDE for application development
• Validated all forms using Struts validation.
• Configured Struts framework to implement MVC design pattern.
• Designed and developed GUI using JSP, HTML, DHTML and CSS
• Worked with JMS for messaging interface.
• Deployed the entire project on WebLogic application server.
• Used AJAX for interactive user operations and client side validations.
• Used XML for ORM mapping relations with the java classes and the database.
• Used XSL transforms on certain XML data.
• Developed ANT script for compiling and deployment.
• Performed unit testing using Junit.
• Extensively used Log4j for logging the log files.
• Used Subversion as the version control system.

Environment: Java 1.4, HTML, CSS, DHTML, JDBC, XML, Oracle, JavaScript, JSP, ANT, SVN, Jboss, Eclipse.