SUMMARY

• 7+ years of professional experience in IT, which includes five years of experience in Hadoop development and Big data. Worked on developing applications in Health care sector and E - Commerce sector.
• Good knowledge in setting up, maintain and configuring the Hadoop cluster.
• Excellent knowledge of Hadoop architecture and on Hadoop daemons such as Name Node, Data Node.
• Hands-on experience on Pig, Hive, HBase, Sqoop, Flume, Oozie and MapReduce framework which are the major components of Hadoop ecosystem.
• Experience in installation, configuration, supporting and monitoring Hadoop clusters using Apache, Cloudera distributions and AWS.
• Hands-on experience in Sqoop which is used in importing and exporting of the data from HDFS to Relational Databases and vice-versa.
• Experience in importing real time data such as log data, social networking data(twitter) into HDFS using Flume.
• Imported different kinds of data such as JSON, Log data into pig using different loaders available.
• Good in data extraction, manipulation, analyzing and validation of large volume of data.
• Familiarity with NLP, Sentiment Analysis.
• Developed applications using Java, RDBMS, and Linux shell scripting
• Developed custom UDF’s for Pig and Hive using java to process and analyze the data.
• Experience in analyzing data using HiveQL, Pig Latin, and custom Map Reduce programs in Java.
• Worked on various databases such as MySQL, Oracle, MS-SQL SERVER.
• Worked on NoSQL databases including HBase, MongoDB.
• Experience on Unix commands and shell scripting.
• Performed different transformations and actions using pySpark to join, aggregate and calculate different statistical values of the data.
• Familiar about using Dockers.
• Experience on cloud technologies like Amazon Web Services(AWS).
• Good knowledge on Apache Kafka and in configuring producers and consumers in it.
• Experience in converting Hive/SQL queries into Spark transformations using Java.
• Good knowledge on creating workflows to execute Pig, Hive jobs using Oozie Workflow Engine.
• Excellent Java development skills using J2EE, Servlets, Junit, JSP, JDBC.
• Familiar with Java virtual machine (JVM) and multi-threaded processing.
• Good understanding of XML methodologies (XML, XSL, XSD) including Web Services and SOAP
• Good understanding of Scrum methodologies, Test Driven Development and continuous integration.
• Good knowledge in analyzing Software Requirement Specification(SRS) document. Strong knowledge in Software Development Life Cycle(SDLC).
• Good knowledge on writing and understanding use cases.
• Excellent communication skills, team player, analytical, research-minded, technically competent, enjoy facing challenges, approach-oriented, positive minded.

TECHNICAL SKILLS

Hadoop/Big Data: Hadoop 1.x/2.x(Yarn), Hortonworks, HDFS, MapReduce, HBase, Pig, Hive, Sqoop, Flume, Avro, Spark, Oozie, Zookeeper, Cloudera desktop.

Java & J2EE Technologies: Core Java, Servlets, JSP, JDBC, JNDI, Java Beans

IDE’s: Eclipse, Net beans

Frameworks: MVC, Struts, Hibernate, Spring

Programming languages: C, C++, Java, Python, Linux

Databases: Oracle 11g/10g/9i, MySQL, DB2, MS-SQL Server

No SQL Databases: HBase, MongoDB

Web Servers: Web Logic, Web Sphere, Apache Tomcat

Web Technologies: HTML, XML, JavaScript, AJAX, SOAP, WSDL

ETL Tools: Informatica, Pentaho

Testing: Load Runner, UFT, HP ALM

PROFESSIONAL EXPERIENCE

Confidential, NC

Hadoop Developer

Responsibilities:

• Involved in various stages of Software Development Life Cycle (SDLC) during application development.
• Involved in installing and configuring various Hadoop components such as Pig, Hive, Sqoop, Flume, Oozie.
• Used Sqoop as data ingestion tool to import and export data from RDBMS to HDFS and Hive.
• Log data collected from the web servers was channeled into HDFS using Flume.
• Large data sets were analyzed using Pig scripts and Hive queries.
• Implemented bucketing concepts in Hive and Managed and External tables were designed to enhance the performance.
• Involved in developing Pig scripts to transform raw data into data that is useful to gain business insights.
• Used Sqoop to export the analyzed data for visualization and generation of reports which are given to BI team.
• Worked on Snappy compression for Avro and Parquet files.
• Configured MySQL database to store Hive metadata.
• Oozie workflow engine was installed to run multiple Hive and Pig Jobs.
• Developed Spark code using Scala and Spark-SQL/Streaming for faster testing and processing of data.
• Migration of ETL processes from RDBMS to HIVE to test easy data manipulation.
• Implemented test scripts to support test driven development and continuous integration.
• Supported QA engineers in understanding, Troubleshooting and Testing.
• Developed Spark jobs using Scala in test environment for faster data processing and used Spark SQL for querying.
• Mentored analyst and test team for writing Hive queries.
• Cluster co-ordination services through ZooKeeper.

Environment: Hadoop, HDFS, MapReduce, Hive, Pig, HBase, Sqoop, Spark, Oozie, Zookeeper, RDBMS/DB, MySQL, CSV.

Confidential, Atlanta, GA

Hadoop Developer

Responsibilities:

• Implemented shell script to automate the installation of the cluster.
• Gathered and aggregated large amount of log data using Apache Flume and stored the data in HDFS.
• Streaming of real time data using Spark with Kafka.
• Configured spark streaming data to receive real time data from Kafka and store it in HDFS.
• Developed Hive and Pig jobs to tune the performance.
• Involved in loading data from Linux file system to HDFS.
• Good knowledge on processing unstructured data using Pig.
• Involved in developing Scala programs which supports functional programming.
• Handling Avro data files by passing schema into HDFS using Avro tools and MapReduce.
• Acquired knowledge on NoSQL databases such as MongoDB.
• Worked on custom Pig loaders to work with a variety of data formats such as JSON, CSV etc.
• Created Hive Dynamic partitions to load time series data.
• Handling different types of joins in Hive like Map joins, bucker map joins and sorted bucket map joins.
• Handling continuous streaming data coming from different sources using Flume and set destination as HDFS.
• Used Log4j to log different level of logs such as WARN, INFO, DEBUG for debugging purposes.
• Actively participated in code reviews and bug fixing to enhance the performance.
• Followed Agile methodologies to finish the tasks before the deadlines.
• Experienced with CDH distribution and Cloudera Manager to manage and monitor Hadoop clusters.

Environment: Hadoop, HDFS, MapReduce, Hive, Pig, HBase, Sqoop, RDBMS/DB, MySQL, CSV, AVRO data files.

Confidential, New Jersey, NJ

Hadoop Developer

Responsibilities:

• Involved in the process of load, transform and analyze health care data from various providers into Hadoop using flume on an on-going basis.
• Data from multiple providers were filtered, transformed and combined by using Pig UDF’s based on payer filter criteria.
• Analyzed transformed data using HiveQL and Hive UDF’s to generate payer by reports for transmission to payers for payment summaries.
• Exported analyzed data to downstream systems using Sqoop-RDBMS for generating end-user reports, Business Analysis reports and payment reports.
• Created Hive tables based on the business requirements.
• Pig scripts and Hive queries were used to analyze the large data sets.
• Implemented Partitioning, Dynamic Partitions and Buckets in HIVE for efficient data access.
• Experienced in runningHadoopstreaming jobs to process terabytes of xml format data.
• Datasets with large amount of data from different hospitals and vendors were analyzed to aggregate and generate reports.
• Load and transform large sets of structured, semi structured and unstructured data.
• Developed Pig Latin scripts to extract data from the web server output files to load into HDFS
• Implemented test scripts to support test driven development and continuous integration.

Environment: Hadoop, MapReduce, HDFS, Hive, Java, HTML, XML, SQL, Eclipse IDE, SQL Server, Shell Scripting.

Confidential, IL

Java Developer

Responsibilities:

• Participated in requirements gathering for the application. Co-ordinated along with the business team to review the requirements and went through Software Requirement Specification(SRS) document.
• Participated in developing different UML diagrams such as Class diagrams, Use case diagrams and Sequence diagrams.
• Spring framework was used in developing the application which uses Model View Controller(MVC) architecture.
• Designed database connections using JDBC.
• Participated in designing and developing UI using HTML, CSS and JavaScript.
• Developed J2EE components on Eclipse IDE.
• Modifications on the database were done using Triggers, Views, Stored procedures, SQL, PL/SQL.
• Developed various data gathering forms using JSP’s, HTML, CSS.
• JDBC was used for database connectivity to SQL and to invoke stored procedures.
• Developed JavaScript code for input validations.
• Developed Action classes and DAO classes to access the database.
• Used Git version control software to monitor and track all the changes that are done to the source code.
• Used Tomcat Application Server to deploy the applications.
• Involved in Unit testing.
• Actively involved in customer interaction to strengthen customer relationship.

Environment: Oracle 11g, Java 1.5, Struts, Servlets, HTML, XML, SQL, J2EE, JUnit, Tomcat 6, MVC, JavaScript, Git.

Confidential

JAVA Developer

Responsibilities:

• Actively participated in every stage of Software Development Lifecycle (SDLC) of the project.
• Actively participated in gathering requirements that help design web pages.
• Designed and developed user interface using JSP, HTML and JavaScript for better user experience.
• Developed Struts action classes, action forms and performed action mapping using Struts framework and performed data validation in form beans and action classes.
• Extensively used Struts framework as the controller to handle subsequent client requests and invoke the model based upon user requests.
• Implemented multi-threading concept for the parallel processing of the data.
• Defined the search criteria and pulled out the record of the customer from the database. Make the required changes and save the updated record back to the database.
• Implemented validations using JavaScript for the fields on Login screen and registration page.
• Used DAO and JDBC for database access.
• Developed PL/SQL and stored procedures for oracle 11g database.
• Design and develop XML processing components to parse XML data.
• Involved in post production support and maintenance of the application.

Environment: Oracle 11g, Java 1.5, Struts, Servlets, HTML, XML, SQL, J2EE, JUnit, Tomcat 6.