SUMMARY:

• Around 5+ years of experience in IT industry which includes 3 years of experience in Big Data and Hadoop Ecosystem like PIG, HIVE, SPARK, SQOOP, OOZIE, KAFKA, IMPALA,HBASE, JIRA, ZOOKEEPER and FLUME.
• 2+ years of experience in JAVA programming with various technologies like Java, J2EE, JavaScript and Data Structures, JDBC, HTML, XML, Junit, JQuery, Struts MVC, JSP, Servlets.
• Excellent understanding / knowledge of Big Data and Hadoop architecture.
• Hands on experience in installing, configuring, and using Hadoop ecosystem components like Hadoop MapReduce, HDFS, HBase, Hive, Spark, Kafka, Sqoop, Pig, Storm, Zookeeper, Oozie and Flume.
• Experienced in data loading andretrieving from different data sources into HDFS systems using Kafka producers, consumers and Kafka brokers.
• Experience in working with different Spark components like Spark transformations, Mlib, Streaming and Spark QL.
• Good experience in writing Map Reduce jobs using Java native code, Pig, Hive for various business use cases.
• Built multiple POCs using NoSQL database clusters like Cassandra, MongoDB and HBase.
• Experience in developing customized UDF’s in java to extend Hive and Pig Latin functionality.
• Good knowledge of Oozie concepts like design, development, and execution of workflows in Oozie.
• Developed various UNIX Shell and Python scripts to automate various Processes & good experience in resolving errors making enhancements to existing scripts. Experience in managing Hadoop cluster using Cloudera Manager.
• Hands on experience with Amazon EMR, Cloudera (CDH4 & CDH5), and Horton WorksHadoop Distributions.
• Implemented the industry's largestDataLakeon theBigDataplatform. Sourced and loaded Petabyte ofdatafrom multiple source system to create enterprisedatahub to support needs of various Business Units and programs.
• Have experience in installing, configuring and using various Hadoop distributions like Cloudera and Horton Works.
• Used Spark API over ClouderaHadoopYARNto perform analytics on data in Hive.
• Upgrade ofRHELand HDP by redesigning of existing server and HDP cluster.
• Knowledge of Data Warehousing and Analytics, Data migration, Data profiling, ETL Processes and Data mining.
• Well versed in designing and implementing MapReduce jobs using JAVA on Eclipse to solve real world scaling problems.
• Responsible for upgradingHortonworksHadoopHDP2.3.0 and Mapreduce 2.0 with YARN in Multi Clustered Node environment
• Exploring with the SPARK improving the performance and optimization of the existing algorithms inHadoopusing SPARK CONTEXT, SPARK - SQL, DATA FRAME, PAIR RDD'S, SPARKYARN.
• Experience in Object Oriented Analysis, Design (OOAD) and development of software using UML Methodology, good knowledge of J2EE design patterns and Core Java design patterns.
• Experience in back-end procedure development, for RDBMS, Database Applications using SQL and PL/SQL. Hands on experience on writing Queries, Stored procedures, Functions and Triggers by using SQL.
• Hands on experience working with Non-Relational and NoSQLdatabases.
• Implemented connectivity to database using JDBC API from Servlets and JSP through Java Beans & Enterprise Java Beans (EJB).
• Skilled in numerous SDLCmethodologies, including Agile Scrum, XP and RUP.
• Experience with operating systems: Windows, Solaris, Red-hat, CentOS,MacOS and Ubuntu.
• Excellent interpersonal and communication skills, creative, research-minded, technically competent and result-oriented with problem solving and leadership skills.

TECHNICAL SKILLS:

Hadoop/Big Data: HDFS, MapReduce, YARN, HBase, Spark, Kafka, Flume, Pig, Hive, Impala Sqoop, Flume, Oozie, Zookeeper, Jira.

Hadoop Distributions: Cloudera (CDH3, CDH4, and CDH5), Hortonworks and Map Reduce.

Java: Core Java, Servlets, JSP, JDBC, Java Beans, Jenkins.

Development tools: Eclipse, Maven, Ant, JUNIT, Log4j.

Code Repository: Subversion, GitHub

DB Languages: MySQL, Oracle, SQL Server, PL/SQL.

Programming languages: Java, Python, Scala, Linux shell scripts.

Operating Systems: Linux, Unix, Windows, MacOS.

Applications: MS Office - Excel, Word, PowerPoint, Visio, Outlook, Lync, OneNote and Access, Teradata SQL Assistant, Toad for Data Analyst, VersionOne

PROFESSIONAL EXPERIENCE:

Confidential, Charlotte, NC

Application Developer (Sr. Hadoop Developer)

Responsibilities:

• Developed Mapreduce programs to perform extraction, transformations and load operations.
• Written Hive and SparkUDFs to perform day to day data validations, Quality Analysis and counters during imports and exports
• Involved in developing HIVE DDLS to create, alter and drop Hive tables andstorm.
• Developed a data pipeline using Kafka andStormto store data into HDFS
• Experience in integrating Apache Kafka with ApacheStormand createdStormdata pipelines for real time processing.
• Used Scala in Spark programs to improvise the report generation, data traceability and data quality checks.
• Developed scripts to perform analytics on data in Hive using Spark API over Cloudera Hadoop YARN.
• Developed Scala scripts, UDFs using both Data frames/SQL and RDD/MapReduce in Spark 1.6 for Data Aggregation, queries and writing data back into OLTP system through Sqoop.
• Experienced in performance tuning of Spark Applications for setting right Batch Interval time, correct level of Parallelism and memory tuning.
• Loaded the data into Spark RDD and do in memory data Computation to generate the Output response.
• Optimizing of existing algorithms in Hadoop using Spark Context, Spark-SQL, Data Frames and Pair RDD's.
• Implemented ELK (Elastic Search, Log stash, Kibana) stack to collect and analyze the logs produced by the spark cluster.
• Performed advanced procedures like text analytics and processing, using the in-memory computing capabilities of Spark using Scala.
• Experienced in handling large datasets using Partitions, Spark in Memory capabilities, Broadcasts in Spark, Effective & efficient Joins, Transformations and other during ingestion process itself.
• Worked on migrating Map Reduce programs into Spark transformations using Spark and Scala.
• Created many B-teq scripts to perform insert,delete and update operations in Teradata.
• Developed Oozie/Sqoop job to import data from multiple RDBMS sources like Teradata, SQLServer and Netezza using JDBC drivers with parallel load processes and export to HDFS location as well as Linux file systems.
• Worked in On-Call Production Support to provide L3 support during Monthly and Quarterly releases.
• Experience in creating, managing and deploying release branches, tags across multiple systems using Jenkins, SVN and ShellScripts
• Hands-on experience with versioncontrol and codedeployment and troubleshooting.
• Have a working knowledge with Hadoop security components like Kerberos and Sentry architectures.
• Have hands on experience with Python coding and its integration with oozie workflows.
• Build Hadoop sandbox environments with components like Hive, Sqoop, Pig to work with other RDMSs and applications such as Teradata, SAS, R and SQL Server to provide the Hadoop exposure and introduction to the business users.
• Handled importing of data from various sources, performed transformations using Pig and loaded data into HDFS and Extracted the data from SQL Server and Teradata into HDFS using Sqoop.
• Performed importing data from various sources to theCassandracluster using Java/Python APIs.
• Build POCs like sourcing data from HDFS to generate monthly reports and infographics, data tracing and data quality for every month that can be included to our in-house Web Portal as new features so that Business Users will have better transparency without any manual interventions.

Environment: CDH 5.8.3, HDFS, MapReduce, Hive, Oozie, Sqoop, Spark, Jenkins, Teradata, SQL Server, Subversion,Eclipse Mars.2, JDk 1.8.0 101 and Autosys

Confidential, Scottsdale, AZ

Hadoop Consultant/Admin

Responsibilities:

• Developed Map Reduce application using Hadoop Mapreduce programming, a framework for processing.
• Injected large data sets in parallel across the Hadoop cluster for pre-processing.
• Hands on exxperience with continuous monitoring and managing of Hadoop cluster using Cloudera Manager.
• Developed Map Reduce programs to process the different file formats for performing transformations.
• Developed Map Reduce Program to analyze the production log files for application issues and performances.
• Experienced in implementing different kind of joins to integrate data from different data sets like Map and reduce side join.
• Implemented Map Reduce programs to handle semi/unstructured data like text, xml, json files.
• Developed the code for Importing and exporting data into HDFS and Hive using Sqoop.
• Responsible for writing Hive Queries for analyzing data in Hive warehouse using Hive Query Language (HQL).
• Extensive hands on experience with HBaseand Cassandra.
• Configured HBase for automatic sharding of tables, automatic failover support between RegionServers.
• Created integration between Cassandra and Hadoop clusters for analytic jobs.
• Involved in defining job flows using Oozie for scheduling jobs to manage apache Hadoop jobs
• Importing data from Oracle to HDFS & Hive for analytical purpose.
• Analyzing imported data in HDFS & Hive using HiveQL and custom Map Reduce programs in Java
• Developing Hive User Defined Functions in java, compiling them into jars and adding them to the HDFS and executing them with Hive Queries.
• Responsible to manage data coming from different sources.
• Assisted in monitoring the Hadoop cluster using Ganglia tool.
• Tested and reported defects in an Agile Methodology perspective.
• Consolidate all defects, report it to PM/Leads for prompt fixes by development teams and drive it to closure.

Environment: Hadoop, HDFS, MapReduce, Hive, Oozie, MongoDB, Java (jdk1.6), NoSQL, MySQL, SQL, Perl and Ganglia.

Confidential, Dallas, Texas

Java Developer

Responsibilities:

• Developed programs by following the Agile methodology.
• Involved in the implementation of design using vital phases of the Software development life cycle (SDLC) that includes Development, Testing, Implementation and Maintenance Support.
• Applied OOAD principles for the analysis and design of the system.
• Used WebSphere Application Server to deploy the build.
• Developed front-end screens using AJAX,JSP, HTML, JQuery, Java Web Services and CSS.
• Used Spring Framework for developing business objects.
• Performed data validation in Struts Form beans and Action Classes.
• Used Eclipse for the Development, Testing and Debugging of the application.
• Used DOM Parser to parse the xml files.
• Log4j framework has been used for logging debug, info & error data.
• Used Oracle 10g Database for data persistence.
• SQL Developer was used as a database client.
• Used WinSCP to transfer file from local system to other system.
• Performed Test Driven Development (TDD) using JUnit.
• Used Ant script for build automation.
• Used Rational ClearQuest for defect logging and issue tracking.

Environment: Windows XP, UNIX, Java5.0, Design Patterns, Web sphere, AJAX, J2EE (Servlets, JSP), HTML, JSON, JavaScript, Java Web Services, CSS, Eclipse, SQL Server,JUnit.

Confidential, Marlborough, MA

JAVA/J2EE Developer

Responsibilities:

• Developed activity, sequence and class diagrams using Unified Modeling Language and RationalRose.
• Developed HTML and JSP pages using Struts.
• Developed Controller Servlets, Action and Form objects for process of interacting with Oracle databaseand retrieving dynamic data.
• Responsible for coding SQL Statements and Stored procedures for back end communication using JDBC.
• Used Apache Log4J logging API to log errors and messages.
• Developed XML parser for File parsing.
• Involved in writing Detail Design Documents with UML Specifications.
• Involved in unit testing and system testing and also responsible for preparing test scripts for the system testing.
• Responsible for packaging and deploying components in to the WebSphere.
• Developed backend components, DBScripts for the backend communication.
• Responsible for performance tuning of the product and eliminating memory leakages in the product.

Environment: Java, Java Beans, JSP, Servlets, JDBC, LOG4J, IBM DB2, XML, HTML, Struts 1.2, Web Sphere, CVS