SUMMARY

• 7+years of professional experience in developing, implementing, configuring, testing Hadoop ecosystem components and maintenance of various web based applications using Java, J2EE.
• More than 3 years of experience as Hadoop Developer with sound knowledge in Hadoop ecosystem technologies.
• Good knowledge of hadoop daemons like NameNode, Secondary NameNode, DataNode, Job Tracker and Task Tracker.
• Excellent understanding of distributed storage systems like HDFS and batch processing systems like Mapreduce and Yarn.
• Experience in developing efficient MapReduceprograms.
• Experience in using MRUnit to analyze the data and testing the MapReduce jobs.
• Experience in using HiveQLfor analyzing, querying and summarizing data.
• Good understanding ofNoSQL databases likeCassandra,Hbase and MongoDB.
• Experience in fetching data into HDFSfrom various databases like MySQL, Oracle,DB2using Sqoop.
• Experience in collecting, aggregating and loading log files into HDFS usingApacheFlume.
• Experience in working with file formats like Parquet, Avro, RCFile etc.
• Experience in using PigLatin for manipulating data.
• Used Pig as ETL tool to do transformations, event joins, filter and some pre - aggregation.
• Experience in writingPig scripts, Pig Latin UDFs and Hive UDFs to load data files.
• Experience in scheduling and monitoring job work flows using Oozieand Zookeeper.
• Good understanding in processing of real-time data using Sparkand Scala.
• Experience in using Apache Solr for indexing and load balanced querying.
• Experience in working with different Hadoop distributions like CDH and Hortonworks.
• Handson experience in working with real time streaming applications using Spark Streaming and Storm.
• Good knowledge of integrating SparkStreaming with Kafkafor real time processing of streaming data.
• Experience in using build management tools likeMaven and Ant.
• DevelopedETL job inTalend to load data from ASCII, Flat files.
• Hands on Evaluation of ETL (Talend) and OLAP tools and recommend the most suitable solutions based on business requirements.
• Experience in generating reports using Tableauby connecting to Hive.
• Hands on experience on UNIX scripting.
• Knowledge on AWS (Amazon EC2) Hadoop distribution.
• Experience in using Kerberose for authenticating the end users using hadoop in a secure mode.
• Expertise in design and development of Web Applications involving J2EE technologies with Java, Spring, EJB, Servlets, JSP, Struts, Web Services, XML, JMS, JDBC and etc.
• Experience in using Eclipse and NetBeansIDE’s.
• Extensive experience in using Relational databases like Oracle, SQLServer, DB2 and MySQL.
• Expertise in using Tomcat serverand also application servers like JBoss and WebLogic.
• Experience in all phases of software development life cycle.
• Support development, testing, and operations teams during new system deployments.

TECHNICAL SKILLS

Programming Languages: C,C++, Java,Python,Scala.

Hadoop Eco System: HDFS, Map Reduce, Hive, Pig, Sqoop, Flume,Zookeeper, Oozie, Kafka, Storm, Spark, Impala.

Database: MySQL, Oracle,SQL Server,DB2.

NoSQL Databases: HBase, Cassandra,MongoDB.

Scripting Languages: HTML, CSS, JavaScript, XML.

Tools:, Technologies and Utilities: Servlets,Struts,JDBC, JSP, Web Services.

Operating Systems: Windows XP/7/8, 10, LinuxRedHat/Ubuntu/CentOS.

Cluster Monitoring Tools: HortonWorks,ClouderaManager.

Web/ App Servers: Apache Tomcat Server, JBOSS, WebLogic.

IDE's: Eclipse,Microsoft Visual Studio, Net Beans.

PROFESSIONAL EXPERIENCE

Confidential - EdenPrairie,MN

Hadoop Developer

Responsibilities:

• Imported data from RDBMS to HDFS using Sqoop.
• Managed data coming from different sources and involved in HDFS maintenance and loading of structured and unstructured data.
• Developed MapReduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables in HDFS.
• Performed storing ofSolr indexes in HDFS.
• Performed several aggregation logics using SparkandScalain the backend.
• Helped market analysts by creating Hive queries to spot the emerging trends by comparing fresh data with HDFS reference tables and historical metrics.
• Defined the job flows in Oozie to automate the process of data loading into the HDFS and PIG.
• Designed HBase schema to avoid Hotspotting and exposed the data from HBase tables to RESTAPI on UI.
• Transformed raw data from several data sources into baseline data by developing Pig scripts and loaded the data into HBase tables.
• Involved in creating POCs to ingest and process streaming data using Spark streaming and Kafka.
• Automated the batch processing by developing Shell Scripts and processed the daily jobs through Maestro scheduler.
• Involved in Configuring Hadoop components like Hive, Pig, HBase, Spark, Sqoop, Oozie and Hue in the client environment
• Co-ordinated with the cross-functional team to ensure that applications are properly tested, configured, and deployed.

Environment: HDFS, YARN, Pig, Hive, HBase, Spark, Scala, Solr, Sqoop, Oozie, Linux, Maven, Git, Jenkins.

Confidential - Lyndhurst, NJ

Hadoop Developer

Responsibilities:

• Pre-processed large sets of structured and semi-structured data, with different formatslike Text Files, Avro, SequenceFiles, and JSON Record.
• Involved in Preparing the Design Documentslike Sequence Diagrams, External Design Report & Internal Design Report.
• Worked on POCs and involved in fixing performance & storage issues using different Compression Techniques, Custom Combiners and Custom Partitioners.
• Involved in Developing Hive scripts to parse the raw data, populate staging tables and store the refined data in partitioned tables in the Hive.
• Developed utility classes in Hive using UDFs.
• Developed scripts to automatically transfer several hundreds of tables from Hive to MySQL using Sqoop.
• Fixed various issues in data transformation in Hive and Sqoop.
• Worked with HBase, a NoSQL database for POC in storing URL's and images - semi structured and unstructured data coming from UNIX and a variety of portfolios.
• Used MRUnit for testing raw data and executed performance scripts.
• Assisted with data capacity planning and node forecasting.
• Analyzed Migration plans for various versions of ClouderaDistribution of ApacheHadoopto draw the impact analysis, and proposed the mitigation plan for the same.
• Experience in analyzing the latest versions, solutions, and software in theHadoopEcoSystem and proposing them to the stakeholders with the proven solutions for the better architecture of the project

Environment: Hadoop, Hive, Hbase, SQOOP, Oozie, Java, Unix, MySQL,Cloudera,Maven, git.

Confidential - Naples, FL

Hadoop Developer

Responsibilities:

• Performed importing of data from different data sources, did transformations using Hive and Map Reduce.
• Loaded data into HDFSfrom RDBMSusing Sqoop.
• Responsible for Managing and scheduling jobs on a Hadoopcluster.
• Performed data cleaning and preprocessing by using MapReduce.
• Wrote Hivequeries andPigscripts for analyzing the data to know the customer behavior.
• Implemented Partitioning and bucketing in Hive.
• Provided support to the analyst and test team for writing Hive Queries.
• Generated final reporting data using Tableau for testing by connecting to the corresponding Hive tables using HiveODBC connector.
• Performed data cleansingusing Pig.
• Used Sqoop to export the analyzed data to the relational databases for visualization and also to generate reports for the BI team.
• Pre-processed the data using PigUDFs for analysis.
• Automated the process of loading the data into HDFS by developing Oozie workflows.
• Monitored System health logs and responded accordingly to any warning or failure conditions.
• Managed and reviewedHadooplog files.

Environment: Cloudera, Hadoop,MapReduce, HDFS,Sqoop, Hive, Pig, Oozie, Linux, XML,Tableau, Java

Confidential

Java Developer

Responsibilities:

• Involved in Requirement analysis and design, development of the application using Java Technologies.
• Developed the login screen so that the application can be accessed only by authorized and authenticated administrators.
• UsedHTML, CSS, JSP'sto design and develop front end and used Java Script to perform user validation.
• Performed Designing, developing, and configuring server side J2EE components like EJB, Java Beans, and Servlets.
• Involved in Creating tables, functions, triggers, sequences and stored procedures in PL/SQL.
• Implemented business logic by developing Session Beans.
• Used JDBC-API to communicate with the Database.
• Used tomcat server to deploy the application.
• Developed application using Waterfall model software methodology.
• Involved In technical documentation of project.

Environment: Java, HTML, CSS, JSP, Servlets, EJB, JDBC, PL/SQL, Tomcat, Oracle8i.

Confidential

Associate Java Developer

Responsibilities:

• Used struts MVC Architecture to develop the modules.
• Developed The UI using JavaScript, JSP, HTML, and CSS for interactive cross browser functionality and complex user interface.
• UsedServlets and Session beansfor creating Business Logic and deployed them on Weblogic server.
• Application design using MVCstruts framework.
• Developed complex SQL Queries and PL/SQL Stored procedures.
• Prepared the Functional, Design and Test case specifications.
• Performed some database side validations by writing Stored Procedures in Oracle.
• Used JUNIT for unit testing of the application.
• Provided Technical support for production environments resolving the issues, analyzing the defects, providing and implementing the solution defects. Resolved more priority defects as per the schedule.

Environment: Java, HTML, Java Script, CSS, Oracle, JDBC, Swing and Eclipse.