SUMMARY:

• Having 7+ years of IT experience in Relational Database design, Core Java development, J2EE application development, SQL and PL/SQL Hadoop, Java, J2EE and SOA Programming ETL, Hibernate, Springs.
• Around 3+ years of IT experience as a Developer, Designer & quality reviewer with cross platform integration experience using Big data, Cloudera, Hortonworks distribution, Tez, SPARK and Scala.
• Strong experience with Hadoop components: Hive, Pig, HBase, Sqoop and Flume.
• Experience in Hadoop Distributed File System and Ecosystem (MapReduce, Pig, Hive, Sqoop and HBase)
• Implementation of Big data batch processes using Hadoop Map Reduce2, YARN, Tez, PIG and Hive.
• Analyzed large and critical datasets using Hortonworks, HDFS, HBase, MapReduce, Hive UDF, Hive, Sqoop, Oozie and Spark.
• Good working experience in using Spark SQL to manipulate Data Frames in Scala.
• Expertise in design and development of role - based security model using LDAP (Light Weight Directory Access Protocol)
• Leveraged Jersey and Google GSon libraries for REST services and JQuery for Rest calls. Utilized Java Script to update the content on the web page dynamically.
• Hands on Experience with Power BI Desktop and the Power BI Service.
• Experience in Security Hardening in Unix and Linux servers.
• Implemented automation of NSX network and AD DNS configuration. like Hadoop MapReduce(MR1), YARN(MR2), HDFS, Hive, Pig, Avro, Deflate, Flume and Sqoop.
• Experience working on NoSQL databases including Hbase and data access using HIVE.
• Experience with a variety of data formats and protocols such as JSON, and AVRO.
• Reliably process unbounded streams of data, continuous computation, ETL and real-time processing using Storm.
• Good knowledge on Integration of Mesos (DS/OS) into the Cloud Platform
• Good working experience using Sqoop to import data into HDFS from RDBMS.
• Hands on experience on apache and Cloudera Hadoop environments.
• Hands on experience on Business Intelligence tools like Power Bi and Tableau for interactive dashboards and visual analysis.
• Hands on experience in Importing and exporting data from different databases like MySQL, Oracle, Teradata, DB2 into HDFS using Sqoop
• Worked on SPARK engine creating batch jobs with incremental load through STORM, KAFKA.
• Experienced in using Flume to transfer log data files to Hadoop Distributed File System (HDFS)
• Experience in Multiple Relational Databases like Oracle 10g and NOSQL database Hbase.
• Using DataBase connect for real-time data integration between Splunk Enterprise and databases.
• Hands on experience with Hadoop, HDFS, MapReduce and Hadoop Ecosystem (Pig, Hive, Oozie, Flume and Hbase).
• Extensive experience in design, development and support Model View Controller using Struts and Spring framework.
• Ability to work effectively in cross-functional team environments and experience of providing training to business users.
• Set up Active Data Guard Configurations for oracle database 11.2.0.3 for thirty data Warehouses whose size varies from 2TB to 5TB on a 3 node RAC.

TECHNICAL SKILLS:

J AVA Technologies: Java, JDK 1.2, JDK 1.3, JDK1.4, JDK1.5, JDK1.6.

J2EE Technologies: JSP, Java Bean, Servlets, JDBC, JPA1.0, EJB3.0, JDBC, JNDI, JOLT, Amazon Cloud (S3, EC2 ).

Languages: C, C++, PL/SQL, and Java.

Frame Works: Hadoop (HDFS, Map Reduce, Pig, Hive, HBase, Mahout, Oozie, YARN, Lucene) Struts 1.x and Spring 3.x

Web Technologies: XHTML, Java Script, AngularJS, AJAX, HTML, XML, XSLT, XPATH, CSS, DOM, WSDL, GWT, JQuery, Perl, VB Script.

Application Servers: WebLogic8.1/9.1/10.x, Web-Sphere5.x/6.x/7.x, Tuxedo server 7.x/9.x, Glass Fish Server 2.x, JBoss4.x/5.x

Web Servers: Apache Tomcat 4.0/ 5.5, Java Web Server 2.0.

Operating Systems: Windows-XP/2000/NT, UNIX, Linux, and DOS

Database: SQL, Oracle 9i/10g, SQLServer, Hbase and Cassandra.

IDE: Eclipse3.x, My Eclipse 8.x, RAD 7.x and JDeveloper 10.x

Tools: Adobe, SQL Developer, Flume and Sqoop.

BI tools: Tableau, Power Bi

PROFESSIONAL EXPERIENCE:

Confidential, Bentonville, Arkansas

Hadoop Developer

Responsibilities:

• Involved in the Daily Scrum (Agile) including design of System Architecture, development of System Use Cases based on the functional requirements.
• Identify data sources, create source-to-target mapping, storage estimation, provide support for Hadoop cluster setup, data partitioning.
• Involved in gathering requirements from client and estimating time line for developing complex queries using Hive for logistics application.
• Exposure on Spark Architecture and how RDD's work internally by involving and processing the data from Local files, HDFS and RDBMS sources by creating RDD and optimizing for performance.
• Worked with different actions in Oozie to design workflow like Sqoop action, Spark action, hive action, shell action.
• Developed daily, weekly and monthly cronjobs and crontab entries for Production and Test environment.
• Involved in collecting and aggregating substantial amounts of datasets using Spark and staging data in HDFS for further analysis.
• Developing Spark programs using Scala API's to compare the performance of Spark with Hive and SQL.
• Developed Scala scripts using both RDD and Data frames/SQL/Data sets Spark API over Hortonworks Hadoop YARN to perform analytics on data in Hive for Data Aggregation, queries and writing data.
• Experience in creating aggregates, hierarchies, charts, filters, quick filters, table calculations with Power BI.
• Experience in writing Sqoop scripts to import and export data from RDBMS into HDFS and HDFS to Microsoft SQL server and handled incremental loading on the customer and transaction information data dynamically.
• Involved in converting Map Reduce programs into Spark transformations using Spark RDD's on Scala.
• Experience creating reports using BI Reporting Tools like Tableau and Power Bi.
• Prepared dashboards using calculated fields, parameters, calculations, groups, sets and hierarchies in Tableau.
• Created rich dashboards using Tableau Dashboard and prepared user stories to create compelling dashboards to deliver actionable insights
• Analyzed business process workflows and assisted in the development of ETL procedures for moving data from source to target systems.
• Published the dashboard reports to Power BI service for navigating the developed dashboards in web.
• Scheduled Oozie workflows actions to run daily using Oozie coordinator at a UDT standard time.

Environment: Hadoop, Hortonworks, HDFS, Hive, Sqoop, spark, Scala, SQL Server, Oozie, Crontab, shell scripts, RDD, Oozie workflows & coordinator, Tableau and Power Bi.

Confidential, Phoenix, Arizona

Hadoop Developer

Responsibilities:

• Defined, designed and developed Java applications, specially using Hadoop Map/Reduce by leveraging frameworks such as Cascading and Hive.
• Leading and coordinating with offshore development team for development and unit testing
• Developed workflow using Oozie for running Map Reduce jobs and Hive Queries.
• Worked on loading log data directly into HDFS using Flume.
• Created managed service offerings for several open source tools, including Hadoop, Spark, Mesos targeting cloud development and analytics use cases.
• Involved in extracting the Big data from Teradata into HDFS using Sqoop
• This plugin allows Hadoop MapReduce programs, HBase, Pig and Hive to work unmodified and access files directly.
• Involved in analyzing existing architecture on premise datacenters and designed to migrate applications from on prem to AWS(Amazon Web Services) Public Cloud.
• Created tables in Teradata to export the data from HDFS using Sqoop after all the transformations and wrote
• Design roles and groups for users and resources using AWS Identity Access Management (IAM).
• Worked on Git for version control, JIRA for project tracking and Jenkins for continuous Integration.
• Designed and implemented MapReduce -based large-scale parallel relation-learning system
• Developed data pipeline using Kafka and Storm to store data in to HDFS.
• Extracted files from MySQL through Sqoop and placed in HDFS and processed.
• Built reusable Hive UDF libraries for business requirements which enabled users to use these UDF's in Hive Querying.
• Implemented custom apps in Docker on Mesos, managed by Marathon
• Imported data frequently from Teradata to HDFS using Sqoop.
• Worked on debugging, performance tuning of Hive & Pig Jobs.
• Created Hbase tables to store various data formats of PII data coming from different portfolios.
• Developed Pig Scripts, Pig UDFs and Hive Scripts, Hive UDFs to load data files into Hadoop
• Applications are built using AWS Cloud formation templates (json).
• Knowledgeable in SPARK and Scala Framework exploration for transition from Hadoop/MapReduce to SPARK.
• Worked closely on parallel computing with SPARK team to explore RDD in Datastax Cassandra.
• Writing entities in Scala and Java along with named queries to interact with database
• Writing scala test cases to test scala written code.
• Developed automated processes that run daily to check disk usage and perform cleanup of file systems on UNIX environments using shell scripting and CRON.

Environment: Hadoop, HDFS, Pig, Sqoop, scala, Teradata, HBase, Mesos, Shell Scripting, AWS, Maven, Hudson/Jenkins, Ubuntu, Red Hat, Mongo DB.

Confidential, Ashburn VA

Hadoop Developer

Responsibilities:

• Involved in design and development phases of Software Development Life Cycle ( SDLC ) using Scrum methodology.
• Worked on analysing Hadoop cluster using different big data analytic tools including Pig, Hive, and MapReduce .
• Involved in implementing security on Hortonworks Hadoop Cluster using with Kerberos by working along with operations team to move non-secured cluster to secured cluster.
• Experience in installation, configuration, supporting and monitoring Hadoop clusters using Apache, Cloudera distributions and AWS. Involved in converting Hive/SQL queries into Spark transformations and actions using Spark SQL (RDDs and Data frames) in Python and Scala.
• Successfully upgraded the Hortonworks HDP from 2.2.4.2 to 2.3.6
• Designed and built the Reporting Application, which uses the SPARK SQL to fetch and generate reports on HBase table data.
• Extracted the needed data from the server into HDFS and Bulk Loaded the cleaned data into HBase.
• Worked closely on parallel computing with SPARK team to explore RDD in Datastax Cassandra.
• Responsible for creating Hive tables, loading the structured data resulted from MapReduce jobs into the tables and writing Hive queries to further analyze the logs to identify issues and behavioral patterns.
• Involved in running MapReduce jobs for processing millions of records.
• Involved in scheduling Oozie workflow engine to run multiple Hive and Pig jobs
• Developed Hive queries and Pig scripts to analyze large datasets.
• Involved in importing and exporting the data from RDBMS to HDFS and vice versa using Sqoop.
• Involved in generating the Adhoc reports using Pig and Hive queries.
• Used Hive to analyze data ingested into HBase by using Hive-HBase integration and compute various metrics for reporting on the dashboard.
• Developed job flows in Oozie to automate the workflow for Pig and Hive jobs. Loaded the aggregated data onto Oracle from Hadoop environment using Sqoop for reporting on the dashboard

Environment: Red Hat Linux, HDFS, Hortonworks, Map-Reduce, Hive, Java JDK1.6, Pig, Sqoop, Flume, Zookeeper, Oozie, Oracle, HBase.

Confidential

Java Developer

Responsibilities:

• As part of the lifecycle development prepared class model, sequence model and flow diagrams by analysing Use cases using Rational Tools.
• Reviewing and analyzing data model for developing the Presentation layer and Value Objects.
• Involved in developing Database access components using Spring DAO integrated with Hibernate for accessing the data.
• Extensive use of Struts Framework for Controller components and view components.
• Involved in writing the exception and validation classes using Struts validation rules.
• Involved in writing the validation rules classes for general server-side validations for implementing validation rules as part observer J2EE design pattern.
• Developed REST API's for user profile and other application support services.
• Used Spring AOP and Dependency injection during various modules of project.
• Implemented Service Oriented Architecture (SOA) using JMS for sending and receiving messages while creating web services.
• Create Web services using REST for consumption of data testing with Postman
• Developed various java objects (POJO) as part of persistence classes for OR mapping.
• Developed web services using SOAP and WSDL with Axis.
• Implemented EJB (Message Driven Beans ) in the Service Layer.
• Responsible for the architecture and design of the data storage tier for this third-party provider of data warehousing, data mining and analysis.
• Involved in working with JMS MQ Queues (Producers/Consumers) in Sending and Receiving Asynchronous messages via MDB’s.
• Developed SQL stored procedures and prepared statements for updating and accessing data from database.
• Used JBoss for deploying various components of application and MAVEN as build tool and developed build file for compiling the code of creating WAR files.
• Used CVS for version control.
• Performed Unit testing and rigorous integration testing of the whole application.

Environment: Java, J2EE, EJB, JMS, Strut, JBoss, Hibernate, JSP, JSTL, AJAX, CVS, Java Script, HTML, XML, MAVEN, SQL, Oracle, SOA, SAX and DOM Parser, Web services (SOAP, WSDL), Spring, Windows.

Confidential

Java Programmer

Responsibilities:

• Involved in preparation of functional definition documents and Involved in the discussions with business users, testing team to finalize the technical design documents.
• Enhanced the Web Application using Struts.
• Created business logic and application in Struts Framework using JSP, and Servlets.
• Documented the code using Java doc style comments.
• Wrote Client-side validation using Struts Validate framework and JavaScript.
• Wrote unit test cases for different modules and resolved the test findings.
• Implemented SOAP using Web services to communicate with other systems.
• Wrote JSPs, Servlets and deployed them on WebLogic Application server.
• Developed automated Build files using Maven.
• Installed and configured 2 Node RAC on 10gR2 and Upgraded databases using Database Upgrade Assistance (DBUA)
• Spring framework was used for dependency injection and was integrate with different frameworks like Struts, Hibernate
• Used Subversion for version control and log4j for logging errors.
• Wrote Oracle PL/SQL Stored procedures, triggers.
• Helped production support team to solve trouble reports
• Involved in Release Management and Deployment Process.

Environment: Java, J2EE, Struts, JSP, Servlets, JavaScript, Hibernate, SOAP, WebLogic, Log4j, Maven, CVS, PL/SQL, Oracle, Windows.