SUMMARY

• Around 9 years of IT experience in software analysis, design, development, testing and implementation of Big D Confidential, Hadoop, NoSQL and Java/J2EE technologies.
• Experience in writing SQL, PL/SQL queries, Stored Procedures for accessing and managing d Confidential bases such as Oracle, SQL MySQL, and Confidential DB2.
• Good working experience in using Spark SQL to manipulate D Confidential Frames in Python.
• Good knowledge in NoSQL d Confidential bases including Cassandra and MongoDB.
• A very good experience in developing and deploying the applications using Weblogic, Apache Tomcat, and JBoss.
• Extensive knowledge of Terad Confidential utilities (BTEQ, Fastload, Fast Export, Multiload Update/Insert/Delete/Upset)
• Good experience in Hive partitioning, bucketing and perform different types of joins on Hive tables and implementing Hive SerDe like JSON and Avro.
• Experience with build tool ANT, Maven and continuous integrations like Jenkins.
• Working experience in Development, Production and QA Environments.
• Experience in NoSQL Column - Oriented D Confidential bases like HBase and its Integration with Hadoop cluster.
• Hands on experience with Big D Confidential Ecosystems including Hadoop, MapReduce, Pig, Hive, Impala, Sqoop, Flume, Oozie, MongoDB, Zookeeper, Kafka, Maven, Spark, Scala, HBase, Cassandra.
• Experience in installation, configuration and deployment of Big D Confidential solutions.
• Extensive hold over Hive and Pig core functionality by writing Pig Latin UDFs in Java and used various UDFs from Piggybanks and other sources.
• Hands on experience with NoSQL D Confidential bases like HBase, Cassandra and relational d Confidential bases like Oracle and MySQL.
• Defined real time d Confidential streaming solutions across the cluster using Spark Streaming, Apache Storm, Kafka, Nifi and Flume.
• Experience in working with Developer Toolkits like Force.com IDE, Force.com Ant Migration Tool, Eclipse IDE, Mavens.
• Proficient in Java, Collections, J2EE, Servlets, JSP, spring, Hibernate, JDBC/ODBC.
• Knowledge on implementing Big D Confidential in Amazon Elastic MapReduce (Amazon EMR) for processing, managing Hadoop framework dynamically scalable Amazon EC2.
• In depth knowledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, D Confidential Node.
• Experience with Amazon Web Services, AWS command line interface, and AWS d Confidential pipeline.
• Experience in Front-end Technologies like HTML, CSS, HTML5, CSS3, and AJAX.
• Experience in the Software Development Life Cycle (SDLC) phases which include Analysis, Design, Implementation, Testing and Maintenance.
• Strong technical, administration and mentoring knowledge in Linux and Big d Confidential /Hadoop technologies.
• Expertise in J2EE technologies like JSP, Servlets, EJBs, JDBC, JNDI and AJAX.
• Expertise in applying Java Messaging Service (JMS) for reliable information exchange across Java applications.
• Good usage of Apache Hadoop along enterprise version of Cloudera and Hortonworks.
• Good Knowledge on MAPR distribution & Amazon's EMR.
• Execute faster MapReduce functions using Spark RDD for parallel processing or referencing a d Confidential set in HDFS, HBase and other d Confidential sources
• Good experience working on analysis tool like Tableau for regression analysis, pie charts, and bar graphs.
• Expertise in developing Spark code using Scala and Spark-SQL/Streaming for faster testing and processing of d Confidential .
• Experience with Apache Spark ecosystem using Spark-SQL, D Confidential Frames, RDD's and knowledge on Spark MLlib.
• A very good understanding of job workflow scheduling and monitoring tools like Oozie and Control-M.

TECHNICAL SKILLS:

Hadoop/Big D Confidential Technologies: Hadoop 3.0, HDFS, MapReduce, HBase 1.4, Apache Pig, Hive 2.3, Sqoop 1.4, Apache Impala 2.1, Oozie 4.3, Yarn, Apache Flume 1.8, Kafka 1.1, Zookeeper

Cloud Platform: Amazon AWS, EC2, EC3, MS Azure, Azure SQL D Confidential base, Azure SQL D Confidential Warehouse, Azure Analysis Services, HDInsight, Azure D Confidential Lake, D Confidential Factory

Hadoop Distributions: Cloudera, Hortonworks, MapR

Programming Language: Java, Scala, Python 3.6, SQL, PL/SQL, Shell Scripting, Storm 1.0, JSP, Servlets

Frameworks: Spring 5.0.5, Hibernate 5.2, Struts 1.3, JSF, EJB, JMS

Web Technologies: HTML, CSS, JavaScript, JQuery 3.3, Bootstrap 4.1, XML, JSON, AJAX

D Confidential bases: Oracle 12c/11g, SQL

Operating Systems: Linux, Unix, Windows 10/8/7

IDE and Tools: Eclipse 4.7, NetBeans 8.2, IntelliJ, Maven

NoSQL D Confidential bases: HBase 1.4, Cassandra 3.11, MongoDB, Accumulo

Web/Application Server: Apache Tomcat 9.0.7, JBoss, Web Logic, Web Sphere

SDLC Methodologies: Agile, Waterfall

Version Control: GIT, SVN, CVS

WORK EXPERIENCE:

Confidential

Sr. Developer

Responsibilities:

• As a Sr. Big D Confidential /Hadoop Developer worked on Hadoop eco-systems including Hive, MongoDB, Zookeeper, Spark Streaming with MapR distribution.
• Developed Big D Confidential solutions focused on pattern matching and predictive modeling
• Involved in Agile methodologies, daily scrum meetings, spring planning.
• Designed solution for various system components using Microsoft Azure.
• Worked on d Confidential ingestion using Sqoop from HDFS to Relational D Confidential base Systems and vice-versa. Maintaining and troubleshooting
• Exploring with Spark to improve the performance and optimization of the existing algorithms in Hadoop using Spark context, Spark-SQL, D Confidential Frame, pair RDD's.
• Created Hive Tables, loaded claims d Confidential from Oracle using Sqoop and loaded the processed d Confidential into target d Confidential base.
• Involved in PL/SQL query optimization to reduce the overall run time of stored procedures.
• Exported d Confidential from HDFS to RDBMS via Sqoop for Business Intelligence, visualization and user report generation.
• Developed Nifi flows dealing with various kinds of d Confidential formats such as XML, JSON, Avro.
• Developed and designed d Confidential integration and migration solutions in Azure.
• Worked on Proof of concept with Spark with Scala and Kafka.
• Worked on visualizing the aggregated d Confidential sets in Tableau.
• Worked on importing d Confidential from HDFS to MYSQL d Confidential base and vice-versa using SQOOP.
• Implemented MapReduce jobs in HIVE by querying the available d Confidential .
• Configured Hive meta store with MySQL, which stores the metad Confidential for Hive tables.
• Performance tuning of Hive queries, MapReduce programs for different applications.
• Proactively involved in ongoing maintenance, support and improvements in Hadoop cluster.
• Developed Spark code using Scala and Spark-SQL/Streaming for faster testing and processing of d Confidential .
• Used Cloudera Manager for installation and management of Hadoop Cluster.
• Developed d Confidential pipeline using Flume, Sqoop, Pig and Java MapReduce to ingest customer behavioral d Confidential and financial histories into HDFS for analysis.
• Collaborated with business users/product owners/developers to contribute to the analysis of functional requirements.
• Worked on MongoDB, HBase d Confidential bases which differ from classic relational d Confidential bases
• Involved in converting HiveQL into Spark transformations using Spark RDD and through Scala programming.
• Primarily involved in D Confidential Migration process using Azure by integrating with Github repository and Jenkins.
• Upgraded the Hadoop Cluster from CDH3 to CDH4, setting up High Availability Cluster and integrating Hive with existing applications.
• Designed & Developed a Flattened View (Merge and Flattened d Confidential set) de-normalizing several D Confidential sets in Hive/HDFS which consists of key attributes consumed by Business and other down streams.
• Worked on NoSQL support enterprise production and loading d Confidential into HBase using Impala and Sqoop.
• Performed multiple MapReduce jobs in Pig and Hive for d Confidential cleaning and pre-processing.
• Build Hadoop solutions for big d Confidential problems using MR1 and MR2 in YARN.
• Handled importing of d Confidential from various d Confidential sources, performed transformations using Hive, PIG, and loaded d Confidential into HDFS.
• Involved in identifying job dependencies to design workflow for Oozie & YARN resource management.
• Integrated Kafka-Spark streaming for high efficiency throughput and reliability
• Worked on Apache Flume for collecting and aggregating huge amount of log d Confidential and stored it on HDFS for doing further analysis.
• Worked in tuning Hive & Pig to improve performance and solved performance issues in both scripts
• Worked on analyzing Hadoop cluster and different big d Confidential analytic tools including Pig, HBase d Confidential base and Sqoop.

Environment: Agile, Hadoop 3.0, Pig 0.17, HBase, Sqoop, Azure, Hive 2.3, HDFS, NoSQL, Impala, YARN, PL/SQL, Nifi, XML, JSON, Avro, Spark Kafka, Tableau, MySQL, Apache Flume 2.3

Confidential

Sr. Confidential

Responsibilities:

• Involved in all phases of Software Development Life Cycle (SDLC) using Agile.
• Responsible for building and configuring distributed d Confidential solution using MapR distribution of Hadoop.
• Involved in complete Big D Confidential flow of the application d Confidential ingestion from upstream to HDFS, processing the d Confidential in HDFS and analyzing the d Confidential .
• Involved in Agile methodologies, daily scrum meetings, sprint planning.
• Wrote multiple MapReduce programs in Java for d Confidential extraction, transformation, and aggregation from multiple file formats.
• Worked with Kafka streaming tool to load the d Confidential into HDFS and exported it into MongoDB d Confidential base.
• Responsible for importing log files from various sources into HDFS using Flume.
• Developed mappings to extract d Confidential from Oracle, Terad Confidential, Flat files, XML files, Excel and load.
• Analyzed Hadoop cluster and different Big D Confidential including HBase and Cassandra.
• Created RDD's and applied d Confidential filters in Spark and created Cassandra tables and Hive tables for user access.
• Implemented MapReduce programs to handle semi/unstructured d Confidential like XML, JSON, Avro d Confidential files and sequence files for log files.
• Used Elastic search as a distributed RESTful web services with MVC for parsing and processing XML d Confidential .
• Created Partitions, Buckets based on State to further process using Bucket based Hive joins.
• Analyzed large amounts of d Confidential sets to determine optimal way to aggregate and report on it.
• Migrating various Hive UDF's and queries into Spark SQL for faster requests.
• Configured Spark Streaming to receive real time d Confidential from the Apache Kafka and store the stream d Confidential to HDFS using Scala.
• Installed and configured Hive, HDFS and the Nifi, implemented CDH cluster. Assisted with performance tuning and monitoring.
• Worked with NoSQL d Confidential bases HBase in creating HBase tables to load large sets of semi-structured d Confidential coming from various sources.
• Implemented the Cassandra and manage of the other tools to process observed running on over Yarn.
• Implemented Kafka High level consumers to get d Confidential from Kafka partitions and move into HDFS.
• Worked on analyzing Hadoop cluster and different big d Confidential analytic tools including MapReduce, Hive and spark.
• Installed Oozie workflow engine to run multiple MapReduce, Hive HQL and Pig jobs.
• Developed HDFS with huge amounts of d Confidential using Apache Kafka.
• Collected the log d Confidential from web servers and integrated into HDFS using Flume.
• Created and maintained Technical documentation for launching Hadoop Clusters and for executing Hive queries and Pig Scripts
• Worked with cloud services like Amazon Web Services (AWS) and involved in ETL, D Confidential Integration and Migration
• Constructed System components and developed server side part using Java, EJB, and Spring Framework.
• Involved in designing the d Confidential model for the system.
• Used J2EE design patterns like DAO, MODEL, Service Locator, MVC and Business Delegate.
• Analyzed large amounts of d Confidential sets to determine optimal way to aggregate and report on it.
• Involved in converting Hive/SQL queries into Spark transformations using Spark RDD, Scala and Python.
• Installed and Configured Apache Hadoop clusters for application development and Hadoop tools like Hive, Pig, HBase, Zookeeper and Sqoop.
• Implemented multiple MapReduce Jobs in java for d Confidential cleansing and pre-processing.
• Wrote complex Hive queries and UDFs in Java and Python.
• Responsible for d Confidential extraction and d Confidential ingestion from different d Confidential sources into Hadoop D Confidential Lake by creating ETL pipelines using Pig, and Hive
• Worked with systems engineering team to plan and deploy new Hadoop environments and expand existing Hadoop clusters and Experience in converting MapReduce applications to Spark.
• Implemented a proof of concept (PoC’s) using Kafka, Strom, HBase for processing streaming d Confidential .
• Implemented best income logic using Pig scripts and UDFs.

Environment: Hadoop 3.0, Pig 0.17, Hive 2.3, HBase, Sqoop, MapR, HDFS, Agile, Spark SQL, Apache Kafka 2.0.0, Scala, Spark, Nifi, NoSQL, Cassandra 3.11, Java, MongoDB, Flume, XML, JSON, Elastic search, AWS

Confidential

Sr. J2EE/Hadoop Developer

Responsibilities:

• Created the automated build and deployment process for application, re-engineering setup for better user experience, and leading up to building a continuous integration system.
• Involved in the Complete Software development life cycle (SDLC) to develop the application.
• Involved in Daily Scrum (Agile) meetings, Sprint planning and estimation of the tasks for the user stories, participated in retrospective and presenting Demo at end of the sprint.
• Exported the analyzed d Confidential to the relational d Confidential bases using Sqoop 2.3.x for visualization and to generate reports for the BI team.
• Developed continuous flow of d Confidential into HDFS from social feeds using Apache Storm Spouts and Bolts.
• Real streaming the d Confidential using Spark 1.6.0 with Kafka 0.10.0.0.
• Importing and exporting d Confidential into HDFS and Hive 2.0 using Sqoop 2.3.x.
• Implemented new Apache Camel routes and extended existing Camel routes that provide end-to-end communications between the web services and other enterprise back end services
• Developed code using Core Java to implement technical enhancement following Java Standards.
• Worked with Swing and RCP using Oracle ADF to develop a search application which is a migration project.
• Implemented Hibernate utility classes, session factory methods, and different annotations to work with back end d Confidential base tables.
• Implemented Ajax calls using JSF-Ajax integration and implemented cross-domain calls using JQuery Ajax methods.
• Interacted with Business Analysts to understand the requirements and the impact of the the business.
• Developed screens using JSP, DHTML, CSS, Ajax, JavaScript, Struts, spring, Java and XML.
• Developed and implemented Swing, spring and J2EE based MVC (Model-View-Controller) framework for the application
• Worked with NoSQL d Confidential bases like Base to create tables and store the d Confidential Collected and aggregated large amounts of log d Confidential using Apache Flume and staged d Confidential in HDFS for further analysis.
• Collaborated with Business users for requirement gathering for building Tableau reports per business needs.
• Worked on deploying Hadoop 2.7.2 cluster with multiple nodes and different big d Confidential analytic tools including Pig 0.16, HBase 0.98.23 d Confidential base and Sqoop HDP2.3.x.
• Involved in loading d Confidential from LINUX file system to HDFS.
• Experience in reviewing Hadoop log files to detect failures.
• Implemented Object-relational mapping in the persistence layer using Hibernate frame work in conjunction with spring functionality.
• Also wrote some complex PL/SQL queries using Joins, Stored Procedures, Functions, Triggers, Cursors, and Indexes in D Confidential Access Layer.
• Implementing Restful web services architecture for Client-server interaction and implemented respective POJOs for its implementations
• Used Web Logic for application deployment and Log 4J used for Logging/debugging.
• Used CVS version controlling tool and project build tool using ANT.
• Used JPA (Java Persistence API) with Hibernate as Persistence provider for Object Relational mapping.
• Used JDBC and Hibernate for persisting d Confidential to different relational d Confidential bases.
• Implemented application level persistence using Hibernate and spring.
• Used XML and JSON for transferring/retrieving d Confidential between different Applications.

Environment: Hadoop, Hive, Pig, HBase, Sqoop, Spark, MapReduce, Spark, Scala, Oozie, Terad Confidential, SQL, NoSQL, HDFS, Kafka, Flume, Cassandra, Java, XML

Confidential

Sr. Java/J2EE Developer

Responsibilities:

• Iterative based methodology applied for the development of the application. Implemented J2EE Design Patterns like DAO, Singleton, Factory.
• Developed the Java/J2EE based multi-threaded application, which is built on top of the struts framework.
• Implemented Hibernate in the d Confidential access object layer to access and update information in the Oracle D Confidential base.
• Used Entity beans for storing the d Confidential base in to d Confidential base.
• Developed Session Beans as the clients of Entity Beans to maintain the Client state.
• Used various Core Java concepts such as Multithreading, Exception Handling, Collection APIs to implement various features and enhancements.
• Wrote front end code for developing new pages using HTML, CSS, JavaScript, and jQuery.
• Involved in developing Java APIs, which communicates with the JavaBeans.
• Designed d Confidential base and created tables, written the complex SQL Queries and stored procedures as per the requirements.
• Created POJOs in the business layer.
• Developed Ant Scripts to build and deploy EAR files on to Tomcat Server.
• Analyzed the EJB performance in terms of scalability by various Loads, Stress tests using Bean- test tool.
• Used Spring/MVC framework to enable the interactions between JSP/View layer and implemented different design patterns with J2EE and XML technology.
• Managed connectivity using JDBC for querying/inserting & d Confidential management including triggers and stored procedures.
• Implemented the J2EE design patterns D Confidential Access Object (DAO), Session Façade and Business Delegate.
• Developed the Restful web services using Spring IOC to provide user a way to run the job and generate daily status report.
• Implemented application using MVC architecture integrating Hibernate and Spring frameworks.
• Utilized various JavaScript and JQuery libraries bootstrap, Ajax for form validation and other interactive features.
• Developed Interactive GUI screens using HTML, bootstrap and JSP and d Confidential validation using JavaScript and AngularJS.
• Extensively used Eclipse while writing code as IDE.
• Implemented PL/SQL queries and used MySQL stored procedures, and built-in functions to retrieve and update d Confidential from the d Confidential bases
• Used ANT scripts to fetch, build, and deploy application to development environment.
• Wrote test cases in JUnit for unit testing of classes.
• Involved in preparing Ant builds scripts (XML based), deployments, and integration and configuration management of the entire application modules.
• Created and modified Stored Procedures, Functions and Triggers Complex SQL Commands for the application using PL/SQL.
• Created tables, triggers, stored procedures, SQL Queries, joins, integrity constraints and views for multiple d Confidential bases, Oracle using Toad tool.
• Configured local Maven repositories and multi-component projects and scheduled projects in Jenkins for continuous integration.

Environment: Java, J2EE, struts, Spring 3.0, XML, PL/SQL, Hibernate 4.0, JavaScript, jQuery, bootstrap, HTML 4.0.1, ANT, Ajax, DHTML, CSS, JavaBeans, MySQL, Oracle 10g, Toad, Maven 3.1, Jenkins