PROFESSIONAL SUMMARY:

• Having around 5+ years of experience in Software Analysis, Design, Development, Implementation and Testing of Object Oriented Applications and Web based Enterprise Applications using JAVA/J2EE technologies.
• Experience in Waterfall, Agile (scrum) methodologies where there is a daily SCRUM meeting to understand the status and resolve any issues and in making web pages cross browser compatible and server scripting languages.
• Extensive experience of development using Hadoop ecosystem covering Map Reduce, HDFS, YARN, Hive, Pig, Hbase, Apache Kafka, Sqoop, Oozie, Cloud era.
• Experience in working with various Cloudera distributions (CDH4/CDH5) and have knowledge on Horton works.
• Worked on designing and implementing complete end - to-end Hadoop Infrastructure including PIG, HIVE, Sqoop, Oozie.
• Performed Importing and exporting data into HDFS and Hive using Sqoop.
• Good knowledge about YARN configuration.
• Knowledge on RDBMS databases like Oracle, My SQL and DB2.
• Experience in strong and analyzing data using HiveQL, Pig Latin, HBase and custom Map Reduce programs in Java.
• Experience in developing PIG queries and writing custom UDF’s.
• Experience in Core Java concepts such as OOP Concepts, Collections Framework, Exception Handling, I/O System, Multi-Threading.
• Used new Java 8 features to improve the code readability and performance such like Stream, Lambda, and Optional etc.
• Experience in writing shell scripts to dump the Shared data from My SQL servers to HDFS.
• Actively involved in coding using Java 1.8, spring and Angular 4 to develop features from end to end.
• Strong skills in RDBMS implementation and development using Oracle, IBM DB2 Database Servers and hands on experience with SQL, PL/SQL.
• Knowledge of NoSQL databases such as HBase, MongoDB and Cassandra.
• Having good experience on using Tableau, Quick view Reporting Tools.
• Manage and review Hadoop log file and Knowledge on Spark & Storm.
• Experience in developing Front-End using JavaScript, HTML, XML and CSS.
• Used React-Router to turn application into Single Page Application.
• Involved in using React JS components, Forms, Events, Keys, Router, Animations and Flux concept.
• Involved in converting Hive/SQL queries into Spark transformations using Spark RDD'S and Scala.
• Used Spark Sql with Scala for creating data frames and performed transformations on data frames.
• Involved in issue tracking and agile project management using JIRA.
• Extensively worked on debugging using Eclipse, Net Beans debugger.
• Experience in developing applications on Windows, UNIX and Linux platforms.
• Having experience on Storage and Processing in Hue covering all Hadoop ecosystem components.
• Load and transform large sets of structured, semi-structured and unstructured data using Hadoop ecosystem components.
• Good knowledge on AWS infrastructure services Amazon simple storage service (Amazon S3) and Amazon elastic compute cloud (Amazon Ec2).
• Excellent working knowledge of popular frameworks like Struts, Hibernate, and Spring MVC.

TECHNICAL SKILLS:

Big Data Ecosystems: HDFS, Sqoop, Flume, Hive, Pig, Map Reduce YARN, Oozie, Kafka, Spark, and HBASE.

Big Data Platforms: Horton works, Cloud era, Amazon AWS and Apache.

Programming Languages: Java, C++, Python and Scala.

Web Technologies: Servlet, JDBC, EJB2.0/3.0, DHTML and HTML/HTML5, XHTML, CSS2/3, JavaScript, JSF, AJAX, JQuery.

Frameworks: Struts 1.x/2.0, Hibernate, Spring Framework 4.x

Design Patterns: Singleton, MVC, Value Object, View Object, DAO, Factory.

Database: Oracle (9i, 10g, 11g), SQL Server2000/2005, DB2, My Sql, No SQL.

Servers: Web Logic, JBOSS, Apache Tomcat, IBM Web Sphere (WAS).

Platforms: Windows (XP-SP2, 7, 8, 10), LINUX, UNIX.

PROFESSIONAL EXPERIENCE:

Confidential, Foster City, CA

Software Developer

Responsibilities:

• Developing a Financial Model Engine for the sales Department on Big Data infrastructure using Scala and Spark.
• Involved in migrating Hive queries into Spark transformations using Data frames, Spark SQL, SQL Context, and Scala.
• Prepared technical documentation of the POC with all the details of installation, configuration, issues faced and their resolutions, Pig scripts, Hive queries, and process for executing them etc.
• Developed shell scripts to periodically perform incremental import of data from third party API to Amazon AWS.
• Implemented Spark using Scala and utilizing Data frames and Spark SQL API for faster processing of data.
• Analyzed the data using HiveQl to identify the different correlations and used core Java technologies to create Hive/Pig UDFs to use in the project
• Experience in using and tuning relational databases (e.g. Microsoft SQL Server, Oracle, MySql) and columnar databases (e.g. Amazon Redshift, Microsoft SQL Data Warehouse).
• Created HBase tables to load large sets of structured, semi-structured and unstructured data coming from UNIX, NoSQL and a variety of portfolios.
• Worked with open source communities to commit code, review code, and drive enhancements and with data center teams on testing and deployment.
• Implemented Java Hbase MapReduce paradigm to load data onto Hbase database on a 4 node Hadoop cluster.
• Design and develop Hadoop MapReduce programs and algorithms for analysis of cloud-scale classified data stored in Cassandra.
• Evaluated data import-export capabilities, data analysis performance of Apache Hadoop framework.
• Involved in installation of CDH4 Hadoop, configuration of the cluster and the eco system components like Sqoop, Pig, Hive, HBase and Oozie.
• Worked closely with the data modelers to model the new incoming data sets and Developed and maintained Hive QL, Pig Latin Scripts, Scala and Map Reduce and Wrote Map Reduce job using Scala.
• Developed Spark SQL script for handling different data sets and verified its performance over MR jobs.
• Created HBase tables to store variable data formats of PII data coming from different portfolios.
• Implementing Robot Framework using python. Generated property list for every application dynamically using python.
• Performed troubleshooting, fixed and deployed many Python bug fixes of the two main applications that were a main source of data for both customers and internal customer service team
• Imported data from local file system, RDBMS into HDFS and Sqoop and developed workflow in Oozie to automate the tasks of loading the data into HDFS.
• Evaluated various data processing techniques available in Hadoop from various perspectives to detect aberrations in data, provide output to the BI tools, etc.
• Cleaned up the input data, specified the schema, processed the records, wrote UDFs, and generated the output data using Pig and Hive
• Creating MapReduce jobs for performing ETL transformations on the transactional and application specific data sources
• Imported Avro files using Apache Kafka and did analytics using Spark in Scala did troubleshooting using Scala problems to produce illustrative reports and dashboards along for ad-hoc analysis
• Active part in Applying Real time batch processing in customer service centers for customer experience optimization
• Compared the execution times for the functionality that needed joins between multiple data sets using MapReduce, Pig and Hive
• Used Apache Spark to execute Scala Source Code for JSON Data Processing and developed code to process it
• Worked in agile environment, delivered sprint goals, familiar with tools like JIRA Agile and Git Stash
• Used real time batch processing to detect and discover customer buying patterns from historical data and then monitoring customer activity to optimize the customer experience. This leads to more sales and happier customers
• Exported the analyzed data onto RDBMS using Sqoop, in order to be used in Tableau to generate reports and also used Sqoop to transfer data between Rdbms and HDFS.
• Gained good experience in Amazon Web Services (EC2, S3, EMR) and Imported data (csv, plain text) from Amazon S3 using HDFS commands.
• Compared the performance of the Hadoop based system to the existing processes used for preparing the data for analysis.

Environment: CDH5, Hadoop, HDFS, MapReduce, Yarn, Hive, Oozie, Sqoop, Oracle, Linux, Shell scripting, Java, Spark, Scala, SBT, Storm, Kafka, Eclipse, Amazon S3, JD Edwards Enterprise One, JIRA, Git Stash.

Confidential

Java/J2EE Developer

Responsibilities:

• Developing User Interface and implementing business process using JSP and Servlets.
• Development of the application that was used to create dynamic JSPs, given input from a database table containing information about the contents of the JSP being developed.
• Involved in writing the presentation layer in Java Server Pages (JSP).
• Developed the front end User Interface using HTML5, JavaScript, CSS3, JSON, JQuery.
• Wrote Servlets programming and JSP scripting for the communication between web browser and server.
• Responsible for coding SQL Statements and Stored procedures for back end communication using JDBC.
• Created ETL test data for all ETL mapping rules to test the functionality of the Informatica Mapping.
• Tested the ETL Informatica mappings and other ETL Processes (Data Warehouse Testing).
• Collaborated with other ETL experts in evaluating the efficacy of load processes and transactional data.
• Developed & tested many features for dashboard using Python, Bootstrap, CSS, JavaScript and JQuery.
• Developed Restful API's using Python and Flask framework.
• Developed an API to write XML documents from a database. Utilized XML and XSL Transformation for dynamic web-content and database connectivity.
• Coded different deployment descriptors using XML. Generated Jar files are deployed on Apache Tomcat Server.
• Developed entire frontend and backend modules using Python on Django Web Framework.
• Involved in the development of presentation layer and GUI framework in JSP. Client Side validations were done using JavaScript.
• Involved in code reviews and mentored the team in resolving issues.
• Participated in weekly design reviews and walkthroughs with project manager and development teams.
• Provide technical guidance to business analysts, gather the requirements and convert them into technical specifications/artifacts for developers to start.

Environment: HTML, JSP, Servlets, JDBC, JavaScript, Tomcat, Eclipse IDE, XML, XSL, Tomcat 5.

Confidential

Web Developer

Responsibilities:

• Involved in requirement gathering phase in order to gather the requirements from the client program manager and dealing with UX team to continuously accommodate changing user requirements.
• Involved in complete User Interface designing and coded the web site in XHTML, CSS and Java Script.
• Responsible for translating designs and concepts into highly usable and engaging web applications using a variety of technologies.
• Used AJAX with jQuery controls for listing all scripts in a grid and can edit it in the grid which will reflect in the database table as well (like margins).
• Converted business requirements into technical requirements in preparation of high level design document and functional specifications.
• Implemented a common styling with the help of CSS across entire application that controls color, layout, width, height, font size, images size and accomplished other graphic related features.
• Design and implementation of new feature or software components for the front end of a large Web application.
• Used MS Visio, Dreamweaver and Photoshop tools for web application development.
• Developed front end UI pages to support data access and user authorization.
• Extensively worked on designing web pages using HTML, DHTML, CSS, JavaScript and AJAX.
• Implemented User Friendly UI design with HTML, CSS and JavaScript for client side validation and form submission functions and PHP for server side scripting for web development.
• Created databases in PHP My Admin for internal projects.
• Managed datasets using Panda data frames and MySQL, queried MYSQL database queries from Python using Python-MySQL connector MySQLdb package to retrieve information.
• Created cross-browser compatible and standards-compliant based page layouts.
• Designed/modified Images/Banners as per the client requirement using Adobe Create Suite.
• Ensured Web Content is in compliance with W3C and Section 508 accessibility standards.
• Interacted with User Experience teams to understand customer needs to design online user experiences, ensuring ease of navigation and simplicity of design.
• Responsible for Unit testing and supporting the UAT&PROD environments.
• Support the deployed applications through debugging and fixing.

Environment: HTML, JSON, XSLT, CSS, JavaScript, AJAX, Adobe Dreamweaver, Adobe Photoshop, PHP, MySQL.