SUMMARY

• Big data Engineer with 7 Years of IT experience including 4 years in Big data domain and 3 years in Java Development.
• Extensively worked on Hadoop eco system tools - MapReduce, Hive, Pig, Sqoop, Oozie, Impala and Spark.
• Experience in understanding of data processing patterns, distributed computing and building applications for real-time and batch analytics.
• Experience in productionizing the code from ground up according industry leading best practices which includes setting up Git Repos and Integrating them to Jenkins CI/CD.
• Experience with Java8, Scala and Python languages used for automation and building frameworks for data processing in Spark, Hadoop and implement solution in Object Oriented pattern.
• Good knowledge on Amazon Web Services(AWS) cloud services like EC2, S3 and EMR.
• Coding and design skills in Core Java, OOPS Concepts, Servlets and JSP.
• Experience on OOP (Objective Oriented Programming) like Inheritance, polymorphism, Abstraction, Encapsulation.
• Strong Understanding of J2EE design Patterns like Session facade, Singleton, Front Controller, Business delegate, Service Locator, DTO, DAO.
• Experience programming in Scala with exposure to the most well-known frameworks such as Akka and Play.
• Extensive experience in implementing MVC framework using Spring in J2EE architecture
• Good exposure and experience with Service Oriented Architecture (SOA) such as Web Services including SOAP, WSDL, JMS (Java Messaging Service), AJAX and tools like ANT, Junit.
• Experience in implementing end-to-end solutions full life cycle (SDLC).

TECHNICAL SKILLS

Big Data Ecosystem: AWS, HDFS, MapReduce, YARN, Hive, Sqoop, Impala, Spark.

Cloud Ecosystem: Amazon Web services (EC2, S3)

Languages: Scala, Java, SQL, HTML, DHTML, JavaScriptOperating systems UNIX, Linux, and Windows Variants

Tools: Maven, Gradle, Jenkins, IntelliJ, Eclipse, GIT.

PROFESSIONAL EXPERIENCE

Confidential - PHOENIX

Big Data Engineer/Java

Responsibilities:

• Migrated the existing data to Hadoop from Mainframes and Teradata to Hadoop Cluster and performed data processing through map-reduce framework.
• Designed architecture for end-to end workflow in migrating process from Mainframe to Hadoop environment.
• Developed map-reduce programs and custom Udfs in hive and pig for various data transformations.
• Implemented Map-reduce paradigm in Spark with Scala API.
• Developed Pig, Hive scripts from Teradata sql scripts to process data in hadoop.
• Used Oozie to automate the workflow and Autosys for scheduling the jobs in cluster in timely manner to meet the SLA for various portfolios existing in retail risk.
• Prepared spark scripts to replace existing pig scripts to process data in spark framework.
• Designed and implemented Data check and Data quality frameworks in spark during the initial load process and the final publish stages.
• Used Jenkins as build tool and GIT as code merge platform.
• Experienced in Agile Methodology, participated in Sprints and daily Scrums to deliver software tasks on-time and with good quality on basis with onsite and offshore teams.
• Extensively used ePass to integration with Enterprise and web applications.
• Core Service is developed as jar or image that can be included by otherMicroServicesas their dependency.
• Docker is used for creating images that are deployed on epass asMicroServices.
• Created auto deploy jobs using Jenkins, Gradle and Maven.
• Created and maintained variousDevOpsrelated tools for the team such as deployment tools and development and staging environments on ePass and Nexus.
• Used Jenkins tool and made customizations according to the local build to track out the build status.

Environment: Groovy, Java 1.8, ePass, Nexus, Docker, Kubernetes, MicroServices, Agile, Java, Beans, XML, Maven, Jenkins, Gradle,Spark,Hadoop, Hive,Sqoop,Oozie,aws.

Confidential

Big Data Engineer/Java

Responsibilities:

• Extracted data from Oracle SQL server and MySQL databases to HDFS using Sqoop.
• Created Hive tables to store the processed results and written Hive scripts to transform and aggregate the disparate data.
• Driving the application from development phase to production phase using Continuous Integration and Continuous Deployment (CICD) model using Maven and Jenkins.
• Automated the process for extraction of data from warehouses and weblogs into Hive tables by developing workflows and coordinator jobs in Oozie.
• Exported the aggregated data onto RDBMS using Sqoop for creating dashboards in the Tableau.
• Utilized Agile Scrum Methodology to manage and organize the team with regular code review sessions.
• Worked with data in multiple file formats including Avro, Parquet, Sequence files, ORC, JSON and Text/CSV.
• Very good understanding of Partitions, bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance.
• Used JIRA for incident creation, bug tracking and change management process.

Environment: Java, Eclipse, Hadoop, Map Reduce, HDFS, Sqoop, Oozie, WinScp, UNIX Shell Scripting, HIVE, Impala, Cloudera (Hadoop distribution), AWS, JIRA etc.

Confidential, Raleigh - NC

Sr. Big Data Engineer

Responsibilities:

• Designed and implemented Object Oriented Singleton Pattern for the Scala Application and created a library for sourcing and transformations in Spark.
• Created Projection step to implement Machine learning algorithm Linear Regression in spark for predictions for version 2.2.0.
• Implemented the Spark best practices to efficiently process data to meet ETAs by utilizing features like partitioning, resource tuning, memory management and Check pointing features.
• Implemented a testing framework in Scala by using ScalaTest and SparkTestingbase to test the application and automated through Jenkins.
• Established Git Lab Repository for the project and implemented CI/CD for the repository to Jenkins Server.
• Created Jenkins Pipeline to implement SBT to compile, test, assembly and publish.
• Created a remote debugger through IntelliJ to debug spark application.
• Extensively used Type Safe Configuration to Parameterize the Spark application using Scala.

Environment: Python, Java, Maven, Jenkins, Gradle, Spark, Hadoop, Hive, Sqoop, Oozie, aws.

Confidential, New York, NY

Software Engineer

Responsibilities:

• Effectively interacted with team members and business users for requirements gathering.
• Understanding functional specifications and documenting technical design documents.
• Used Spring MVC to decouple business logic and view components.
• Involved in the integration of spring for implementing Dependency Injection (DI/IOC).
• Developed the Business Logic using Plain Old Java Objects (POJOs).
• Developed Graphical User Interfaces using HTML and JSP’s for user interaction.
• Created Ext JS pages, used JavaScript for client-side validations, and AJAX to create interactive front-end GUI.
• Used JSON for data exchange between application modules along with XML.
• Used Direct Web Remoting, Spring JDBC Template and Spring DAO’s Support classes for JDBC.
• Created set of classes using DAO pattern to decouple the business logic and data.
• Used various Core Java concepts such as Multi Threading, Exception Handling, Collection APIs to implement various features and enhancements.
• Designed and Developed complex UI screens using Spring MVC, AJAX, jQuery, HTML5, CSS3, Python, Java Script for request management and search and filter modules.
• Involved in coding, maintaining, and administering Servlets, and JSP components to be deployed on a WebSphere Application server application server.
• Developed Web Services using XML messages that use SOAP. Developed Web Services for Payment Transaction and Payment Release.
• Extensively worked with VXML, GRXML in implementing the call flow for the IVR application. Implemented Speech-to-Text and Text-to-Speech using Nuance.
• Built scripts using Ant to build the J2EE application.
• Responsible for creation and consumption of Web services both SOAP and REST based.
• Developed the application using RAD as the IDE and used its features for editing, debugging, compiling, formatting, build automation and version control (CVS).
• Wrote test cases in Junit for unit testing of classes and implemented the logging using Log4j.
• Developed test cases for Unit Testing using JUnit and Mockito.
• BuiltNO SQL schemas and maintaining sessions by Mongo DB.
• Used CVS version control to track and maintain the different version of the application.
• Involved in offshore co-ordination, work assignment, query resolution and work product reviews.
• Extensive hands-on experience in Pivotal cloud foundry, other PaaS platforms and In-depth understanding of Domain Driven Design and 12 Factor principles.

Environment: Core Java 6, J2EE, JSP, JSTL, Servlets, Ext JS, Agile Methodology,Struts, MVC, Tomcat/JBoss, Python, XML, HTML, CSS, DHTML, DOM,Hibernate, SOAP, REST, JavaScript, Multithreading, Oracle, Junit, No SQL,Mongo DB, Junit, Web services, PLSQL, JDBC, ANT, Solaris and Windows 2000.

Confidential, Hartford, CT

Software Engineer

Responsibilities:

• Participated in development phases of the project with major emphasis on coding and unit testing of the modules.
• Development methodology used was the agile methodology. Process included iterative development, 2-week sprints, and daily stand.
• Developed the presentation layer on Struts framework using Servlets and JSP.
• Used Eclipse for developing web components such as JSP, Controller tier that includes action classes.
• Designed and developed the business logic components using facade design pattern.
• Created war/ear files and deployed them on WebSphere application server.
• Developed PL/SQL stored procedures to perform complex database operations.
• Front-end designing and validation were done using the JavaScript.
• Prepared Test Case document to test the required functionalities.
• Performed Unit as well as integration testing for all the modules.
• Created Technical documentation as per the company standards.
• Used Ant scripts to fetch, build and deploy the application to development environment.
• Enhanced the system with change requests and coordinating with business and development team.
• Interacted with DBAs, Data Architects, Application Team, Infrastructure team.

Environment: Java, J2EE, JSPs, Servlets, JDBC, Web Services, SOAP/HTTP, Struts, WebSphere, XML, XSLT, JavaScript, HTML, NetBeans, Oracle, Windows.