We provide IT Staff Augmentation Services!

Sr. Hadoop/spark Developer Resume

5.00/5 (Submit Your Rating)

Columbus, OH

SUMMARY:

  • Overall 9 years of IT industry experience with knowledge from varied requirements domains like Financial, Insurance, and Enterprise business software sectors
  • 2+ years of experience working on BIG DATA using HADOOP/ Confidential framework and related technologies such as HDFS, HBASE, Map Reduce, HIVE, PIG, FLUME, OOZIE and SQOOP
  • 1+ Apache Confidential using Scala, SparkSQL, SparkStreaming.
  • 7 years Java, JSP, EJB, Frameworks (Struts, spring, Hibernate) in Implementing J2EE technology.
  • Worked in Agile Methodology, throughout the project. Actively involved in Leading IPMs(Iteration Planning Meeting), Entries, Exits, 3 Amigos, StandUp meetings.
  • Hands on experience with Apache Confidential, SparkSQL, SparkStreaming.
  • Used Scala 2.X to code Confidential
  • Hands on experience with Confidential - Scala programming with good knowledge on Confidential architecture and its in memory processing.
  • Good working experience with Horton works and Cloudera Hadoop stack.
  • Excellent knowledge on Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node.
  • Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems (RDBMS) and from RDBMS to HDFS.
  • Experience in writing custom UDFs in java for Hive and Pig to extend the functionality.
  • Implemented Hadoop based data warehouses, integrated Hadoop with Enterprise Data Warehouse systems.
  • Good working experience with Flume, Kafka, Confidential, Hbase Integration.
  • Experience in writing UNIX shell scripts.
  • Experience working with JAVA, J2EE, JDBC, ODBC, JSP, Java Eclipse, Java Beans, EJB, Servlets, MS SQL Server.
  • Expertise in designing and implementing frameworks such as Spring Confidential, Struts, JSF.
  • Extensive experience in developing scalable, reliable and efficient enterprise applications usingJAVA, J2EE, Struts, AJAX, Spring, SOA, JMS, Web Services, SOAP, REST, Hibernate.
  • Well versed in designing presentation layer components using Servlets, JSP, JSF, JSTL, HTML, AJAX, XSL, XHTML, JQuery, CSS, JavaScript, Groovy, Grails.
  • Extensive experience working in Oracle, DB2, SQL Server, Netezza, My SQL, NoSQL, MongoDB database, HBase, Cassandra.
  • Hands on experience in gathering the requirements, assigning the tasks to resources and updating the status to the client by end of the day. Expertise in designing enterprise applications using J2EE technologies such as Java.
  • Responsible for reporting project status. Working to Creating the Cucumber, Ruby Test framework for the Rules Team.
  • Strong experience in Windows, UNIX, Linux environments.

TECHNICAL SKILLS:

Operating Systems: Windows, UNIX, Linux

Programming Languages: Java 1.5/1.6, C, Scala 2.0, Python

Enterprise Technologies: JSP, Servlets, JSF, Custom Tag Libraries, JNDI, Strut2.0, Hibernate, Spring 3.xRESTFUL services, Web services, EJB, ILog JRules 6.5, Log4J, SLF4J

Databases: Oracle 9i/10g, MS Access, DB2 8.1, SQL Server 2005/2000

Tools: Rational Rose, IBM RAD 6.0, Eclipse IntelliJApplication Servers IBM Web Sphere 6.1,Apace Tomcat 5.x, IIS 6.0

Automation Testing: Ruby/Cucumber

Build tools: Maven, SBT

Big Data Ecosystem: Hdfs, Map Reduce, Yarn, Hive, Pig, Sqoop, Flume, Hive, Zookeeper, Oozie, HBASEKafka, Impala, Confidential, Confidential Sql, Confidential Streaming

Hadoop Distributions: Apache Hadoop, Cloudera Hadoop Distribution and Hortonworks Data Platform

PROFESSIONAL EXPERIENCE:

Confidential, Columbus, OH

Sr. Hadoop/ Confidential Developer

Responsibilities:

  • Designed and developed data movement framework for multiple sources like Sql Server, Oracle, and MySQL.
  • Hands on experience with Apache Confidential, SparkSQL, SparkStreaming.
  • Hands on experience with Confidential -Scala programming with good knowledge on Confidential architecture and its in memory processing.
  • Load the data into Confidential RDD and do in memory data Computation to generate the Output response
  • Involved in converting Hive/SQL queries into Confidential transformations using Confidential, Python and Scala.
  • Design and Develop Parsers for different file formats (CSV, XML, Binary, ASCII, Text, etc.).
  • Created Sqoop jobs for import and export data for multiple sources.
  • Developed scripts to automate the creation Sqoop jobs for various workflows.
  • Created hive tables and partitioning and stored as parquet format, Avro format, Sequence file and as a Text file to read and write the data with the appropriate compressions
  • Experience in optimizing the hive queries to improve the performance of hive queries.
  • Ran same hive queries in impala for benchmarking process.
  • Developed the Oozie workflows to automate the loading process.
  • Experience in creating Flume Agent
  • Built & Deployed Hadoop clusters with different Hadoop components (HDFS, YARN, HBASE and ZOOKEEPER)
  • Developed Hive unit testing framework.
  • Worked on Kafka
  • Good knowledge of Amazon Web Services.
  • Tried Strom to create streaming pipeline
  • Gathered the business requirements from the Business partners and subject Matter Experts.
  • Responsible to manage data coming from different sources..
  • Developed MapReduce programs to perform data filtering for unstructured data.
  • Designed Oozie workflows for job automation.
  • Experience in troubleshooting in map reduce jobs by reviewing log files.
  • Optimized our Hadoop infrastructure at both the software and hardware level
  • Ensured our Hadoop clusters are built and tuned in the most optimal way to support the activities of our Big Data teams.

Environment: Java 6, Scala, Eclipse, Oracle 10g, Sub Version, Hadoop, Confidential, Hive, Hbase, Pig, Linux,, MapReduce, Impala, Java (JDK 1.6), Hadoop Distribution Cloudera and Hortonworks, PL/SQL, UNIX Shell Scripting, SBT for Confidential .

Confidential, Columbus, OH

Sr Java Developer

Responsibilities:

  • Worked in Agile Methodology, thoughout the project. Actively involved in Leading IPMs(Iteration Planning Meeting), Entries, Exits, 3 Amigos, StandUp meetings.
  • Involved in design and development of modules in the application.
  • Coordinated closely with client's Enterprise Architecture team in signing off the design of the application.
  • Maven was used to manage dependencies in the application and deploy it on WebLogic Application server. CVS was used for the version control
  • Involved in implementation of project as an SME in all the phases and ensured quality deliverable to the client.
  • Implemented Confidential architecture using Spring Confidential framework.
  • Composing the application classes as Spring Beans using Spring IOC/Dependency Injection.
  • Front end was developed using JSP, AJAX, Struts tags library, jQuery, HTML, CSS
  • Developed common APIs for Curam Agenda Player and dynamically load agenda pages based on admin configuration.
  • Involve in RESTful web services for making use of HTTP protocol between client and server.
  • Used DOJO for client side framework.
  • Developed Data persistence API using Hibernate and Spring DAO layer.
  • Implemented logging and transaction manager using Spring's Aspect Oriented Programming (AOP) concept.
  • Used multithreading in programming to improve overall performance.
  • Used Hibernate by creating its mapping file and coding for data access methods.
  • Coded various business process methods required for creation of Web Services related to customer information and provider information, using JAX-WS, SOAP, WSDL and JAX-RS, REST web services.
  • Implemented critical DB design optimization techniques in the application. Created Oracle cron jobs to update crucial tables.
  • Redesigned and tuned SQL queries to improve the performance of the applications.
  • Developed and executed test data for unit, functional and user acceptance testing to assure quality project deliverables.
  • Worked on Maven2 during build process also modified pom.xml to use latest libraries and specifications.
  • Worked in build process, such as running build scripts to check out the code from svn, to build it and deploying under UNIX boxes also running Web sphere deploy, startup scripts.
  • Handled the build and Deployment strategies.
  • Involvement in end to end project phases and providing warranty support on the applications.

Environment: Java JDK 1.7, J2EE, UML, MULE ESB, Servlets, Apache CXF, Hibernate, Spring Framework, JSP, JDBC, Java JMS, JUnit, Oracle, Eclipse, GIT, XML, Javascript, CSS style sheets, Log4j, Solaris Unix, Weblogic11g 10.3.6, PL/SQL, Maven, Crucible, JIRA

Confidential, Jacksonville, FL

Sr. Java Developer

Responsibilities:

  • Developed application using Java/J2EE platform. Implemented the Model View Control structure.
  • Used Subversion for activities tracking i.e., Version Controlling and Change Management that is tracking structure of folders, maintaining global revision number for the whole repository and SVN operations.
  • Implemented jmock for moking of objects in test-driven development
  • Responsible for writing Hibernate POJO classes and integrating Hibernate with Spring for processing business needs.
  • Implemented Python scripts to automate the conversion process
  • Struts1.1 was used for actions, validations and to integrate various components. HTML and JavaScript were used for web interface.
  • Involved in developing the User Interface screens for clients using Struts, JSP, JSP Tag Libraries, HTML, XML, XSL and JavaScript.
  • Hibernate Query Language (HQL) was used to perform various queries in the database
  • Responsible in configuring the struts-config.xml. For the various modules, developed Action Classes and created form beans, action mappings, tile definitions, validations using Dyna Validator and custom validation and wrote Java Scripts for retaining the form fields when validator is done for the Pages.
  • Involved in component development involving EJB and maintained development using J2EE principles.
  • Designed and developed the EJB Stateless Session bean which delegates the call to the Business layer.
  • Oracle 8i database was used for the application.
  • Used JDBC for communicating with Oracle 8i database.
  • WSAD 5 provided the application development environment for developing the application.
  • Used Websphere Application Sever5.1 to deploy the application.
  • Supported in maintenance and customizations for Curam - Interactive GUI Screens using JSP, Curam Web UIM.

Environment: Java 1.5, J2EE 1.4, Struts Frame work, jsp, Spring Framework 2.0, Hibernate 3.0, Oracle 10g, MyEclipse 6.5.1, Subversion, Oracle 9i, PL/SQL, WebSphere 6.1.0, UML, Toad, Windows.

Confidential, Washington, DC

Sr. Java Developer

Responsibilities:

  • Implementation of User Interface Rules so as to reflect our business needs. Used Agile methodology in designing and developing the modules.
  • Collected User Stories for documenting the requirements of product catalog, ordering products and Approval module.
  • Used Struts validator framework to validate user input.
  • Implemented Singleton Design Pattern by sharing the single service locator object across different Business Delegates.
  • Developed Confidential design pattern based User Interface using JSP, XML, HTML and Struts.
  • Used Spring AOP for transaction management.
  • Used Apache Axis to generate the Order products web services module.
  • Created WSDL for the web services to be deployed using bottom-up approach.
  • Application is built using standard design patterns such as DAO, Abstract Factory, Singleton, Session Facade, Business Delegate, and Confidential .
  • Junit, log4j were used for unit testing and as logging frameworks.
  • Hibernate is used as a persistence mapping technology along with JPA which acts as a wrapper around the Hibernate eliminating the mappings and configuration by annotating the POJO classes with Data Base tables.
  • Participated in and contributed to group sessions, design reviews, and code analyzing.
  • Used SVN repository for version control.
  • Used Eclipse IDE for development.

Environment: Java, J2EE, Spring, Struts, Hibernate, JSP, HTML, Apache Ant, Log4J, Eclipse IDE, JUnit, Subversion, WSDL, Web Services, Singleton, XML, DAO.

Confidential, Quincy, MA

Java Developer

Responsibilities:

  • Analyzing the specifications provided by client.
  • Implementing the Domain Driven Approach in Java for making different project modules as independent which can be easily plug-in or plug-out with other modules for any further enhancements or changes.
  • Developed Service Layer using Spring IOC and Spring AOP under the guidelines of Service Oriented Architecture.
  • Develop the User Interface application with advanced technologies HTML
  • Used Bootstrap framework, CSS and media queries for responsive web designing.
  • Development of user stories that are planned and designed for each sprint in Java using Restful web services using Jersey Architecture with spring and Hibernate frameworks.
  • Implementing test case scenarios using JUNIT framework for unit testing.
  • Analyzing the code quality using SONAR framework and validating the Junit unit test cases using code collaborator framework.
  • Involved in smoke testing the application completely from user interface to backend services and performs testing of database related operations.
  • Writing SQL queries and stored procedures to interact with Informix, SQL, DB2, Oracle, databases.
  • Created Continuous Delivery Pipeline for various modules using CloudbeesJenkins.
  • Implemented Database Schema Automation and DMR Automation using Liquibase.
  • Created Dashboards for capturing Metrics from Graphite in Grafana.
  • Worked on GIT, STASH, CONFLUENCE, JIRA and Sub-Version.
  • Design the user stories that are planned for each sprint in Agile Methodology and preparing the design approach document with defining the implementation approach of the user story and visualizing the user story by drawing the process flow diagram and System context diagram

Environment: Java Script, Restful Web Service, Junit, spring, Hibernate, DB2, Bootstrap, HTML5, CSS3, Informix, SQL Server, Windows 7, TomEE, AnthillPro, Jenkins, Liquibase, Grafana.

Confidential, Farmington Hills, MI

Java Developer

Responsibilities:

  • Involved in Architecture and System Design and development process.
  • Setting up the basic project set-up from scratch of Struts-Hibernate App based on Design
  • Created the User Interface screens using Struts Confidential for logging into the system and performing various operations on network elements.
  • The users are classified into various organizations to differentiate the privileges between them in accessing the system.
  • Development using the Use Cases and business logic & Unit Testing of Struts Based Application
  • Developed JSP pages using Custom tags and Tiles framework and Struts framework.
  • Developed the User Interface Screens for presentation logic using JSP, Struts Tiles, and HTML.
  • Used display tag to render large volumes of data. Bean, HTML and Logic tags are extensively used to avoid java expressions and scriplets in JSP.
  • Design patterns like Session Façade, Command, Singletonand DAO are implemented in business layer.
  • EJBs are created for Backend operations. Hibernate is used for Database persistence.
  • JMS is used to send message objects to client queues and topics.
  • JUnit test cases are created for unit testing.
  • Log4j is used for logging purposes and debug levels are defined for controlling what we log.
  • ANT is used for building the application EAR.
  • Hibernate 3.0 annotations are included for Oracle DB.
  • Working with on-site and off-site (India based) resources for successful implementation of the Workflow module

Environment: Java 1.5, J2EE, JSP, EJB, Struts 1.2, WebSphere 5.0, Apache TOMCAT, Web Services,Hibernate, JMS, XML, XSL, HTML, JavaScript, CSS, AJAX.

We'd love your feedback!