We provide IT Staff Augmentation Services!

Big Data Developer Resume

5.00/5 (Submit Your Rating)

SUMMARY:

  • Over 7+ years of professional IT experience with over 2 years extensive experience as Hadoop Developer and Big Data Analyst.
  • Experience in processing large sets of structured, semi - structured and unstructured data and supporting application architecture.
  • Experience with analysis of Datasets related to Financial industries.
  • Good understanding of data architecture including data ingestion pipeline design, Hadoop information systems architecture, data modeling and data mining, machine learning and advanced data processing.
  • In-depth understanding of Spark Architecture including Spark Core, Spark SQL, Spark Streaming, Data Frames, Spark MLlib.
  • Experience in writing Spark RDD transformations, actions, Data Frame's, case classes for the required input data and performed the data transformations using Spark-Core.
  • Good knowledge on creating Data Pipelines in SPARK using Scala and Python.
  • Experience in developing Spark Programs for Batch and Real-Time Processing.
  • Experience in importing and exporting data between RDBMS and HDFS using Sqoop.
  • Hortonworks Certified Spark Developer.
  • Extensive experience in designing, developing and implementing enterprise applications using Java EE, Spring, Strut and Hibernate.
  • Experienced in developing REST and SOAP based Java web services.
  • Experience in assessing business rules, collaborate with stakeholders and perform source-to-target data mapping, design and review.
  • Able to work independently or as part of a professional team to drive product success.
  • Excellent organizational skills and ability to manage multiple projects simultaneously.
  • Strong troubleshooting and problem-solving skills with analytical mindset.

TECHNICAL SKILLS:

Programming Languages: Python, Scala, Java, SQL

Hadoop Ecosystem: HDFS, Spark, Sqoop, Kafka, Spark SQL, Spark Streaming, Hive, Pig, HBase, Yarn, Oozie and Hue

Development Tools: Eclipse, Notepad++, NetBeans, Maven, SBT, Putty, Git

JAVA /J2EE Technologies: Servlets, JSP, JDBC, EJB, JSF, Spring, Struts, JMS.

Web Services: RESTful, SOAP

Web Technologies: HTML, CSS, AJAX, JQuery, XML, JSON, XHTML.

Databases: MySQL, Oracle, HBase, MongoDB, Cassandra

Methodologies: Agile, Waterfall

Web/Application Servers: Apache Tomcat, Web Logic, IBM Web Sphere

PROFESSIONAL EXPERIENCE:

Confidential

Big Data Developer

Responsibilities:

  • Worked on a live 52 node Hadoop Cluster running Hortonworks Data Platform.
  • Extracted data from Oracle SQL Server and MySQL databases to HDFS using Sqoop.
  • Developed an automated process using Shell script which drives the data pull process from RDBMs to HDFS using Sqoop.
  • Worked on developing a data pipeline using Kafka to store data into HDFS and performed the real-time analytics on the incoming data using Spark components.
  • Used Kafka to divide streaming data into batches as an input to spark engine for batch processing.
  • Worked on POC’s with Apache Spark using Scala to implement spark in project.
  • Developed Spark SQL to load tables into HDFS to run select queries on top.
  • Performed analytics and processing using in-memory computing capabilities of Spark using Scala.
  • Develop predictive analytic using Apache Spark Scala APIs.
  • Created oozie workflows to sqoop the data from source to HDFS and target tables.
  • Experienced with batch processing of data sources using Spark and Elastic search.
  • Analyzed system failures, identified its root cause and recommended course of actions.
  • Functioned as the point of contact for tracking issues and communicating it to the vendors and all other stakeholders.

Environment: Hadoop, Spark, Scala, SQL, Sqoop, Kafka, Spark SQL, Spark Streaming, Oozie, Eclipse IDE, Oracle.

Confidential

Sr Application Developer

Responsibilities:

  • Involved in the complete SDLC including design of System Architecture, development of System Use Cases based on the functional requirements.
  • Involved in Daily Scrum (Agile) meetings, Sprint planning and estimation of the tasks for the user stories, participated in retrospective and presenting Demo at end of the sprint.
  • Designed and coded controller classes using J2SE that would talk to real hardware controller to access their states and gave the user control over the hardware through the multithreaded UI.
  • Used JSP, HTML5, CSS3 and JavaScript to construct the dynamic web pages (presentation Layer) for the application.
  • Used Spring Boot framework for building cloud Micro Services and to develop Spring based application radically faster with very less configuration.
  • Analyzed the Maven dependency management in base code in order to annotate the dependencies on to Spring Boot application in to Gradle for Micro Services.
  • Implemented API controllers (SOAP and REST) and web services client classes to interact with downstream systems.
  • Worked with core Java technologies like Multi-Threading and synchronization.
  • Developed internal coding using J2EE technologies based on the MVC Architecture.
  • Implemented Business Logic using Java, Spring MVC and Hibernate.
  • Followed Test Driven Development (TDD) during the entire development phase.
  • Used Spring Data Framework to use the features of Spring JDBC and Spring ORM classes like JDBC Template and Hibernate Template to perform the database operations by connecting to Data sources available.
  • Developed user interface as JSFs, prime faces, HTML and CSS and BOOTSTRAP with custom tag libraries using JSF Framework.
  • Developed build and deployment scripts using MAVEN as build tools in Jenkins to move from one environment to other environments.
  • Optimized the full text search function by connecting to MongoDB.
  • Used JIRA ticketing system to keep track of issues and tasks on individuals.
  • Used Maven to build the application and deployed on WebSphere Application Server.
  • Used GITHUB as version control tool.

Environment: Java, J2SE, HTML5, CSS3, JQuery, Ajax, Bootstrap, Node JS, JSON, J2EE, Spring Framework 4.2.0, Spring MVC 4.2, Spring Security, Spring Boot, Spring Data (Spring JDBC, Spring ORM), JSP2.0, Hibernate.

Confidential, TX

Java Developer

Responsibilities:

  • Involved in all stages of Software Development Life Cycle (SDLC) of the project in agile methodology.
  • Involved in gathering business requirements, analyzing the project and created UML diagrams such as Use Cases, Class Diagrams, Sequence Diagrams and flowcharts for the Optimization module using Microsoft Visio and UML.
  • Developed the applications using Java/J2EE standards and guidelines.
  • Developed the UI Screens using JSP, JavaScript and HTML and did the client-side validation with the JavaScript.
  • Used Spring MVC (Model View Controller) to handle/intercept the user requests and used various controllers to delegate the request flow to the Backend tier of the application.
  • Extensively used Hibernate 3.0 in data access layer to access and update information in the database.
  • Designed asynchronous messaging using Java Message Service (JMS) to exchange of critical Business data and events among J2EE components and legacy systems.
  • Designed test cases using Junit for unit testing, performed functional integration system and validation testing.
  • Involved in Managing Web Services and operations.
  • Involved in developing the core base Classes and designed the packaging needed for the project.
  • Integrated various modules and deployed them in WebSphere Application Server.
  • Responsible for debugging, testing, maintaining and deploying the applications.

Environment: Java 1.7, JavaScript, HTML, CSS, Angular JS 1.5, REST web services, SOAP, Junit, Eclipse, Tomcat, Postman, GIT.

We'd love your feedback!