We provide IT Staff Augmentation Services!

Data Engineer Resume

0/5 (Submit Your Rating)

SUMMARY:

  • Over 18+ years of IT experience in system analysis, design, development, testing, implementation, low latency and high - throughput systems.Hands on Java, Scala, J2EE, REST API, Spring, Spring Boot, DB2, Oracle, SQL Server, MySQL, MongoDB, WebSphere, WebLogic, JBoss, Maven and GIT. Big Data application development specialized in Spark Core, Spark Streaming, Spark SQL, MapR Event Streams, MapR DB, MapR FS, Scala and Drill.
  • Hands on work experience with the tools in Hadoop Ecosystem including Hive, HDFS, Kafka, Spark Streaming, Yarn, Oozie, Zookeeper, Apache Spark Core, Spark Streaming, Spark SQL, MapR Event Streams, Scala, MapR DB, MapR FS, Drill.
  • Hands on work experience in writing applications on NoSQL databases MapR DB, HBase, Cassandra and MongoDB.
  • Developed and deployed large scale n-tier Enterprise / Web applications using IBM WebSphere, WebLogic, JBoss and Tomcat
  • Strong experience in System Integration using Service Oriented Architecture (SOA) Web services and MQ Series.
  • Hands on experience in Front-end technologies JavaScript, Kendo UI, jQuery, JSON, Ajax, HTML 5, CSS 3, AngularJS.
  • Experienced in working with Amazon Web Services (AWS) EC2, S3 and Google Cloud Platform (GCP).

TECHNICAL SKILLS:

Big Data Technologies: MapR Hadoop Distribution YARN, Pig, HIVE, MapR-DB, HBase, MapR Streams, Kafka, Spark

Data Layer: MapR-FS, HDFS

Real-time Data Processing: Apache Spark, Kafka and MapR Streams

Big Data Workflow: Oozie

Data Access: Pig, Sqoop, Hive, Cassandra, Drill, HBase

Languages: Java, Scala, SQL, HiveQL, Spark SQL, Java Script, Shell Scripting

Java & J2EE Technologies: Core Java, Servlets, Hibernate, Spring, Spring Boot, Spring Batch, Spring MVC, Spring Data, Spring Integration test, Spring Unit test, Struts, JMS, EJB, RESTful API

Application Servers: Web Logic, Web Sphere, JBoss, Tomcat.

Cloud: AWS (S3, EC2), GCP

Databases: Microsoft SQL Server, MySQL, Oracle, DB2, MongoDB

Build Tools: Jenkins, Maven, ANT

Operating Systems: Linux/Unix, Mac and Windows

PROFESSIONAL EXPERIENCE:

Confidential

Data Engineer

Responsibilities:

  • Working in Professional Services on big data projects implementing Confidential distribution of Hadoop.
  • Built data pipelines to get the customer behavior data in real-time using technologies - MapR Streams (Kafka implementation), MapR DB (HBase) and Spark Streaming
  • Developed the spark batch jobs using Apache Spark framework/Scala.

Confidential

Lead Developer

Responsibilities:

  • Developed Applications using Java, J2EE, REST Web services, JSP, Hibernate, Spring Boot, Kendo UI, JSON, WebSphere 8.5, RAD 9, Maven, GitHub, Clear case, Jira, DB2, JMS, MQ, JQuery, AngularJS.
  • Developed data pipelines using Kafka, Spark Streaming, Spark SQL and MongoDB
  • Developed Restful Web Services, hibernate persistent classes, Spring Controller classes, Spring data, Spring Batch and Stateless Session Beans.
  • Developed application to convert data from DB2 tables to MongoDB JSON format
  • Developed JSP web pages using Kendo UI Components and JQuery.
  • Developed Kendo GRID components invoked REST web services using Data Source framework to populate the data on webpage.
  • Developed Kendo UI templates and validated the form data using Kendo Validator and Kendo UI screens using Model View View Model (MVVM) is a design pattern
  • Developed applications to integrate with Open Text RightFax fax server solutions
  • Developed Shell scripts to invoke Java standalone applications run as Batch jobs on LINUX.
  • Developed Python script for automating deployment procedure for WebSphere application server and Deployed J2EE system on WebSphere application server using Jenkins.
  • Developed authentication and authorization RESTful webservice and deployed as Micro Service.
  • Developed external technical design documents created component diagrams and sequence diagrams and translated all requirement document into technical design and created database design and generated DDL and created tables and indexes and sequences.
  • Created a cluster on WebSphere applications servers and deployed the J2EE applications and tested fail over scenarios by brought down one server instance.
  • Configured the Load balancer on WebSphere applications server and performed load testing using HP Load Runner
  • Developed java applications to populate data on PDF forms using Adobe iText API
  • Developed client application code based on WSDL to invoke SOAP based web services hosted in CASS system.
  • Configured and deployed Shibboleth identity provider application to do single sign on with external vendors
  • Developed java single sign on applications to connect AD/LDAP to authenticate users
  • Developed application using Spring unit test and Spring Integration test

Confidential

Sr. J2EE Developer

Responsibilities:

  • Developed Applications using Java, J2EE, EJB, JSP, JDBC, STRUTS, Tiles, Hibernate, Spring, AJAX, JavaScript, CSS, Eclipse3.2, Design patterns (Observer, Decorator, Strategy, Session façade and Data access object, Abstract factory), Weblogic8.1 and Oracle10g.
  • Developed messaging bus which polls wireless controller in specified intervals gets the response in xml format and parse the xml and updates the database
  • Designed and Developed Event Manager, Event Listener API which handles topology events, generates alarm based on its severity level and updates the database.
  • Developed Stateless Session Beans, Struts Action classes, Form classes, JSP custom tags, unit test cases using JUnit framework, Data Transfer Objects(DTO), Value Objects (VO)
  • Designed and Developed XML Schema using XML Spy, using JAXB API converted XML schema to Java code, parsed XML to java objects and vice versa
  • Tested the system using JProfiler to find out potential memory leaks and fixed the memory leaks

Confidential

Sr. Java Developer

Responsibilities:

  • Developed Applications using Java, EJB, JSP, JSF, JDBC, J2EE, MQ Series, Web Services, STRUTS, Hibernate, JavaScript, CSS, Eclipse, Stateless Session Beans, Stateful Session Beans, Message Driven Bean (MDB), Struts Action classes, Form classes, JSP custom tags Design patterns (Business delegate, Session façade and Data access object, Service Locator, Abstract factory), Weblogic8.1 and Oracle10g.
  • Developed Stateless Session Beans, Stateful Session Beans, Message Driven Bean (MDB), Struts Action classes, Form classes, JSP custom tags, Data Transfer Objects(DTO), Value Objects (VO)
  • Used MQSeries as the message middleware between back office system and J2EE web interface. Developed MQSeries listener which listens on queue reads data in XML format and parses into java object and updates the database.
  • Design patterns used Business delegate, Session façade and Data access object, Service Locator, Abstract factory, Command pattern, Value Object
  • Deployed system into Weblogic8.1, JBoss4.x, and ORION2.x application server, used Xdoclet to generate META-INF files like ejb-jar.xml
  • Designed and Developed Data Migration Toolkit utility application using Swing GUI, which reads data from text file (which is in specified format) insert into selected database. Database name, url, userid and password can be changed on fly through UI
  • Developed applications using Hibernate persistent frame work, developed persistent classes, hibernate-mapping files.hbm.xml file, hibernate query language
  • Developed applications using Bea Weblogic Portal 8.1 and Weblogic Workshop
  • Developed AOP based spring and Hibernate framework and other infrastructure components for use in J2EE applications and employed the Dependency Injection (DIP)/Inversion of Control (IOC).
  • Developed Search module using Value List Handler design pattern, JDBC, DAO, Stateful Session Bean, Struts Action classes
  • Developed Container Managed Persistence (CMP) EJBs used CMR relations, wrote EJB-QL queries, Message Driven Bean (MDB), Stateless Session Beans, Value Objects and Data Transfer Objects

Confidential

Sr. Software Consultant

Responsibilities:

  • Developed applications using Java, EJB, Java Servlets, Struts Framework JSP, WSAD, JavaScript, DB2, WebSphere 5.1, MQSeries, JDBC, J2EE, SessionFacade pattern, Ant, VSS, Toad.
  • Developed XML transformer to transform one XML to another XML using XSLT JAXP API
  • Developed applications using JAXP, SAX, DOM API to parse XML to java object and vice versa.
  • Developed Bean Managed Persistence (BMP) beans, wrote persistence logic in Data Access Object (DAO) BMP invokes DAOs, used Abstract Factory Method Design pattern.
  • Wrote UNIX shell scripts to perform batch jobs, for backing up full system, which includes the database. Automated the programs to run when system boot up, Shutdown and startup
  • Design patterns used DAO, SessionFacade, Business Delegate and Deployed FPS system into Jboss application server and Weblogic6.1 application server both on Solaris (Unix) and Windows

Confidential

Software Developer

Responsibilities:

  • Developed applications using Java, J2EE, JSP, EJB, Swing, Websphere Studio Application Developer (WSAD), and IBM Web Sphere 3.5, DB2, Ant, JDBC, Dreamweaver, Clear Case, Clear Quest and Java script.

Confidential

Software Developer

Responsibilities:

  • Developed application using Java, EJB, JSP, XML mappings, SAX, DOM, XSL, XML Schema, MQ Series, EAI, Caster, WebSphere 4.0, Java Servlets, Oracle8i, JDBC, VSS, Ant.

Confidential

Software Developer

Responsibilities:

  • Developed application using Java, Java servlets, EJB, JSP, JDBC, Oracle8i, Weblogic 5.1 Application server, JBuilder, Java Script, Toad, Ant build.xml

We'd love your feedback!