Hadoop Developer Resume
Irvine, CA
SUMMARY
- 12+ years of professional experience in IT which includes about 2 years of work experience in Big Data, Spark, Kafka and Hadoop ecosystem related technologies in Government, Banking, Retail, and Entertainment Industry and Avionics sectors.
- Well versed in Development, Configuration, Supporting and Managing of Big Data and Underlying infrastructure of Hadoop Cluster.
- Excellent knowledge in Spark and Hadoop Architecture and its major components like Hadoop Map Reduce, HDFS Frame work, HIVE, PIG, Zookeeper, Sqoop, Oozie, Flume and Avro.
- Experience in importing and exporting the data using Sqoop and Flume from HDFS to Relational Database System and vice - versa.
- Experience with Oozie Workflow Engine to automate and parallelize Hadoop Map/Reduce and Spark jobs.
- Experience in analyzing data using HIVEQL, PIGLatin and custom MapReduce programs in JAVA.
- Worked with Distributed Message Broker like Kafka.
- Experience in writing custom UDF’s like UDAF’s and UDTF’s for extending Hive and Pig core functionality.
- Hands on experience in Scala for working with Spark Streaming.
- Understanding of NoSQL databases like HBase and Cassandra.
- Worked on design and implemented HIVE based data warehouse solution.
- Used Cloudera Manager Tool.
- Good understanding of cloud configuration in Amazon web services (AWS).
- Good experience in complete project life cycle (design, development and testing) of Web applications.
- Hands on Experience in application developments like Java, RDBMS.
- Implemented REST based webservices.
- Extensive knowledge in Java, J2EE, JSP, JDBC, Servlets, Hibernate, Struts and Spring Framework.
- Experience in configuring and deploying Web Applications using Web Logic, Tomcat and Apache.
- Experience using IDE like Eclipse, Scala IDE.
- Good communication skills, work ethics and the ability to work in a team efficiently.
TECHNICAL SKILLS
Big Data/Hadoop: Spark, Kafka, Spark Streaming, HDFS, Hadoop MapReduce, YARN, Zookeeper, Hive, Pig, Sqoop, Flume and Oozie.
Languages: Java, Scala, SQL.
Methodologies: Waterfall model.
Database: Hive, Oracle, MySQL.
Web Tools/Frameworks: HTML, XML, JDBC, EJB, JSON, JSP, Servlets, Struts, REST API, Spring and Hibernate.
Web/ App Server: Scripting
Operating System: GUI/IDE/ToolsJBoss, Tomcat, IBM Web Server and Oracle WebLogic Server. Shell Scripting, Java Script.
Windows and Linux: Eclipse, Scala IDE, SBT, WSAD, TOAD, Oracle JDeveloper.
PROFESSIONAL EXPERIENCE
Confidential, Irvine, CA
Hadoop Developer
Responsibilities:
- Importing and exporting data into HDFS from RDBMS and vice versa using Sqoop.
- Developed custom MapReduce jobs in java for preprocessing and data cleaning.
- Develop Spark code in Scala for preprocessing and data cleaning.
- Develop Spark Streaming code in Scala for loading data into HDFS.
- Creating Hive tables and working on them using HiveQL.
- Used SparkQL and DataFrames to work with Schema Data.
- Written Hive queries for data analysis to meet the business requirements.
- Hands on experience in scala for Spark streaming.
- Integrated Kafka and Spark Streaming using Scala.
- Responsible for developing PIG Latin scripts.
- Managing and scheduling batch Jobs on a Hadoop Cluster using Oozie.
- Experience in managing and reviewing Hadoop Log files.
- Used Zookeeper to provide coordination services to the cluster.
- Managing and scheduling Spark Jobs on a Hadoop Cluster using Oozie.
- Experienced in loading and transforming large sets of structured, semi-structured and unstructured data.
- Migration of ETL processes from MySQL to Hive to test the easy data manipulation.
- Written Hive queries to process the data for visualization.
- Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
- Implemented java Spring based REST web services.
- Worked on Java Spring based MVC code for frontend web application.
Environment: Hadoop, Spark, Kafka, Map Reduce, YARN, Sqoop, Oozie, HDFS, Hive, Pig, Java, Hadoop distribution of Cloudera 5.4/5.5, Linux,, XML, Eclipse, MySQL.
Confidential, Orlando, FL
Java/J2EE Developer
Responsibilities:
- Played an active role in the development of the application. The application is built using J2EE technologies.
- Designed and implemented front-end components using Spring/JSP and JavaScript’s.
- Used Spring Framework.
- Implemented data persistence to Oracle database using JDBC/IBATIS.
- Coordinated with the team to understand the existing system.
- Made Changes to the Configuration files
- Tested application for functionality.
- Created build/EAR file and deployed it in Jboss.
- Played an active role in the development of the application.
- The application is built using J2EE technologies.
- Designed and implemented front-end components using JSP/html and JavaScript’s.
- Used Struts framework.
- Implemented data persistence to Oracle database using JDBC.
- Coordinated with the team to understand the existing system.
- Made Changes to the Configuration files
- Tested application for functionality.
- Played an active role in the development of the application. The application is built using J2EE technologies.
- Designed and implemented front-end components using Struts/JSP and JavaScript’s.
- Used Struts Framework.
- Implemented data persistence to MS SQL Server database using JDBC/Firestorm.
- Coordinated with the team to understand the existing system.
- Used Design patterns like DAO, Transfer Objects and Factory Pattern.
- Made Changes to the Configuration files and web.xml file (Web Deployment Descriptors).
- Tested application for functionality.Played an active role in the development of the application.
- The application is built using J2EE technologies.
- Designed and implemented front-end components using JSP/html and JavaScript’s.
- Implemented data persistence to Oracle database using JDBC.
- Coordinated with the team to understand the existing system.
- Played an active role in the development of the application. The application is built using J2EE technologies.
- Designed and implemented front-end components using Spring/JSP and JavaScript’s.
- Used Spring Framework.
- Implemented data persistence to Oracle database using JDBC/IBATIS.
- Coordinated with the team to understand the existing system.
- Made Changes to the Configuration files
- Tested application for functionality.
Environment: Java/JVM 1.4, JSP, Spring, IBATIS, JDBC, tortoise CVS, JavaScript, Oracle, Eclipse, Win SCP, Squirrel, TOAD, Oracle WebLogic Server, ANT
Confidential, N Charleston, SC
Java/J2EE Developer
Responsibilities:
- Played an active role in the development of the application. The application is built using J2EE technologies and MVC pattern.
- Designed and implemented front-end components using Struts/JSP and JavaScript’s.
- Used Struts Framework.
- Implemented data persistence to DB2 database using JDBC/Hibernate and Data Source.
- Coordinated with the team to understand the existing system.
- Used Design patterns like DAO, Transfer Objects and Factory Pattern.
- Made Changes to the Configuration files and web.xml file (Web Deployment Descriptors).
- Tested application for functionality.
- Created EAR file and deployed it in WAS 5.
Environment: Java/JVM 1.4, Servlet, JSP, Struts 1.1, JDBC/Hibernate, CVS, JavaScript, XML, XSLT, HTML, DB2 7.2, DB2/390, WSAD 5.0 Domino/LDAP/SSO/Global Security, WAS 5 (Websphere Application Server) on AIX server, WSFTP Pro, Advanced Query Tool, DB Visualizer 4.0.
Confidential, LA, CA
Java/J2EE Developer
Responsibilities:
- Played an active role in the development of the application. The application is built using J2EE technologies and Struts Framework.
- Implemented EJB’s (both Session and Entity beans), which act as Models in Struts Framework, Servlets for server side functionality.
- Implemented Data Access Objects (DAO) design pattern, to encapsulate the database logic.
- Implemented data persistence to Oracle database using JDBC and Entity Beans.
- Implemented custom tags for Adjustments and Hierarchies in Struts framework.
- Implemented the necessary Form beans and Action classes as a part of Struts MVC framework.
- Designed and implemented front end components using JSP and JavaScript’s,
- Played a key role in the development of Generalized Data Access Object (DAO) to be used by any adjustments and Hierarchies for database persistence.
- Used Design Pattern, Factory Pattern to generate Data Models by parsing XML file that contains the Metadata of the models to be created.
- Wrote test cases for unit testing the code.
Environment: Java 1.4, EJB 2.0, Servlets, JSP, Struts 1.1, JDBC/SQL * NET, WinCVS, JavaScript, XML, XSLT, HTML, Oracle 9i, Design Pattern, WSAD 5.0(Websphere Studio Application Developer), LDAP, WAS (Websphere Application Server).
Confidential
Java/J2EE Developer
Responsibilities:
- Created Servlet and XML file to handle various Actions
- Used MVC/Struts design for the application
- Created java classes for the application and Java JSP form.
- Used java script for validation of page data in the JSP pages.
- Created Custom Tags classes
- Tested the application on IBM Websphere Application Server
- Created Enterprise Java Bean (EJB) for various modules
- Responsible for designing, coding and testing of application
- Did unit testing using based on test script
- Coded business logic involved in the application
Environment: JDK 1.2, J2EE, XML/XSL, EJB, Servlet, JSP, Custom Tag Libraries, Collections, WSAD 5, DB2 7.2, IBM Websphere Application Server and Windows 2000, TOAD, UML, Struts/MVC Design, VSS (Visual Source Safe)
Confidential, Baltimore, MD
Java/J2EE Developer
Responsibilities:
- Used JDeveloper to code various modules
- Deployed various Module on BEA Weblogic Server
- Created Java JSP form and servlet
- Used JDBC for working with Oracle Database
- Created classes to handle workflow logic
- Coded for business logic involved in the application
- Responsible for designing, coding and testing of application
- Involved in the implementation of the system
- Worked on Consumer module and Attendance Module
- Created sun.net.smtp.SmtpClient to send email
- Used Calendar and Gregorian Calendar for Attendance Module
- Used SQL, PL/SQL and Stored Procedures for back-end database.
Environment: JDK 1.2, J2EE, JSP, Servlet, Java Beans, JDeveloper, Oracle 8i, PL/SQL, Bea Weblogic Server and Windows NT, Visual Source Safe, TOAD
