We provide IT Staff Augmentation Services!

Hadoop Developer Resume

4.00/5 (Submit Your Rating)

Lynchburg, VA

SUMMARY

  • Over 6 years of professional experience in designing, developing, debugging Web - based and Enterprise applications.
  • Over 3 years of experience on major Hadoop ecosystem’s projects such as Map-Reduce, PIG, HIVE andHBASE.
  • Good working experience using Sqoop to import data into HDFS from RDBMS and vice versa.
  • Good knowledge in using job scheduling and monitoring tools like Oozie and ZooKeeper.
  • Experienced in Hadoop administration activities such as installation and configuration of clusters using Cloudera.
  • Involved in developing distributed Enterprise and Web applications using UML, Java/J2EE, Web technologies that include EJB, JSP, Servlets, Struts 2, JMS, JDBC, HTML, XML, XSL, XSLT, Java Script, Spring and Hibernate.
  • Designed Use Case diagrams, Class diagrams, Activity diagram, Sequence diagrams, Flow Charts, and deployment diagrams using Rational Rose Tool.
  • Experience in Web application development using Java, Servlets, JSP, JSTL, Java Beans, EJB, JNDI, JDBC, Struts, HTML, DHTML, CSS, PHP,XML, XSL/XSLT and AJAX. s
  • Experience with IDE’s like Eclipse, NetBeans, RAD, and JBuilder for developing J2EE/JAVA applications.
  • Experience with design Patterns like MVC, Singleton, Factory, Proxy, DAO, Abstract, Prototype and Adaptor.
  • Experience with J2EE application server like WebLogic, IBM Web Sphere, GlassFish, and Tomcat.
  • Experience in Relational Database Management Systems such as SQL Server, DB2, Oracle and PL/SQL.
  • Proficient in writing and handling SQL Queries, Stored Procedures, and triggers.
  • Experience with frameworks like JUnit and Log4J.
  • Experience with optimization tools like JProbe and JConsole.
  • Hands on experience in knowledge of user acceptance, Black Box, White box and Unit testing.
  • Knowledge of multi-vendor operating systems includingLinux,Windows andUNIX Shell Script.
  • Experienced in using Agile software methodology.
  • Willing to learn and adapt to new technologies

TECHNICAL SKILLS

Programming Languages: Java, C, C++

Java API/Frameworks: Servlets, web services, SOAP, Rest, JSP, JDBC, JNDI, EJB, RMI, JPA, JMS, Struts 2, Spring, Hibernate.

Hadoop Ecosystem: Map-Reduce, Hive, Pig, Hbase, Flume, Sqoop, ZooKeeper,Oozie,Cloudera

Web Technologies: HTML, DHTML, DOM, JavaScript, php, AJAX, CSS

XML Technologies: XML, DOM, SAX, XSL, XSLT, JNDI, WSDL

Application/Web Servers: WebLogic, GlassFish, IBM WebSphere, Apache Tomcat

Databases: SQL Server, MySQL, PL/SQL, Oracle, DB2

IDE Tools: Eclipse, JBuilder, NetBeans, Visual Studio

Operating Systems: Windows, UNIX, LINUX.

Tools: Rational Rose, JUnit, Log4j, JConsole, JProbe

Design Methodologies: UML, Rational Rose

PROFESSIONAL EXPERIENCE

Confidential, Lynchburg, VA

Hadoop Developer

Responsibilities:

  • Wrote MapReduce jobs and pig scripts using various input and output formats. Also designed custom format as per the business requirements.
  • Wrote extensive MapReduce jobs in Java to train the cluster and developed Java MapReduce programs for the analysis of sample log files stored in cluster.
  • Analyzed large and critical datasets using Cloudera, HDFS, Hbase, MapReduce, HIVE, and HIVE UDF. Pig, Sqoop, Zookeeper and Spark.
  • Created and modified UDF and UDAF’s for Hivewhenever necessary and developed HIVE queries to analyze data and generate results.
  • Developed Pig UDF’s for preprocessing the data for analysis.
  • Involved in installing Hadoop Ecosystem components and configured multi node Hadoop cluster.
  • Used SQOOP to dump data from MySQL relational database into HDFS for processing and exporting data to RDMS.
  • Involved in writing HIVE queries for data analysis with respect to business requirements.
  • Automated all the jobs, for pulling net flow data from the relational databases to load data into Hive tables, using Oozie workflows and enabled email alerts on any failure cases.
  • Integrated
  • Wrote Hive and Pig scripts as ETL tool to do transformations, event joins, filter both traffic and some pre-aggregations before storing into the HDFS.
  • Worked with Flume to import the log data from the reaper logs and syslog’s into the Hadoop cluster.
  • Used complex data types like bags, tuples and maps in Pig for handling data.
  • Created workflow and coordinator using Oozie for regular jobs and to automate the tasks of loading the data into HDFS
  • Configured connection between HDFS and Tableau using Impala for Tableau developer team.
  • Worked on streaming analyzed stream of data into relational database using Sqoop for making it available for visualization and report generation by the BI team.
  • Experienced with handling administration activations using Cloudera manager.
  • Developed request/response paradigm by using Spring Controllers, Inversion of Control and Dependency Injection with Spring MVC.
  • Used Web Services like SOAP and WSDL to communicate over internet.
  • Used JProbe and JConsole to profile application for memory leaks and resource utilization.
  • Deployed the application using WebLogic Application Server and Oracle as database server.

Environment: Java, JDBC, Spring, Hibernate SOAP, WSDL, WebLogic Apache Hadoop, HDFS, Pig, Sqoop, Spark, MapReduce, CloudEra, Avro, Snappy, Zookeeper, NoSQL, Hbase, Cassandra, Oracle,Shell Scripting, Ubuntu, Flume, Tableau, Agile, Impala, Linux Red Hat, MySQL, Angular JS

Confidential - Moline, IL

Hadoop Developer

Responsibilities:

  • Assisted administrator in setting up Hadoop cluster andcreated maintenance shell scripts.
  • Wrote MapReduce jobs and pig scripts using various input and output formats, also designed custom format as per the business requirements.
  • Setup a 20 node cluster to run Hadoop, Pig, Hive and Hbase for test use and provided architectural guidance for expansion of Hadoop Cluster.
  • Coordinated cluster services using ZooKeeper.
  • Managed, reviewed and interpretedHadoop log files. Involved with the application teams to install Hadoop updates, patches and version upgrades as required.
  • Performed data validation on the data ingested usingMapReduce by building a custom model to filter all the invalid data and cleansing the data.
  • Collecting and aggregating large amounts of log data using ApacheFlume and staging data in HDFS for further analysis.
  • Integrated Oozie with rest of the Hadoop stack supporting several types of Hadoop jobs out of the box (Pig, Hive, and Sqoop) as well as system specific jobs such as Perl and shell script.
  • Used Oozie job scheduler to automate the job flows.
  • Assisted business users in ad-hocqueries and data metrics using Pig and Hive.
  • Created Pig, Latinscripts to clean up data for further analysis in HIVE
  • Participated in performance and optimization for MapReduce programs, Hive Scripts and Pig Latin scripts
  • Implemented Database access through JDBC at Server end with Oracle.
  • Designed applications using Struts with Tiles and Validator, implementing MVC design pattern and writing custom TagLibraries, JSP, JavaBeans, StrutsController.
  • Executed Object relational mapping and persistence mechanism using HibernateORM.
  • Installed and configured Hive and also wrote UDF’s that helped spot market trends.
  • Worked with Hbase in creating Hbase tables to load large sets of semi structured data coming from various sources.
  • Created struts-config.xml file for the action servlet to extract data from specified Action form so as to send it to specified instance of action class.
  • Maintained the system UI using Angular JS framework, JavaScript, jQuery, HTML, CSS, Ajax.

Environment: Java, Struts, JSP,JDBC, Spring, XML, Hibernate, Hadoop, HDFS, Pig, Hive, Hbase, MapReduce, Java, Oozie, MAHOUT, Linux, UNIX Shell Scripting, NoSQL databases, Cloudera, Impala, Flume, Tableau, Angular JS, JavaScript, jQuery, HTML5, CSS, Ajax

Confidential, Atlanta, GA

Java Developer

Responsibilities:

  • Developed various UML diagrams like use cases, class diagrams, interaction diagrams (sequence and collaboration) and activity diagrams.
  • Involved in multi-tiered J2EE design utilizing Spring Inversion of Control (IOC) and Hibernate deployed on WebSphere Application Server connecting to Oracledatabase.
  • Responsible for data reconciliation with EOD files using scheduled batch processes.
  • Responsible for system development using J2EE architecture.
  • Used Spring framework for dependency injection, transaction management and AOP.
  • Involved in Spring MVC model integration for front-end request action controller.
  • Using Spring ORM support, Hibernate for development of DAO layer.
  • Involved in implementing the DAO pattern for database connectivity and Hibernate.
  • Created procedures, triggers, functions and packages using PL/SQL.
  • Created Web Services for Remote calling using SOAP.
  • Development of JPA Entities and Hibernate DAO for data fetching for batch and front-end processing.
  • Used the inner join, outer join, cross join while writing the complex SQL Queries.
  • Managed performance and tuning of SQL queries and fixed the slow running queries in production with utilities like Explain, Trace and Stored Outlines.
  • Used various Java, JEE design patterns like Factory,SessionFaçade, DAO, DTO etc.
  • Worked on projectdeploymentfiles such as web.xml and context definition files for servlet mappings, Java bean class definitions. Action Classes mappings, transactions, JSPs declarations, validation and database connection pooling.
  • Design and code web services using Apache Axis, WSDL on WebSphere App server.
  • Involved in the development or presentation layer and GUI framework in JSP and AngularJS.
  • Client Side validations were done using JavaScript.
  • Implemented error handling including logging critical errors to database.
  • Involved in Designing the Database and developed Stored Procedures, triggers.
  • Used XML for data and message exchange over HTTP.

Environment: J2SE,J2EE,JDK 1.3, RAD 6.x, IBM WebSphere Application Server 6.x, Tomcat 5.x, JDBC 2.0, JNDI 1.2, JSP 1.2, Struts 2.0, Log4j, RMI, EJB 2.0, MySQL 5.1, JMS 1.0.2, Web Services, Rest, Cold Fusion, JPA, AJAX, Linux, Dreamweaver, Junit, Swing, HTML, DHTML, XHTML, CSS, XML, XSL, XSLT, JavaScript, Apache Ant, SQL Server, PL/SQL, Oracle, Toad, AJAX, UML/Rational Rose 2000, UNIX, ClearCase

Confidential, Greenville, SC

Java Developer

Responsibilities:

  • Involved in Requirements gathering, analysis, design, development, Testing and Maintenancephases of Confidential Bank online processing.
  • Implemented Agile development process on Software Development Life Cycle.
  • Involved in using spring concepts - DI/IOC, AOP, Batch Implementation and Spring MVC.
  • Used Apache CXF to create web services.
  • Involved in creating Restful web services using JAX RS and JERSEY tool.
  • Involved in writing SQL queries &PL/SQL - Stored procedures, functions, triggers, cursors, object, types, sequences, indexes etc.
  • Involved in peer and lead level design and code reviews.
  • Involved in deploying the application in UNIX and to connect to see logs for fixing UAT/Production defects. Designed and implemented applicationusing Spring, Spring IOC, Spring Annotations, Spring MVC, Spring Transactions, Hibernate 3.0, SQL, IBM WebSphere 8 and JBoss
  • Actively participated in the daily SCRUM meetings to produce quality deliverables within time.
  • Used REST and SOAP Web Services to exchange information.
  • Used JMS for vendor communication.
  • Used Spring AOP for logging.
  • Involved in multi-tiered J2EE design utilizing SpringIOC architecture and Hibernate.
  • Wrote server-side test cases using Junit.
  • Involved in Analysis, Design and Implementation of Business User Requirements
  • Implemented Java and J2EE Design Patterns like Business Delegate, MVC, Singleton Factory, Data Access Object (DAO), Service Locator and Chain of Responsibility.
  • Wrote SQL queries using Oracle database
  • Included Client side coaching using AngularJS
  • Included Server side caching using Hibernate EH Cache
  • Designed a responsive UI using Bootstrap.
  • Used Maven to build war and EAR files to deploy on Application Servers
  • Worked on bug fixing and enhancements on change request.
  • Configured and customized logs using Log4J
  • Resolved defects and worked with QA team for testing
  • Provided production support for the application after deployment
  • Used SVN as Version Control Tool.
  • Used Maven to build projects.
  • Provided development whenever necessary.

Environment: Java 1.5, J2EE, Java Script, AJAX, IBM Web Sphere 8, IBM Clear case, Spring Framework-IOC, AOP, MVC, JDBC Template, Ajax, JQuery, AngularJS, Eclipse Web Services - SOAP & Restful, CXF, WSDL, SOAP, Junit, Mockito, JMS, Agile Methodology, SCRUM, Design Patterns, Servlet, JSP, XML, SVN, Oracle 11g, SQL Developer, Junit, Eclipse, Maven, Log4J,JBoss 7

Confidential, Nashville, TN

Java/J2EE Developer

Responsibilities:

  • Extensively used Eclipse IDE for building, testing and deploying applications.
  • Established two new functions, estimate value insurance quote module and current user verification in life insurance quote module from front end to back end.
  • Developed the whole framework for the projects, based on Struts and Spring MVC.
  • Developed the presentation layer and GUI framework based on spring framework involving JSP, HTML, JavaScript, AJAX, CSS, XML.
  • Also used Servlets to generate the dynamic pages with session management.
  • Involved in writing JavaScript functions and implementation of AJAX on presentation layer.
  • Developed controllers, repositories, Service modules from beans and validations.
  • Developed beans and persisted bean in the database using Hibernate.
  • Involved in development of Spring DAO layer which invoked database queries.
  • Created SQL queries, PL/SQL Stored Procedures, functions for the database layer by studying the required business objects and validating them with Stored Procedures also used JPA with Hibernate provider.
  • Involved in writing of Web Services using SOAP, WSDL, deployment configuration and testing.
  • Built the entire module using Maven and deployed it on Web Logic application server.
  • Implemented Junit framework to write test cases for different modules and resolved the test findings.
  • Used Subversion for software versioning and as a revision control system.
  • Made enhancements to the application which presented me with the opportunity to go through the entire SDLC.
  • Providing daily updates to the on-site team over call and making enhancements.
  • Assisted the Quality Assurance team in testing the applications.
  • Used JProbe and JConsole to profile application for memory leaks and resource utilization.

Environment: JDK 1.6, DAO, JPA,JSP, Servlets, Hibernate, Spring, Struts, Maven, Web Services, WebLogic, AJAX, JDBC, XML, CSS, DOM, HTML, Oracle 11g, UML, JUNIT,JQUERY.

We'd love your feedback!