We provide IT Staff Augmentation Services!

Hadoop Developer Resume

0/5 (Submit Your Rating)

Medford, MA

SUMMARY

  • 8+ years of professional experience in IT, including 3+ years of work experience in Big Data, Hadoop Development and Ecosystem Analytics in Banking, Food & Beverage, Healthcare, Insurance and State Project sectors.
  • Well versed in installation, configuration, supporting and managing of Big Data and underlying infrastructure of Hadoop Cluster.
  • Hands on experience on major components in Hadoop Ecosystem like Hadoop Map Reduce, HDFS, HIVE, PIG, Pentaho, HBase, Sqoop, Oozie, Flume and Avro.
  • Experienced teh Hadoop using Puppet labs.
  • Experience in managing and reviewing Hadoop Log files.
  • Experience wif Oozie Workflow Engine in running workflow jobs wif actions that run Hadoop Map/Reduce and Pig jobs.
  • Experience in importing and exporting teh data using Sqoop from HDFS to Relational Database systems/mainframe and vice - versa.
  • Experience in setting up automated monitoring and escalation infrastructure for Hadoop Cluster using Ganglia and Nagios.
  • Work experience wif cloud infrastructure like Amazon Web Services (AWS).
  • Experienced teh integration of various data sources like Java, RDBMS, Shell Scripting, Spreadsheets, and Text files.
  • Experience in Web Services using XML, HTML and SOAP.
  • Excellent Java development skills using J2EE, J2SE, Servlets, JUnit, JSP, JDBC.
  • Experience using middleware architecture using Sun Java technologies like J2EE, JSP, Servlets, and application servers like Web Sphere and Web logic.
  • Familiarity working wif popular frameworks likes Struts, Hibernate, Spring MVC and AJAX.
  • Ability to blend technical expertise wif strong Conceptual, Business and Analytical skills to provide quality solutions and result-oriented problem solving technique and leadership skills.

TECHNICAL SKILLS

Hadoop Ecosystem: HDFS, Map Reduce Hive, Pig, Jaspersoft, HBase, Zookeeper, Sqoop, Oozie, Flume and Avro.

Web Technologies: Core Java, J2EE,Servlets,JSP,JDBC,XML,AJAX,SOAP, WSDL

Methodologies: Agile, UML, Design Patterns (Core Java and J2EE)

Frameworks: MVC, Struts 2/1, Hibernate 3, Spring 3/2.5/2

Programming Languages: Java, XML, Unix Shell scripting, HTML.

Data Bases: Oracle 11g/10g, DB2, MS-SQL Server, MySQL, MS-Access

Web Services: Web Logic, Web Sphere, Apache Tomcat

Monitoring & Reportingtools: Ganglia, Nagios, Custom Shell scripts

PROFESSIONAL EXPERIENCE

Confidential, Medford, MA

Hadoop Developer

Environment: Hadoop 1x, HDFS, Map Reduce, Hive 10.0, Pig, Sqoop, Ganglia, HBase, Shell Scripting

Responsibilities:

  • Proactively monitored systems and services, architecture design and implementation of Hadoop deployment, configuration management, backup, and disaster recovery systems and procedures.
  • Involved in Analyzing system failures, identifying root causes, and recommended course of actions.
  • Documented teh systems processes and procedures for future references.
  • Worked wif systems engineering team to plan and deploy new Hadoop environments and expand existing Hadoop clusters.
  • Monitored multiple Hadoop clusters environments using Ganglia.
  • Monitored workload, job performance and capacity planning using Cloud era Manager.
  • Worked wif application teams to install operating system, Hadoop updates, patches, version upgrades as required.
  • Installed and configured Flume, Hive, Pig, Sqoop and Oozie on teh Hadoop cluster.
  • Used Flume to collect, aggregate, and store teh web log data from different sources like web servers, mobile and network devices and pushed to HDFS.
  • Performed Map Reduce programs on log data to transform into structured way to find user location, age group, spending time.
  • Analyzed teh web log data using teh HiveQL to extract number of unique visitors per day, page views, visit duration, most purchased product on website.
  • Exported teh analyzed data to teh relational databases using Sqoop for visualization and to generate reports by our BI team.
  • Responsible to manage data coming from different sources.
  • Integrated Oozie wif teh rest of teh Hadoop stack supporting several types of Hadoop jobs out of teh box (such as Map-Reduce, Pig, Hive, and Sqoop) as well as system specific jobs (such as Java programs and shell scripts).
  • Involved in Installing and configuring Kerberos for teh authentication of users and Hadoop daemons.

Confidential, Reno, NV

Hadoop Developer

Environment: Hadoop Cluster, HDFS, Hive, Pig, Sqoop, Linux, Hadoop Map Reduce, HBase, Shell Scripting.

Responsibilities:

  • Responsible for building scalable distributed data solutions using Hadoop.
  • Responsible for Cluster maintenance, adding and removing cluster nodes, Cluster Monitoring and Troubleshooting, Manage and review data backups and log files.
  • Analyzed data using Hadoop components Hive and Pig.
  • Worked hands on wif ETL process.
  • Responsible for running Hadoop streaming jobs to process terabytes of xml's data.
  • Load and transform large sets of structured, semi structured and unstructured data using Hadoop/Big Data concepts.
  • Involved in loading data from UNIX file system to HDFS.
  • Responsible for creating Hive tables, loading data and writing hive queries.
  • Handled importing data from various data sources, performed transformations using Hive, Map Reduce, and loaded data into HDFS.
  • Extracted teh data from Teradata into HDFS using teh Sqoop.
  • Exported teh patterns analyzed back to Teradata using Sqoop.
  • Installed Oozie workflow engine to run multiple Hive and Pig jobs which run independently wif time and data availability.

Confidential - Carson City, NV

J2EE Developer

Environment: Java/J2EE, Oracle 11g, SQL, JSP, Struts 1.2, Hibernate 3, Web Logic 10.0, HTML, AJAX, Java Script, JDBC, XML, JMS, UML, JUnit, log4j, Web Sphere, My Eclipse

Responsibilities:

  • Utilized Agile Methodologies to manage full life-cycle development of teh project.
  • Implemented MVC design pattern using Struts Framework.
  • Form classes of Struts Framework to write teh routing logic and to call different services.
  • Created tile definitions, Struts-config files, validation files and resource bundles for all modules using Struts framework.
  • Developed web application using JSP custom tag libraries, Struts Action classes and Action.
  • Designed Java Servlets and Objects using J2EE standards.
  • Used JSP for presentation layer, developed high performance object/relational persistence and query service forentire applicationutilizingHibernate.
  • Developed teh XML Schema and Web services for teh data maintenance and structures.
  • Used Web Sphere Application Server to develop and deploy teh application.
  • Worked wif various Style Sheets like Cascading Style Sheets (CSS). In coding for JUnit Test cases.

Confidential, Seattle, WA

Java/J2EE Developer

Environment: Spring MVC, Oracle 11g J2EE, Java, JDBC, Servlets, JSP, XML, Design Patterns, CSS, HTML,JavaScript 1.2, JUnit, Apache Tomcat, My SQL Server 2008.

Responsibilities:

  • Involved in various phases of Software Development Life Cycle (SDLC) as design development and unit testing.
  • Developed and deployed UI layer logics of sites using JSP, XML, JavaScript, HTML/DHTML, and Ajax.
  • CSS and JavaScript were used to build rich internet pages.
  • Agile Scrum Methodology been followed for teh development process.
  • Designed different design specifications for application development that includes front-end, back-end using design patterns.
  • Developed proto-type test screens in HTML and JavaScript.
  • Involved in developing JSP for client data presentation and, data validation on teh client side wif in teh forms.
  • Developed teh application by using teh Spring MVC framework.
  • Collection framework used to transfer objects between teh different layers of teh application.
  • Developed data mapping to create a communication bridge between various application interfaces using XML, and XSL.
  • Spring IOC being used to inject teh parameter values for teh Dynamic parameters.
  • Developed JUnit testing framework for Unit level testing.
  • Actively involved in code review and bug fixing for improving teh performance.
  • Documented application for its functionality and its enhanced features.
  • Created connection through JDBC and used JDBC statements to call stored procedures.

Confidential -Memphis, TN

Java Developer

Environment: J2EE, JDBC, Java 1.4, Servlets, JSP, Struts, Hibernate, Web services, SOAP, WSDL, Design Patterns, MVC, HTML, JavaScript 1.2,WebLogic 8.0, XML, Junit, Oracle 10g, My Eclipse.

Responsibilities:

  • Played an active role in teh team by interacting wif welfare business analyst/programspecialists and converted business requirements into system requirements.
  • Developed analysis level documentation such as Use Case, Business Domain Model, Activity & Sequence and Class Diagrams.
  • Conducted Design reviews and Technical reviews wif other project stakeholders.
  • Implemented Services using Core Java.
  • Developed and deployed UI layer logics of sites using JSP.
  • Struts (MVC) is used for implementation of business model logic.
  • Worked wif Struts MVC objects like Action Servlet, Controllers, and validators, Web Application Context, Handler Mapping, Message Resource Bundles and JNDI for look-up for J2EE components.
  • Developed dynamic JSP pages wif Struts.
  • Used built-in/custom Interceptors and Validators of Struts.
  • Developed teh XML data object to generate teh PDF documents and other reports.
  • Used Hibernate, DAO, and JDBC for data retrieval and medications from database.
  • Messaging and interaction of Web Services is done using SOAP.
  • Developed JUnit Test cases for Unit Test cases and as well as System and User test scenarios
  • Involved in Unit Testing, User Acceptance Testing and Bug Fixing.
  • Implemented mid-tier business services to integrate UI requests to DAO layer commands.

We'd love your feedback!