We provide IT Staff Augmentation Services!

Hadoop Consultant Resume

3.00/5 (Submit Your Rating)

Cury, NC

SUMMARY

  • Over 7+ years of experience in IT industry with strong emphasis Object Oriented Analysis, Design, Development and Implementation, Testing and Deployment of Software Applications and Web enabled applications.
  • Around 2 years of experience with Hadoop, HDFS, MapReduce and Hadoop Ecosystem (Pig, Hive, HBase).
  • Experience writing Map Reduce Jobs, HIVEQL.
  • Good experience in optimizing MapReduce algorithm using combiners and partitioners to deliver teh best results.
  • Experience with Hbase, PIG and NoSQL.
  • Experience in designing Big Data solutions for traditional enterprise businesses.
  • Experience in Setting up Hadoop in various modes and integrating Hadoop Ecosystem with Hadoop.
  • Good experience in writing Map Reduce jobs using Java native code, Pig, Hive for various business use cases.
  • Good working experience on Red Hat Enterprise Linux Products.
  • Expertise in Java/J2EE technologies, such as Core Java, Struts, Spring, Hibernate, JDBC, EJB, JMS, JSP, JSTL, HTML, JavaScript, JQuery, JSON etc.
  • Good working experience as a Java/J2EE programmer developing applications using Servlets, JSP, JSTL, RMI, EJB, Struts, Spring, JSF, Java Beans, JDBC, JMS, Hibernate and MVC architecture.
  • Exposures working with design patterns like MVC, Front Controller, Data Accessor, Value Object, Singleton and Session Facade.
  • Experience working in Spring Framework, Struts Framework and Hibernate framework.
  • Good Understanding of Service Oriented Architecture (SOA) and Web Services with XML, XSD, WSDL and SOAP.
  • Experience in Object oriented analysis and design (OOAD), UML and Design Patterns.
  • Proficiency in programming with different Java IDE's like Eclipse, IntelliJ, IBM RAD 6.x/7.x, WSAD and NetBeans.
  • Strong experience in RDBMS technologies like SQL, Stored Procedures, Triggers, Functions.
  • Experience in Mercurial, SVN, ClearCase, version control systems.
  • Strong communication skills with professional attitude and can take teh pressures to drive with enthusiasm to support of client Hadoop Cluster environment with full potential.

TECHNICAL SKILLS

Big Data: Hadoop, MapReduce, HDFS, Hive, Pig, Sqoop, Zookeeper and HBase

Languages: Java, SQL, HTML, DHTML, JavaScript, XML, C/C++.

Java/J2EE Technologies: JSP, Servlets, JavaBeans, JDBC, JNDI, JTA, JPA, EJB 3.0

Design Patterns: MVC, Session Facade, Service Locator, Data Access Object, Data Transfer Object / Value Object, Business Delegate

Web Design Tools: HTML, DHTML, AJAX, JavaScript, jQuery and CSS

Version Control Tools: CVS, Rational Clear Case

Frameworks: Struts 1.1/2.0, Spring 2.5, Hibernate 3.0

Servers: Web Logic Server 10.3, JBoss 6.0, Tomcat 5.5/6.0

IDEs: NetBeans, Eclipse, IntelliJ, SQL Developer, Rational Rose for Java, JBuilder 4.0, Aptana.

Databases: Oracle 9i / 10g/11g, SQL Server 2008, MS - SQL Server.

Operating systems: Windows XP/NT, Linux, UNIX, DOS

PROFESSIONAL EXPERIENCE

Confidential, Cury, NC

Hadoop Consultant

Responsibilities:

  • Gatheird teh business requirements from teh Business Partners and Subject Matter Experts.
  • Involved in installing Hadoop Ecosystem components.
  • Used to manage and review teh Hadoop log files.
  • Responsible to manage data coming from different sources.
  • Supported Map Reduce Programs those are running on teh cluster.
  • Involved in HDFS maintenance and loading of structured and unstructured data.
  • Wrote MapReduce job using Java API.
  • Installed and configured Pig and also written PigLatin scripts.
  • Wrote MapReduce job using Pig Latin.
  • Involved in managing and reviewing Hadoop log files.
  • Imported data using Sqoop to load data from MySQL to HDFS on regular basis.
  • Developed Scripts and Batch Job to schedule various Hadoop Program.
  • Wrote Hive queries for data analysis to meet teh business requirements.
  • Created Hive tables and working on them using Hive QL.
  • Utilized Agile Scrum Methodology to halp manage and organize a team of 4 developers with regular code review sessions.
  • Weekly meetings with technical collaborators and active participation in code review sessions with senior and junior developers.
  • Used JUnit for unit testing and Continuum for integration testing.

Environment: Java Hadoop, MapReduce, HDFS, Hive, Java (jdk1.7), Pig, Linux, XML, MySQL, MySQL Workbench.

Confidential, Memphis, TN

Hadoop Consultant

Responsibilities:

  • Responsible for architecting Hadoop clusters with CDH3.
  • Extensively involved in Installation and configuration of Cloudera distribution Hadoop 2, 3, NameNode, Secondary NameNode, JobTracker, TaskTrackers and DataNodes.
  • Installed and configured Hadoop ecosystem like HBase, Flume, Pig and Sqoop.
  • Involved in Hadoop cluster task like Adding and Removing Nodes without any effect to running jobs and data.
  • Managed and reviewed Hadoop Log files.
  • Load log data into HDFS using Flume. Worked extensively in creating MapReduce jobs to power data for search and aggregation.
  • Worked extensively with Sqoop for importing metadata from Oracle.
  • Designed a data warehouse using Hive.
  • Created partitioned tables in Hive.
  • Mentored analyst and test team for writing Hive Queries.
  • Extensively used Pig for data cleansing.
  • Developed Pig Latin scripts to extract teh data from teh web server output files to load into HDFS.
  • Developed teh Pig UDF’S to pre-process teh data for analysis.
  • Developed workflow in Oozie to automate teh tasks of loading teh data into HDFS and pre-processing with Pig.
  • Cluster co-ordination services through ZooKeeper.

Environment: Hadoop, MapReduce, HDFS, Pig, Hive, HBase, ZooKeeper, Oozie, Java (jdk1.6), Oracle 11g/10g, PL/SQL, SQL*PLUS, Windows NT, UNIX Shell Scripting.

Confidential, Jersey City, NJ

J2EE Developer

Responsibilities:

  • Actively involved in Analysis, Detail Design, Development, Bug fixing and Enhancement in Agile methodology.
  • Created web services using SOAP. Teh calls and responses between client and server are transmitted as SOAP messages.
  • Used Middle Tier Frameworks like Spring ORM, Hibernate and JDBC to develop Database Related Code and Spring WS for teh WebServices.
  • WSDL generation from teh specified XSD.
  • Registered and used web services in WSRR (Web Services Registry and Repository).
  • Developed module to communicate with WSRR and obtain teh end point URL for a particular web service.
  • Designed and developed teh DB schema for teh module and participated in DB Design discussions.
  • Designed table structure and coded scripts to create tables, indexes, views, sequence, synonyms and database triggers. Involved in writing Database procedures, Triggers, PL/SQL statements for data retrieval.
  • Used Business Delegate, Singleton, Front Controller, Factory and DAO design patterns.
  • Mentored Junior Developers and performed code reviews.
  • Held training sessions about teh effective practices of coding.
  • Involved in teh creation of teh Functional Spec and User Manual.
  • Conducted brain storming sessions for resolution to problems.
  • Performed internal quality audits as per teh organization guidelines.
  • Code changes for Change Requests and enhancements.
  • Used Spring AOP module for creating transactions.
  • Used Hibernate to develop teh persistence layer.
  • Generated teh EAR file using Maven and deployed teh application in WebLogic Application Server.
  • Enterprise Java is used for Business Logic coding.
  • Designed teh Unit Test Cases to be used in teh unit testing.
  • Used CVS for version control.

Environment: Web Technologies (HTML, XML), JAVA/J2EE (Servlets, JSP, Spring, JUnit), log4J, HTTP, XML, SOAP, Net Beans, WebLogic Application server, CVS, Oracle 10g and SQL.

Confidential - Nashville, TN.

J2EE Developer

Responsibilities:

  • Responsible for teh development & unit testing of Staffing Request module using Struts.
  • Prepared architectural prototype to validate teh architecture and baseline for teh development.
  • Involved in system design and development in Core Java using Collections, multithreading.
  • Developed JUnit test cases and validated users input using regular expressions in JavaScript as well as in teh server side.
  • Used Hibernate Query Language for to store and retrieve data from teh database.
  • Configured teh Queues and topics on teh JMS of teh JBOSS server.
  • Used Struts tag libraries and custom tag libraries extensively while coding JSP pages.
  • Interact with clients to understand their needs and propose design to teh team to implement teh requirement.
  • Train team members to understand teh system and how to use it.
  • Developed PL/SQL objects like packages, procedures and functions.
  • Always adhered on Quality processes during delivery on tasks to client.
  • Provided Test Scripts and Templates with test results of each task delivered to teh client team.
  • Always used teh best practices of Java/J2EE and minimize teh unnecessary object creation, encourage proper garbage collections of un-used objects, always keep try to minimize teh database call, always encourage to get all data in bulk from database to get best performance of application.

Environment: J2sdk 1.5, JBoss3.2.7, ANT, JDBC, HTML, JavaScript, Struts1.x, Hibernate 3.0,JSP, Servlets, Log4j, Junit 3.8.1.,Eclipse 3.1.1, JBoss Plugins, XDoclet 1.2.3,, JMS in JBoss, CVS, CSS and JS, SQL Server .

Confidential, Horsham, PA

Java Developer

Responsibilities:

  • Involved in teh development of replica of teh actual project using Swing.
  • Extensively used Core Java.
  • Actively involved in teh generation of teh FSML document.
  • Used Java Strings and String Tokenizer classes.
  • Extensively used teh Java IO to write teh data into files to FSML documents.
  • Involved in teh modification of teh parser for teh generated FSML to effectively parse teh document generated in teh replica.
  • Extensively used teh layout managers like GridLayout, GridBagLayout and BoxLayout.
  • Created a presentation of teh actual flow using Power Point.
  • Written procedures for storing teh generated files in teh database.
  • Created XML files and applied XSL to enable users to access teh system.
  • JAXP API was used in processing XML files with DOM and SAX parsers.
  • Involved in teh testing and bug fixing.

Environment: Java, JDBC, Swing, AWT, FSML (Financial Services Markup Language), XML.

We'd love your feedback!