Hadoop Consultant Resume
Cury, NC
SUMMARY
- Over 7+ years of experience in IT industry with strong emphasis Object Oriented Analysis, Design, Development and Implementation, Testing and Deployment of Software Applications and Web enabled applications.
- Around 2 years of experience with Hadoop, HDFS, MapReduce and Hadoop Ecosystem (Pig, Hive, HBase).
- Experience writing Map Reduce Jobs, HIVEQL.
- Good experience in optimizing MapReduce algorithm using combiners and partitioners to deliver teh best results.
- Experience with Hbase, PIG and NoSQL.
- Experience in designing Big Data solutions for traditional enterprise businesses.
- Experience in Setting up Hadoop in various modes and integrating Hadoop Ecosystem with Hadoop.
- Good experience in writing Map Reduce jobs using Java native code, Pig, Hive for various business use cases.
- Good working experience on Red Hat Enterprise Linux Products.
- Expertise in Java/J2EE technologies, such as Core Java, Struts, Spring, Hibernate, JDBC, EJB, JMS, JSP, JSTL, HTML, JavaScript, JQuery, JSON etc.
- Good working experience as a Java/J2EE programmer developing applications using Servlets, JSP, JSTL, RMI, EJB, Struts, Spring, JSF, Java Beans, JDBC, JMS, Hibernate and MVC architecture.
- Exposures working with design patterns like MVC, Front Controller, Data Accessor, Value Object, Singleton and Session Facade.
- Experience working in Spring Framework, Struts Framework and Hibernate framework.
- Good Understanding of Service Oriented Architecture (SOA) and Web Services with XML, XSD, WSDL and SOAP.
- Experience in Object oriented analysis and design (OOAD), UML and Design Patterns.
- Proficiency in programming with different Java IDE's like Eclipse, IntelliJ, IBM RAD 6.x/7.x, WSAD and NetBeans.
- Strong experience in RDBMS technologies like SQL, Stored Procedures, Triggers, Functions.
- Experience in Mercurial, SVN, ClearCase, version control systems.
- Strong communication skills with professional attitude and can take teh pressures to drive with enthusiasm to support of client Hadoop Cluster environment with full potential.
TECHNICAL SKILLS
Big Data: Hadoop, MapReduce, HDFS, Hive, Pig, Sqoop, Zookeeper and HBase
Languages: Java, SQL, HTML, DHTML, JavaScript, XML, C/C++.
Java/J2EE Technologies: JSP, Servlets, JavaBeans, JDBC, JNDI, JTA, JPA, EJB 3.0
Design Patterns: MVC, Session Facade, Service Locator, Data Access Object, Data Transfer Object / Value Object, Business Delegate
Web Design Tools: HTML, DHTML, AJAX, JavaScript, jQuery and CSS
Version Control Tools: CVS, Rational Clear Case
Frameworks: Struts 1.1/2.0, Spring 2.5, Hibernate 3.0
Servers: Web Logic Server 10.3, JBoss 6.0, Tomcat 5.5/6.0
IDEs: NetBeans, Eclipse, IntelliJ, SQL Developer, Rational Rose for Java, JBuilder 4.0, Aptana.
Databases: Oracle 9i / 10g/11g, SQL Server 2008, MS - SQL Server.
Operating systems: Windows XP/NT, Linux, UNIX, DOS
PROFESSIONAL EXPERIENCE
Confidential, Cury, NC
Hadoop Consultant
Responsibilities:
- Gatheird teh business requirements from teh Business Partners and Subject Matter Experts.
- Involved in installing Hadoop Ecosystem components.
- Used to manage and review teh Hadoop log files.
- Responsible to manage data coming from different sources.
- Supported Map Reduce Programs those are running on teh cluster.
- Involved in HDFS maintenance and loading of structured and unstructured data.
- Wrote MapReduce job using Java API.
- Installed and configured Pig and also written PigLatin scripts.
- Wrote MapReduce job using Pig Latin.
- Involved in managing and reviewing Hadoop log files.
- Imported data using Sqoop to load data from MySQL to HDFS on regular basis.
- Developed Scripts and Batch Job to schedule various Hadoop Program.
- Wrote Hive queries for data analysis to meet teh business requirements.
- Created Hive tables and working on them using Hive QL.
- Utilized Agile Scrum Methodology to halp manage and organize a team of 4 developers with regular code review sessions.
- Weekly meetings with technical collaborators and active participation in code review sessions with senior and junior developers.
- Used JUnit for unit testing and Continuum for integration testing.
Environment: Java Hadoop, MapReduce, HDFS, Hive, Java (jdk1.7), Pig, Linux, XML, MySQL, MySQL Workbench.
Confidential, Memphis, TN
Hadoop Consultant
Responsibilities:
- Responsible for architecting Hadoop clusters with CDH3.
- Extensively involved in Installation and configuration of Cloudera distribution Hadoop 2, 3, NameNode, Secondary NameNode, JobTracker, TaskTrackers and DataNodes.
- Installed and configured Hadoop ecosystem like HBase, Flume, Pig and Sqoop.
- Involved in Hadoop cluster task like Adding and Removing Nodes without any effect to running jobs and data.
- Managed and reviewed Hadoop Log files.
- Load log data into HDFS using Flume. Worked extensively in creating MapReduce jobs to power data for search and aggregation.
- Worked extensively with Sqoop for importing metadata from Oracle.
- Designed a data warehouse using Hive.
- Created partitioned tables in Hive.
- Mentored analyst and test team for writing Hive Queries.
- Extensively used Pig for data cleansing.
- Developed Pig Latin scripts to extract teh data from teh web server output files to load into HDFS.
- Developed teh Pig UDF’S to pre-process teh data for analysis.
- Developed workflow in Oozie to automate teh tasks of loading teh data into HDFS and pre-processing with Pig.
- Cluster co-ordination services through ZooKeeper.
Environment: Hadoop, MapReduce, HDFS, Pig, Hive, HBase, ZooKeeper, Oozie, Java (jdk1.6), Oracle 11g/10g, PL/SQL, SQL*PLUS, Windows NT, UNIX Shell Scripting.
Confidential, Jersey City, NJ
J2EE Developer
Responsibilities:
- Actively involved in Analysis, Detail Design, Development, Bug fixing and Enhancement in Agile methodology.
- Created web services using SOAP. Teh calls and responses between client and server are transmitted as SOAP messages.
- Used Middle Tier Frameworks like Spring ORM, Hibernate and JDBC to develop Database Related Code and Spring WS for teh WebServices.
- WSDL generation from teh specified XSD.
- Registered and used web services in WSRR (Web Services Registry and Repository).
- Developed module to communicate with WSRR and obtain teh end point URL for a particular web service.
- Designed and developed teh DB schema for teh module and participated in DB Design discussions.
- Designed table structure and coded scripts to create tables, indexes, views, sequence, synonyms and database triggers. Involved in writing Database procedures, Triggers, PL/SQL statements for data retrieval.
- Used Business Delegate, Singleton, Front Controller, Factory and DAO design patterns.
- Mentored Junior Developers and performed code reviews.
- Held training sessions about teh effective practices of coding.
- Involved in teh creation of teh Functional Spec and User Manual.
- Conducted brain storming sessions for resolution to problems.
- Performed internal quality audits as per teh organization guidelines.
- Code changes for Change Requests and enhancements.
- Used Spring AOP module for creating transactions.
- Used Hibernate to develop teh persistence layer.
- Generated teh EAR file using Maven and deployed teh application in WebLogic Application Server.
- Enterprise Java is used for Business Logic coding.
- Designed teh Unit Test Cases to be used in teh unit testing.
- Used CVS for version control.
Environment: Web Technologies (HTML, XML), JAVA/J2EE (Servlets, JSP, Spring, JUnit), log4J, HTTP, XML, SOAP, Net Beans, WebLogic Application server, CVS, Oracle 10g and SQL.
Confidential - Nashville, TN.
J2EE Developer
Responsibilities:
- Responsible for teh development & unit testing of Staffing Request module using Struts.
- Prepared architectural prototype to validate teh architecture and baseline for teh development.
- Involved in system design and development in Core Java using Collections, multithreading.
- Developed JUnit test cases and validated users input using regular expressions in JavaScript as well as in teh server side.
- Used Hibernate Query Language for to store and retrieve data from teh database.
- Configured teh Queues and topics on teh JMS of teh JBOSS server.
- Used Struts tag libraries and custom tag libraries extensively while coding JSP pages.
- Interact with clients to understand their needs and propose design to teh team to implement teh requirement.
- Train team members to understand teh system and how to use it.
- Developed PL/SQL objects like packages, procedures and functions.
- Always adhered on Quality processes during delivery on tasks to client.
- Provided Test Scripts and Templates with test results of each task delivered to teh client team.
- Always used teh best practices of Java/J2EE and minimize teh unnecessary object creation, encourage proper garbage collections of un-used objects, always keep try to minimize teh database call, always encourage to get all data in bulk from database to get best performance of application.
Environment: J2sdk 1.5, JBoss3.2.7, ANT, JDBC, HTML, JavaScript, Struts1.x, Hibernate 3.0,JSP, Servlets, Log4j, Junit 3.8.1.,Eclipse 3.1.1, JBoss Plugins, XDoclet 1.2.3,, JMS in JBoss, CVS, CSS and JS, SQL Server .
Confidential, Horsham, PA
Java Developer
Responsibilities:
- Involved in teh development of replica of teh actual project using Swing.
- Extensively used Core Java.
- Actively involved in teh generation of teh FSML document.
- Used Java Strings and String Tokenizer classes.
- Extensively used teh Java IO to write teh data into files to FSML documents.
- Involved in teh modification of teh parser for teh generated FSML to effectively parse teh document generated in teh replica.
- Extensively used teh layout managers like GridLayout, GridBagLayout and BoxLayout.
- Created a presentation of teh actual flow using Power Point.
- Written procedures for storing teh generated files in teh database.
- Created XML files and applied XSL to enable users to access teh system.
- JAXP API was used in processing XML files with DOM and SAX parsers.
- Involved in teh testing and bug fixing.
Environment: Java, JDBC, Swing, AWT, FSML (Financial Services Markup Language), XML.