We provide IT Staff Augmentation Services!

Hadoop Developer Resume

3.00/5 (Submit Your Rating)

NJ

SUMMARY:

  • 8+ years of extensive experience in the IT Industry which includes Big Data Analytics, Hadoop implementations, and Java.
  • 2+ yearsof experience withHadoop,HDFS,MapReduceand Hadoop Ecosystem (Pig,Hive, andSqoop).
  • Extensive hands on experience with working level knowledge on Big data and NoSQL (Not Only SQL) technologies including: Hadoop, Hive, HBase, Flume, Map Reduce using Java, HDFS (Hadoop Distributed File System), Master - Slave architectural model, Clustering, Node management etc.
  • Strong working experience with Hadoop Architecture and the components of Hadoop - MapReduce, HDFS, JobTracker, TaskTracker, NameNode and DataNode.
  • Experience in setting up Hadoop clusters, both in-house as well as on the cloud (Amazon EC2).
  • Capturing data from existing databases that provide SQL interfaces using Sqoop.
  • Efficient in building hive, pig and map Reduce scripts to analyze data.
  • Extending Hive and Pig core functionality by writing custom UDFs.
  • Successfully loaded files to Hive and HDFS from SQLServer, HBase.
  • Loaded the dataset into Hive for ETL Operation.
  • Good knowledge on Hadoop Cluster architecture and monitoring the cluster.
  • In depth knowledge of database concepts and programming practices using SQL.
  • Experience in database design using Stored Procedure, Functions, Triggers and strong experience in writing complex queries for SQL Server, MySQL.
  • Experience with ETL tools (Informatica, SSIS).
  • Good knoledge of IBM Infosphere and Big Insight Tools
  • Having strong Object Oriented Design experience in JAVA and PHP.
  • Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
  • Worked extensively in Java, J2EE, XML, JDBC, MVC, Spring2.0, Design Patterns and UML, PHP, JQuery, JavaScript, HTML 5, CSS.
  • Excellent analytical, problem solving, communication and interpersonal skills with ability to interact with individuals at all levels and can work as a part of a team as well as independently.
  • Ability to perform at a high level, meet deadlines, adaptable to ever changing priorities.

TECHNICAL SKILLS:

Hadoop: HDFS, Pig, Hive, HBase, Sqoop, MapReduce, Flume, HUE, Zookeeper, Oozie.

Hadoop Distribution: Cloudera, Raw Hadoop Installation

Programming Languages: Java, PHP, Shell Script

Web Technologies: HTML, CSS, JavaScript, JQuery, Dojo, AJAX.

Platforms: Windows XP/7, UNIX/LINUX/SOLARIS, MAC.

Databases: Oracle 11g/10g/9i, MySQL 5.2, SQL Server 2000/2005/2008, MS Access, Teradata

ETL Tools: Informatica, SSIS.

Tools: SQL developer Management Studio, TOAD, Eclipse, IBM Big Insight

WORK EXPERIENCE:

Confidential, NJ

Hadoop Developer

Responsibilities:

  • Worked on analyzing Hadoop cluster and different big data analytic tools including Pig, Hbase NoSQL database and Sqoop.
  • Implemented nine nodes CDH3Hadoop cluster on Centos LINUX.
  • Installed and configured Hadoop Map Reduce, HDFS, Developed multiple Map Reduce jobs in java for data cleaning and pre-processing.
  • Importing and exporting data in HDFS and Hive using Sqoop.
  • Extracted files from Oracle 11g through Sqoop and placed in HDFS and processed.
  • Experience with NoSQL databases.
  • Installed and configured Hive and also written Hive UDFS.
  • Involved in creating Hive tables, loading with data and writing hive queries which will run internally in map reduce way.
  • Involved in the regular Hadoop Cluster maintenance such as patching security holes and updating system packages.
  • Synchronized different configuration files of hadoop cluster nodes across the system.
  • Configured the MapReduce property to make sure local temporary storage is using large disk partitions.
  • Analyzed the web log data using the HiveQL.

Environment: Java 6, Eclipse, Hadoop, Hive, Hbase, Oracle 11g, Linux, Map Reduce, HDFS, Shell Scripting, MySQL.

Confidential, Philadelphia, PA

Hadoop Developer

Responsibilities:

  • We have written Map/Reduce programs, Pig scripts to specify the conditions to separate the fraudulent claims.
  • These conditions were derived after processing the past 20 years of health care data that we possesses.
  • This data was exported into HDFS using Sqoop.
  • Hive was used to integrate with Micro-Strategy - to produce results quickly based on the report that was requested.
  • Flume was used to collect the logs with error messages across the cluster.
  • Oozie and Zoo-keeper were used to manage the flow of jobs and coordination in the cluster respectively.
  • LZO compression technique was used to make optimum utilization of the network bandwidth.
  • Played a key-role is setting up a Hadoop cluster (in-house).
  • Lead a team which consisted of 3 resources.
  • Worked on a stand-alone as well as a distributed Hadoop.
  • Worked on a Cloudera Hadoop distribution.
  • Updated the classification levels that were achieved on the data every day to the on-site team.

Environment: JAVA, HADOOP, HIVE, PIG, SQOOP, FLUME, HBASE, IBM InfoSphere, IBM Big Insight Tools.

Confidential, MA

Java/J2EE Developer

Responsibilities:

  • Created Java Server Pages for client presentation and interaction with business layer.
  • Developed Perl scripts for doing implementing automated tasks on UNIX systems.
  • Implemented the web layer with Struts for a module for authorization.
  • Involved in developing interface for WEB pages like user registration, login, registered access control for users depending on logins using HTML and Java Script.
  • Deployed servlets and JSPs and fine-tuned them for better performance.
  • Designed and Developed web services to maintain a data cache for the frequently used data.
  • Responsible for functional requirements and technical designing, designed customized screens, developed SMTP mail services and easy Web Self Service.
  • Developed and Deployed Java Servlets and JSP for Dynamic HTML generation and for session management using Weblogic.
  • User Authentication privileges using JAAS Login Module.
  • Used Spring framework to auto wire/inject components and also configure the batch jobs
  • Designed JNDI Component for data base communication and message service.
  • Implemented ANT tool varying its versions depends on latest Mile stones.
  • To keep track of latest Versions implemented CVS Structure.
  • Generated few dynamic Tag Libs and implemented MVC design patterns using Java Struts.
  • Preformed Unit Testing using JUnit and designed test cases.

Environment: J2EE, JavaScript, HTML, JSP, Servlets, JDBC, Oracle, REST, Spring, CVS, XML, XSL, Rational Rose, Eclipse2.0, UNIX Scripts, UNIX, Web logic 7.1

Confidential, OH

Java / J2EE Developer

Responsibilities:

  • Created JSP pages to get user information such as and other details.
  • Struts Framework was used in creating the front-end application and providing proper validations using validator plugin. Custom validations were written for some fields.
  • Team orchestration to effectively carry out all project activities such as analysis & design, coding, integration and testing.
  • Tortoise SVN was used as the Version Control Software.
  • Database Queries were handled using SQL PLUS.

Environment: J2EE, JSP 2.2, Struts, Eclipse, SQL, Starteam 7.0, XML, Tomcat, HTML, JavaScript, Windows 2000, UNIX.

Confidential

Software Developer

Responsibilities:

  • Software development life cycle: analysis, detail design, development, system and integration testing.
  • Wrote JavaScript functions to validate input fields.
  • Developed using design patterns like MVC, Singleton Factory etc.
  • Developed and deployed the application on Tomcat Server
  • Wrote SQL statements to update and fetch data from the database.
  • Performed Unit testing using JUnit.
  • Reviewed and modified design documents.
  • Was involved in Code review and integration testing.

Environment: Java, Jsp, MVC, SQL, Junit, JavaScript.

We'd love your feedback!