We provide IT Staff Augmentation Services!

Hadoop Application Developer Resume

3.00/5 (Submit Your Rating)

Saluda, VA

SUMMARY

  • Having a total of 7 years of experience in Full life cycle Java Application development including requirements Analysis and Design, Development, implementation, support, maintenance and enhancements.
  • Passionate towards working in Big Data and Analytics environment.
  • Experience in working wif MapReduce programs using Apache Hadoop for working wif Big Data.
  • Organizing data into tables, performing transformations, and simplifying complex queries wif Hive.
  • Performing real - time interactive analyses on massive data sets stored in HDFS or HBase using SQL wif Impala.
  • In depth understanding/noledge of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node and MapReduce concepts.
  • Expertise in writing Hadoop Jobs for analyzing data using Hive and Pig.
  • Experience in analyzing data using Hive QL, Pig Latin, and custom MapReduce programs in Java.
  • Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa.
  • 4 years of experience using JBoss Application Servers and Administration.
  • 3 years of experience wif Jakarta Struts Framework, MVC and J2EE Framework.
  • 4 years of experience in implementing J2EE Design Patterns.
  • Experienced in process, validate, parse, and extract data from XML files using DOM and SAX parsers.
  • 4 years of experience in designing, developing database to create its Objects like Tables, Stored Procedures, Triggers and Cursors using TSQL wif MS SQL Server 2000/2005/2008/2012, PL/SQL wif Oracle 8i/9i/10g, MS Access 2003. Data Connectivity used for Web and windows Using JDBC and ODBC.
  • 3 years of experience in coding Ant scripts to build teh application.
  • 4 years of experience in writing shell scripts.
  • Experienced in developing Web services in Tomcat and Jboss.
  • Experienced in using IDE Tool like Eclipse 2.x/3.x/Europe/Juno, WSAD 5.0, JBuilder 7.0, JDeveloper 9.0.3.
  • Experienced in debugging, troubleshooting, deployment and support roles.
  • Experience includes thread synchronization and cross process communications.
  • Strong experience in banking domain.
  • Strong communication and presentation skills.

TECHNICAL SKILLS

HADOOP/BIGDATA: HDFS, MapReduce, HBase, Pig, Hive, Sqoop, Oozie.

LANGUAGES: Java1.4/5.0/6.0, J2EE, XML, XSLT, HTML, DHTML, UNIX Scripting, PL/SQL.

JAVA TECHNOLOGIES: Servlets 2.3/3, JSP 1.1/2.0, EJB 2.0/3.0, JNDI, JMS, JDBC, RMI, JXL Java Mail, JavaBeans, Applets, Swing, RMI, Multi Threading, Web Services (SOAP based, Rest based), Apache Axis/CXF, JWSDP, Android.

APPLICATION SERVERS: Jboss 4.0.1/4.3.2, Web Sphere 6.0/8.0, Web logic 8.0/9.0.

WEBSERVERS: Apache Tomcat 4.0/5.5, Microsoft IIS 4.0, Java Web Server

METHODOLOGIES: Design Patterns, MVC Architecture, Struts Framework 1.2/2, Spring 3.0 Spring MVC, Spring Web flow, Directory Services (LDAP), IMS Connector Framework, Web Services, Apache Axis, JWSDP and Web Portals.

IDE: IBM Web Sphere Studio (WSAD), Eclipse 3.0/Europa/Juno, JBuilder 5.0, JDeveloper 9.0.3, Net Beans and Rational Rose.

SCRIPTING LANGUAGES: Apache Ant1.5, JavaScript, XML and Shell Programming.

OPERATING SYSTEMS: Windows 2000/NT/XP/Vista/Windows 7/Windows 8, SUN Solaris, and Red hat Linux

TOOLS: Squirrel, Aqua Data Studio, MS FrontPage, UML, RUP, Macromedia Drea m weaver, Adobe PhotoShop 5, MikTex, Microsoft Visio, Mat Lab and Simulink.

DATABASES: Oracle 10g/9i/8i/7i, MS Access, MS SQL Server 2000/2005/2008/2012 and My Sql.

PROFESSIONAL EXPERIENCE:

Confidential, Saluda, VA

Hadoop Application Developer

Responsibilities:

  • Involved in teh Proof of Concept implementation on Hadoop stack.
  • Obtained teh requirement specifications from teh SME’s, Business Analysts in teh BR, and SR meetings for corporate work place project. Interacted wif teh Business users to build teh sample report layouts.
  • Responsible for building scalable distributed data solutions usingHadoop.
  • Installed and configured Flume, Hive, Pig, Sqoop and Oozie on theHadoopcluster.
  • Implemented nine node Hadoop cluster on Redhat LINUX.
  • Extensively used Pig for data cleansing.
  • Responsible for cluster maintenance, adding and removing cluster nodes, cluster monitoring and troubleshooting, manage and review data backups, manage and reviewHadooplog files.
  • Loaded data into teh cluster from dynamically generated files using Flume and from relational database management systems using Sqoop.
  • Developed Pig Latin scripts to extract teh data from teh web server output files to load into HDFS.
  • Involved in writing several MapReduce programs to analyze client’s/trading data and provide consolidated reports to reach teh targeted SLA’s.
  • Experience in writing UDF’s in Hive/Pig for segregating virtual trading records, CUSIP lookups & aggregation etc.
  • Used Pig as ETL tool to do transformations, event joins, filter bot traffic and some pre-aggregations before storing teh data onto HDFS.
  • Loaded teh dataset into Hive for ELT (Extract, Load and Transform) operation.
  • Developed workflow in Oozie to automate teh tasks of loading teh data into HDFS and pre-processing wif Pig and HiveQL.
  • Experience in setting up a multi-node clustered environment on Amazon EC2.

Environment: Hadoop, HDFS, Hive, HBase, Sqoop, PIG, FLUME NG, Oozie, Java (JDK 1.6), Eclipse, MySQL and Ubuntu.

Confidential, Buffalo, NY

Big Data /Hadoop Consultant

Responsibilities:

  • Gatheird teh business requirements from teh Business Partners and Subject Matter Experts.
  • Involved in installing Hadoop Ecosystem components.
  • Used to manage and review teh Hadoop log files.
  • Responsible to manage data coming from different sources.
  • Supported Map Reduce Programs those are running on teh cluster.
  • Involved in HDFS maintenance and WEBUI it through Hadoop-Java API.
  • Wrote MapReduce job using Java API .
  • Wrote MapReduce job using Pig Latin.
  • Written UDF's using Java API.
  • Imported data using Sqoop to load data from MySql to HDFS on regular basis.
  • Developing Scripts and Batch Job to schedule various Hadoop Program.
  • Written Hive queries for data analysis to meet teh business requirements.
  • Creating Hive tables and working on them using Hive QL.
  • Utilized Agile Scrum Methodology to halp manage and organize a team of 4 developers wif regular code review sessions.
  • Weekly meetings wif technical collaborators and active participation in code review sessions wif senior and junior developers.

Environment: Hadoop, MapReduce, HDFS, Hive, Java (jdk1.6), Pig, Linux, XML, MySQL, MySQL Workbench.

Confidential, Atlanta, GA

Hadoop/Java Developer

Responsibilities:

  • Gatheird teh business requirements from teh Business Partners and Subject Matter Experts.
  • Created Hive tables which are extracted by teh relavent EDW tables.
  • Responsible to manage data coming from different sources.
  • Importing and exporting data into HDFS and Hive using Sqoop.
  • Supported Map Reduce Programs those are running on teh cluster.
  • Written Hive queries for data analysis to meet teh business requirements.
  • Involved in creating UDF's where Custom Functionalities are required.
  • Wrote MapReduce job using Java API.
  • Involved in creating Hive tables, loading wif data and writing hive queries which will run internally in map reduce way.
  • Imported data using Sqoop to load data from MySQL to HDFS on regular basis.
  • Developing Scripts and Batch Job to schedule various Hadoop Program.

Environment: Hadoop, MapReduce, HDFS, Hive, Pig, Eclipse, Linux, MySQL.

Confidential, Houston, TX

Hadoop developer

Responsibilities:

  • Installed and configured Hadoop and responsible for maintaining cluster and managing and reviewing Hadoop log files.
  • Installed and configured Hadoop MapReduce, HDFS and developed multiple MapReduce.
  • Developed simple and complex MapReduce programs in Java for Data Analysis.
  • Load data from various data sources into HDFS using Flume.
  • Worked on Cloudera to analyze data present on top of HDFS.
  • Worked extensively on Hive and PIG.
  • Worked on large sets of structured, semi-structured and unstructured data.
  • Use of Sqoop to import and export data from HDFS to RDBMS and vice-versa.
  • Developed PIG Latin scripts to play wif teh data.
  • Involved in creating Hive tables, loading wif data and writing hive queries which will run internally in map reduce way.
  • Responsible to manage data coming from different sources.

Environment: Apache Hadoop, Cloudera Manager, HDFS, Java MapReduce, Eclipse, Hive, PIG, Sqoop, Oozie and SQL.

Confidential, Montvale, NJ

Hadoop Developer

Responsibilities:

  • Worked on analyzing Hadoop cluster and different big data analytic tools including Pig, Hbase NoSQL database and Sqoop.
  • Importing and exporting data in HDFS and Hive using Sqoop.
  • Extracted files from MongoDB through Sqoop and placed in HDFS and processed.
  • Experience wif NoSQL databases.
  • Written Hive UDFS to extract data from staging tables.
  • Involved in creating Hive tables, loading wif data and writing hive queries which will run internally in map reduce way.
  • Familiarized wif job scheduling using Fair Scheduler so that CPU time is well distributed amongst all teh jobs.
  • Involved in teh regular Hadoop Cluster maintenance such as patching security holes and updating system packages.
  • Managed Hadoop log files.
  • Analyzed teh web log data using teh HiveQL.

Environment: Java 6, Eclipse, Hadoop, Hive, Hbase,Mango DB, Linux, Map Reduce, HDFS, Shell Scripting, Mysql.

Confidential

Software Developer

Responsibilities:

  • Responsible and active in teh analysis, definition, design, implementation, management, and deployment of full software development life cycle of project.
  • Developing User Interface and implementing business process using JSP and Servlets.
  • Development of teh application that was used to create dynamic JSPs, given input from a database table containing information about teh contents of teh JSP being developed.
  • Involved in writing teh presentation layer in Java Server Pages (JSP).
  • Wrote Servlets programming and JSP scripting for teh communication between web browser and server.
  • Responsible for coding SQL Statements and Stored procedures for back end communication using JDBC
  • Developed an API to write XML documents from a database. Utilized XML and XSL Transformation for dynamic web-content and database connectivity.
  • Coded different deployment descriptors using XML. Generated Jar files are deployed on Apache Tomcat Server.
  • Involved in teh development of presentation layer and GUI framework in JSP. Client Side validations were done using JavaScript.
  • Involved in code reviews and mentored teh team in resolving issues.
  • Participated in weekly design reviews and walkthroughs wif project manager and development teams.
  • Provide technical guidance to business analysts, gather teh requirements and convert them into technical specifications/artifacts for developers to start.

Environment: HTML, JSP, Servlets, JDBC, JavaScript, Tomcat, Eclipse IDE, XML, XSL, Tomcat 5.

We'd love your feedback!