We provide IT Staff Augmentation Services!

Hadoop Developer Resume

5.00/5 (Submit Your Rating)

Richardson, TX

SUMMARY:

  • 5 years of comprehensive ITexperienceas Hadoop Developer.
  • Excellent understanding of Big Data, Hadoop Cluster architecture and HDFS concepts. In depth knowledge on major components in Hadoop Ecosystem including Hadoop Map Reduce, HDFS, HIVE, PIG, Flume, Sqoop and HBase.
  • Hands - on experience in installation, configuration, supporting and managing Hadoop and the underlying infrastructure of the Hadoop cluster under Linux.
  • Strong knowledge in NoSQL databases like HBase, Cassandra and MongoDB.
  • Experience in importing/exporting data using Sqoop from HDFS to RDBMS and vice-versa.
  • Dataset analysis using ETL methodology for extraction of reusable transformations using Filter, Joins, Aggregation in Pig Latin and HiveQL.
  • Extending Hive and Pig core functionality by writing customUDFs.
  • Experience in managing and reviewing Hadoop Log files.
  • Working knowledge of ZooKeeper.
  • Strong Knowledge in Performance Tuning/Reporting Services and Integration Services.
  • Knowledge of Hadoop ecosystem components and Relational databases using SQL in different phases in data warehouse development lifecycle.
  • Prepared Functional, Technical, Mapping documents and Test Cases.
  • Excellent problem solving skills, excellent analytical skills, good communication and interpersonal skills.
  • Logical implementation and interaction with HBase.
  • Ability to adapt to new technologies very quickly.
  • Experience in requirement analysis and scoping & business process mapping.
  • Experience includes project estimates, cross functional analysis across various domains, system & design, development, customization, testing, implementation of various application systems.
  • Complete knowledge in Software Development Life Cycle (SDLC) processes.

TECHNICAL SKILLS:

Big Data: Ecosystem Hadoop MapReduce,HDFS, HBase, Pig, Hive, Sqoop

Hadoop Framework: Apache, Cloudera

Database Technologies: Cassandra, NOSQL, SQL, JDBC, PL/SQL

Database: Servers Oracle, SQL Server

Languages: C, Java, SQL, PL/SQL, TSQL, Shell Scripting, HTML

Operating Systems: Windows 2000/XP, IBM AIX 5.2, LINUX 2.6

Special Tools: Eclipse, TOAD, PL/SQL Developer

PROFESSIONAL EXPERIENCE:

Confidential - Richardson, TX

Hadoop Developer

Environment: ApacheHadoop, MapReduce, Sqoop, Hive, Oozie, Java (jdk1.6), Oracle 11g/10g,UNIX

Responsibilities:

  • Involved in Installing and configuringHadoopMapReduce and HDFS.
  • Developed multiple Map Reduce jobs in java for data cleaning and preprocessing.
  • Worked on importing and exporting data into HDFS and HIVE using Sqoop from RDBMS.
  • Responsible to manage data coming from different sources.
  • Performed transformations, cleaning and filtering on imported data using Map Reduce, and loaded final data into HDFS and Hive.
  • Monitoring the performance of running MapReduce programs on the cluster.
  • Worked with business teams and created Hive queries for ad hoc analysis.
  • Responsible for creating Hive tables, partitions, loading data and writing hive queries.
  • Involved in scheduling Oozie workflow engine to run multiple Hive jobs.
  • Developed scripts and automated data management from end to end and sync up between all the clusters.

Confidential

Hadoop Developer

Environment: Eclipse IDE, Linux,Hadoop Map Reduce, Pig Latin, Sqoop, Java, Hive, Hbase, Unix Shell Scripting

Responsibilities:

  • Programming inHadoop MapReduce as Hadoop developer.
  • Developed BigData analytic models using Hive.
  • Developed customer transaction event path tree extraction model using Hive from customer transaction data.
  • Enhanced and optimize the customer path tree GUI viewer to incrementally load the treedata from HBase NoSQL database.
  • Used prefuse opensource java framework for the GUI.
  • Design & implement Map/Reduce jobs to support distributed data processing.
  • Process large data sets utilizing ourHadoop cluster.
  • Designing NoSQL schemas in Hbase.
  • Developing map-reduce ETLin Java/Pig.
  • Extensive data validation using HIVE.
  • Importing and exporting the data using Sqoop from HDFS to Relational Database systems and vice-versa.

Confidential, Palo Alto, CA

Hadoop Developer

Environment: Big data platform: Apache Hadoop, MapReduce, HDFS, PIG, HIVE, Sqoop, Flume, HBase, ZooKeeper; SQL, MySQL, Pig Latin; JAVA Core, Linux/Unix; C/C++; Java JDK, Eclipse.

Responsibilities:

  • Installed and configured HDFS with MapReduce architectureon 5 data centers with hundreds nodes cluster around the world.
  • Scheduled the Map/Reduce job to collect the log and aggregate the log on a hourly basis.
  • Developed multiple MapReduce jobs in java for log data cleaning and preprocessing.
  • Implemented MapReduce programs using Java.
  • Logical implementation and interaction with HBase.
  • Efficiently put or fetch data to/from HBase by writing Map/Reduce job.
  • Developed MapReduce jobs to automate transfer of data from/to HBase.
  • Assist with the addition of Hadoop processing to the IT infrastructure.
  • Using flume to collect all the web log from the online ad-servers and push into HDFS.
  • Implemented Map/Reduce job and execute the Map/Reduce job to process the log data from the ad-servers.
  • Gained good knowledge on creating strategies for on-line advertising.
  • Well worked with the usage of Big Data environment and implementation.
  • Wrote efficient map reduce code to aggregate the log data from the Ad-server.
  • Well exposed to accessing massive volumes of online ad-server data.
  • Prepared multi-cluster test harness to exercise the system for performance and failover.
  • Developed high-performance cache, making the site stable and improving its performance.

We'd love your feedback!