We provide IT Staff Augmentation Services!

Jr Hadoop Developer Resume

0/5 (Submit Your Rating)

SUMMARY

  • 1+ years of IT experience in Hadoop.
  • Excellent knowledge on Hadoop Architecture and ecosystems such as HDFS, Map Reduce, Job Tracker, Task Tracker, Namenode, Datanode, Secondary Namenode, Resource Manager concepts.
  • Experience in dealing with Apache Hadoop components like Sqoop, Hive, PIG, Oozie, Spark, Ambari, Yarn and Tez.
  • Experience in installation, configuration and managing - Cloudera and Hortonworks Hadoop platforms.
  • Hands on experience in Sqoop, imported data from RDBMS like MySQL into HDFS handling incremental load.
  • Built several Internal and External HIVE tables and performed several Joins on those tables to de-normalize the data.
  • Modelled Hive Partitions and Buckets extensively for data separation and faster data processing and followed Pig and Hive best practices for tuning.
  • Extensively worked on Spark Streaming and Spark SQL, consuming real-time data from Kafka, and performed various transformations on data and queried using Spark SQL.
  • Extensive Experience on importing and exporting data using stream processing platforms like Flume and Kafka.
  • Used Pig for data cleansing and implemented Oozie workflow to chain multiple MapReduce, Hive, Sqoop and Pig jobs.
  • Good knowledge on Spark In-memory capabilities and its modules: Spark-SQL, Spark MLlib.
  • Imported Hive data into Spark RDDs and Dataframes, performed various actions & transformations on them and exported results back to Hive.
  • Experience in Test-driven development, Software Development Life Cycle (SDLC) methodologies like Agile and Scrum.

TECHNICAL SKILLS

Big Data: Hadoop, MapReduce, Hive, Pig, Kafka 0.10.1.1, Spark 1.6.2, SparkSQL, Scala, Zookeeper, Maven, HBase, HQL, Oozie, Sqoop, YARN, ETL.

Business Intelligence: Tableau 8.X/9.X/10.X, Business objects/QlikView, Impala, SAS.

Databases: DB2, MySQL, MS SQL Server, MS Access, Vertica, MongoDB.

Languages: Java, Python, SQL, HQL, HTML, CSS, Jenkins, Agile.

Application Server: Apache Tomcat.

Cloud Computing: AWS EMR, EC2, S3.

Platforms: CDH 5.X, AWS, HDP 2.X

Tools: Eclipse, NetBeans, Maven, Git, Jira, Visual Studio, MS-Office 2003/2007/2010.

PROFESSIONAL EXPERIENCE

Jr Hadoop Developer

Confidential

Responsibilities:

  • Worked closely with team in converting Business requirements to Technical requirements.
  • Imported required tables from RDBMS to HDFS using Sqoop.
  • Transformed data using Spark based on requirement.
  • Written spark applications using Python and Scala.
  • Used spark SQL for Analytics.
  • Experience in Spark streaming.
  • Scheduled automated jobs with the help of Oozie.

Environment: Hadoop, HDFS, Sqoop, Flume, Kafka, MapReduce, Hive, PIG, Oozie, HBase, Zookeeper, Cloudera, Hortonworks, Oracle, NoSQL and Unix/Linux

Hadoop Intern

Confidential

Responsibilities:

  • Imported required tables from RDBMS to HDFS using Sqoop.
  • Transformed data using MapReduce on requirement.
  • Used Java for writing MapReduce Jobs.
  • Analyzed data using Hive and Impala.
  • Worked with Hive Tables, Hive queries, Partitioning, Bucketing.
Environment: Hadoop, HDFS, Sqoop, MapReduce, Hive, PIG, Oozie, Cloudera, CDH5, Oracle, NoSQL and Unix/Linux.

We'd love your feedback!