Jr Hadoop Developer Resume
SUMMARY
- 1+ years of IT experience in Hadoop.
- Excellent knowledge on Hadoop Architecture and ecosystems such as HDFS, Map Reduce, Job Tracker, Task Tracker, Namenode, Datanode, Secondary Namenode, Resource Manager concepts.
- Experience in dealing with Apache Hadoop components like Sqoop, Hive, PIG, Oozie, Spark, Ambari, Yarn and Tez.
- Experience in installation, configuration and managing - Cloudera and Hortonworks Hadoop platforms.
- Hands on experience in Sqoop, imported data from RDBMS like MySQL into HDFS handling incremental load.
- Built several Internal and External HIVE tables and performed several Joins on those tables to de-normalize the data.
- Modelled Hive Partitions and Buckets extensively for data separation and faster data processing and followed Pig and Hive best practices for tuning.
- Extensively worked on Spark Streaming and Spark SQL, consuming real-time data from Kafka, and performed various transformations on data and queried using Spark SQL.
- Extensive Experience on importing and exporting data using stream processing platforms like Flume and Kafka.
- Used Pig for data cleansing and implemented Oozie workflow to chain multiple MapReduce, Hive, Sqoop and Pig jobs.
- Good knowledge on Spark In-memory capabilities and its modules: Spark-SQL, Spark MLlib.
- Imported Hive data into Spark RDDs and Dataframes, performed various actions & transformations on them and exported results back to Hive.
- Experience in Test-driven development, Software Development Life Cycle (SDLC) methodologies like Agile and Scrum.
TECHNICAL SKILLS
Big Data: Hadoop, MapReduce, Hive, Pig, Kafka 0.10.1.1, Spark 1.6.2, SparkSQL, Scala, Zookeeper, Maven, HBase, HQL, Oozie, Sqoop, YARN, ETL.
Business Intelligence: Tableau 8.X/9.X/10.X, Business objects/QlikView, Impala, SAS.
Databases: DB2, MySQL, MS SQL Server, MS Access, Vertica, MongoDB.
Languages: Java, Python, SQL, HQL, HTML, CSS, Jenkins, Agile.
Application Server: Apache Tomcat.
Cloud Computing: AWS EMR, EC2, S3.
Platforms: CDH 5.X, AWS, HDP 2.X
Tools: Eclipse, NetBeans, Maven, Git, Jira, Visual Studio, MS-Office 2003/2007/2010.
PROFESSIONAL EXPERIENCE
Jr Hadoop Developer
Confidential
Responsibilities:
- Worked closely with team in converting Business requirements to Technical requirements.
- Imported required tables from RDBMS to HDFS using Sqoop.
- Transformed data using Spark based on requirement.
- Written spark applications using Python and Scala.
- Used spark SQL for Analytics.
- Experience in Spark streaming.
- Scheduled automated jobs with the help of Oozie.
Environment: Hadoop, HDFS, Sqoop, Flume, Kafka, MapReduce, Hive, PIG, Oozie, HBase, Zookeeper, Cloudera, Hortonworks, Oracle, NoSQL and Unix/Linux
Hadoop Intern
Confidential
Responsibilities:
- Imported required tables from RDBMS to HDFS using Sqoop.
- Transformed data using MapReduce on requirement.
- Used Java for writing MapReduce Jobs.
- Analyzed data using Hive and Impala.
- Worked with Hive Tables, Hive queries, Partitioning, Bucketing.
