Data Engineer Resume

PROFESSIONAL SUMMARY:

Hadoop Data Engineer with 2+ years of hands on experience using Hadoop Framework and its ecosystem including HDFS, HBase, Hive, Pig, MapReduce, Sqoop, Oozie and Flume for Data Warehouse (ETL) and Data Analysis.
Experience using Apache and Cloudera Hadoop distributions.
Experience with Relational and Non - Relational Databases.
Intermediate programming skills in Core Java and Python.
Experience in building Data Warehouse pipeline involving ETL (Extract/Transform/Load) operations such as data movement, cleansing, transformation etc.
Experience building Excel and Real-Time dashboards from warehouse data to generate insights.

TECHNICAL SKILLS:

Hadoop Stack: HDFS, HBase, Hive, Pig, Sqoop, Oozie, Flume, MapReduce

Hadoop Management: Cloudera Manager, Apache Ambari

Programming Language: Core Java (Intermediate), Python (Intermediate), Shell scripting, R (basics)

Database: Oracle DB, MySql, MongoDB

Others: Git, JIRA, Informatica, Linux

PROFESSIONAL EXPERIENCE:

Confidential

Data Engineer

Develop data warehousing and analytics solution for an international retail chain company.
Load and transform data (structured and semi-structured) from Linux filesystem and transactional databases to HDFS, Hive, HBase using Sqoop, Shell script etc.
Develop and execute queries against large datasets to support impact analysis, reconciliation, and data validation.
Analyze data using Hive queries, Pig scripts and MapReduce programs.
Generate dashboard for data visualization.