Big Data Platform Engineer Resume

SUMMARY:

Motivated IT Professional and graduate student with solid understanding working at various levels of large scale IT projects, including Big data Hadoop Ecosystem, business intelligence, data modeling and database design, end user acceptance testing and agile methodology.

SKILLS:

Apache Hadoop HDFS

HDFS

Apache Hadoop Oozie

Oozie, Sqoop

Big Data

Cassandra

Data Feed

Data Science

Datasets

ETL, Hadoop

Kafka, Mongodb

Teradata, Hive

Perl, Python

Matplotlib

Pandas, Pyspark

Tensorflow

Shell Scripting, bash

WEB Scraping

RDBMS

Data Administration database

Database Modeling

Data Modeling

Database Design

MySQL

Oracle

PostgreSQL

SQL ftp

HTTP

Real - Time

Secure File Transfer Protocol

SFTP, ERD, Scala, Microservice

Deep Learning

Neural Networks

Java, Systems Management

Amazon Web Services, AWS

Asteradata Data Warehouse Frameworks

Data Acquisition Wireless

Mentor

Neural

Telemetry

Instructor

Marketing

Ecosystem

Scraping

User Acceptance

Acceptance Testing

User Acceptance Testing

Statistics

EXPERIENCE:

Confidential

Big Data Platform Engineer

Responsibilities:

Built data pipelines across various functional areas of the company using CICD
Developed and Supported Data Science/AIML use cases performing ETL using Spark Scala Ingested data from SFTP, RDBMS, across various hadoop clusters using NiFi.
Ingested telemetry data using Akka Streams and built microservices using Akka HTTP
Ingested data from RDBMS using Sqoop into HDFS and Hive.
Developed monitoring programs using Python of NiFi cluster, Oozie jobs, data feed sanityand for various applications used in the ingestion of data and building data pipelines

Confidential

Big Data Engineer Associate

Responsibilities:

Performed ERD modeling and database design of Oracle, MySQL databases
Optimized complex internal SQL for various RDBMS and user SQL for Hive and Presto
Built automated ETL data processing pipelines sourcing data from Teradata, via SFTP, FTP,HTTP or other, into Hadoop, processing the data using Spark.

Confidential

Assistant Big Data Instructor

Responsibilities:

Developed Big Data course material and content for Confidential Technologies futureemployees
Delivered courses in - class and worked with students on a 1-1 basis oftentimes providingmentorship

Confidential

Big Data Engineer

Responsibilities:

Developed and designed automation data ingestion pipelines using Spark Scala and NiFi
Troubleshooted and maintained sanity of ingestion data pipelines
Extracted and loaded to and from RDBMS and flat files

We provide IT Staff Augmentation Services!

We'd love your feedback!

Resume Categories

Client Services

Job Seekers

Visa Sponsorship