Sr. Big Data Engineer Resume

SUMMARY:

I’m a Sr. Big Data Engineer wif good experience in designing, implementing & monitoring traditional OLTP, OLAP applications & Big - Data applications.
I has experience in creating data models for data-lake for storing TBs of data & processing them using parallel processing frameworks.
I has worked closely wif data scientists to productionize data analytic models including machine-learning models and exposed teh models’ analysis for teh visualization layer to consume.

TECHNICAL SKILLS:

Programming Languages: Java, Scala, and Cobol.

Databases: Oracle, MySQL, Hive and Cassandra.

Tools: /Frameworks: Spark, Oozie, Hadoop, Azure, Spring-Boot and Drools.

Development Tools: Eclipse, Intellij, SQL Developer, Soap UI, Maven, Jenkins, Github.

PROFESSIONAL EXPERIENCE:

Confidential

Sr. Big Data Engineer

Responsibilities:

Azure’s Reservation Allocation system - dis system receives azure’s usage data in TBs every hour. It cleans & categorizes teh usage based on teh resource type, region & other dimensions. Teh usage is then applied against customers RI Reservations. Remaining usage will be sent to down-stream systems for further charge.
Spark, Azure Data Factory, SQL, Kusto, PowerBI Lead a team of data engineers to enhance, monitor & maintain teh system that uses Azure Data Factories, sql & Kusto data lakes
Migrated data audit kusto-function to spark. It monitors huge amounts of azure usage data that passes thru many modules of teh billing system & raises alerts when it finds any anomaly.
Respond to production tickets wifin teh set SLA for pipelines using SQL queries, stored procedures, Kusto & spark.
Fix bugs, own development & testing activities for enhancements to teh system.

CONFDENTIAL

Technical Lead

Responsibilities:

Work wif business team to gather requirements for changes.
Technical Lead 4 + Years (2010 - 2013) Create design for teh needed changes & work wif offshore developers to develop code, review code.
Create data models & needed indexes to reduce turn-around time of transactions.
Create stored-procedures & queries for batch jobs that post system-generated transactions to monitor & close offers accepted by customer.
Core-Java Oracle Drools Create queries that transfer data to reporting system for daily report generation.
SME for teh application.
Help support team to answer queries from business users about production jobs.
Lead teh production deployment & address queries from business users post- production.

Confidential

Team Lead

Responsibilities:

Team Lead 3 + Years (Oct’06 - 2009) Work wif customers to understand requirements & bugs they face.
Develop & test code for new requirements to enhance system, new reports & bug fixes.
Write stored procedures to post farmer loan waivers offered by government.
Cobol Oracle Unix Fine tune queries for daily/monthly reports to halp branches complete their daybook closing fast.
Support UAT, production installs.
Developed & on-boarded new PPF module.
Support customers for UAT, production deployment and post-production bug fixes.