SUMMARY:

• Over 6 years' experience in Data Science and Data Analytics Platform using Spark, Python, Scala and SQL technologies.
• Certified HDP (Hortonworks Data Platform) Spark Developer with knowledge in cross platform technologies using Big data with CloudEra and Hortonworks platform.
• Built Analytical tools from data collected through both live streaming and batch processing using Databricks platform.
• Experience in using various Data Visualization tools like Qlik, Tableau, Databricks to provide Business Intelligence on simple terms.
• Strong Knowledge of Object Oriented Design Methodologies such as Polymorphism, Inheritance, Encapsulation, Interfaces etc.
• In depth knowledge on Big Data Stack like Hadoop ecosystem Hadoop, Map Reduce, Hive, Kafka, Spark, Spark Data Frames, Spark SQL.
• Exploring with Spark improving the performance and optimization of the existing algorithms in Hadoop using Spark context, Spark - SQL, Spark-Data Frames, Pandas-Dataframes, pair RDD's.
• Knowledge on Hadoop architecture and its components like HDFS, Name Node, Data Node, Job Tracker, Task Tracker programming paradigm
• Hands on experience with HiveQL
• Extensively used multiple Python libraries like Pandas, NumPy, SciPy, Matplotlib to deliver various clientele needs.
• Have strong knowledge on Supervised and Unsupervised Machine Learning techniques like Linear Regression, Classification, Clustering algorithms.

SKILLS:

C#

Hadoop

HDFS

Hive

JSON

Object Oriented

Python

Matplotlib

Numpy

Pandas

Pyspark

Scripting

XML

Analytics Platform

Apache Hadoop HDFS

Big Data

Clustering

Data Analytics

Data Science

Data Visualization

Hortonworks Data Platform

Kafka

Machine Learning

MAP Reduce

Decision Trees

Linear Regression

Data Analysis

Progress

SQL

Tableau Software

Tableau

T-SQL

Live Streaming

APM

User Interface

UI Amazon Simple Storage Service

Flow Charts

Scala

Object Oriented Design

MATLAB

Robotics

Robot

Filtration

Instrumentation

Satellites

Solidworks

Microcontrollers

Metrics

Business Intelligence

System Level

Unspecified

Visualization

Telemetry

EXPERIENCE:

Confidential

Data Science and Analytics Engineer

Technologies/ Tools used: Python, Scala, Pandas, NumPy, SciPy, Matplotlitb, Spark SQL, Hive, Databricks, Tableau, Jupyter Notebooks, Supervised and Unsupervised Machine Learning models, Delta lake, Partitioning, Confidential buckets.

Responsibilities:

• Provided Data Science and Analytic Solutions for XR2 Automated Central pharmacy system.
• Applied clinical expertise and advanced Machine Learning techniques to uncover opportunities to adjust that flow to improve safety, cost, efficiency, and patient outcomes.
• Used Databricks to create performance charts for multiple system level metrics.
• Created and Developed Notebooks (using PySpark and Spark SQL) and published dashboards with desired charts and tables.
• Have set up Email Alerts to report when a Robot metric goes out of desired limits or in case of unplanned downtime and Robot Stoppage.
• Created scheduled jobs using Scala to Automate the report generation as well as email alerting process and make them available to the corresponding end users.
• Working on migrating Log Parser from C# and T-SQL to PySpark and Spark SQL on Databricks.
• Imported data from various file formats (CSV, XML, JSON) into Databricks using UI as well as Notebooks.
• Worked on Log Parser which scrapes log files sent from robots to achieve an insight into its performance.
• Created and installed live streams for data and developed strategies for collecting new data, clean existing data and prepared it for Machine Learning systems.
• Used SciPy libraries for generating supervised and unsupervised models.
• Used Scala to parse log information stored in Amamzon S3 buckets on Databricks platform.
• Transformed tables to use Delta Lake functionality on databricks.
• Developed and supported multiple Delta tables according to the clientele requirements.
• Worked on OTS (Omnicell Telemetry Service) to connect to Kafka endpoints which are connected to Confidential buckets.
• Supported and provided solutions for multiple data Interfaces on OTS service for live streaming as well as batch streaming.
• Set up Email alerts for when the system metrics as well as the robot metrics are out of bounds by using Amazon SES.
• Used various Machine Learning capabilities to design and implement Decision Trees, Flow Charts and Linear Regression Models which gave micro level insight on robot performance
• Provided support and developed tableau views created for data visualization.

Confidential

Software Developer

Technologies/ Tools used: Python, Pandas, NumPy, Matplotlitb, Spark SQL, QlikSense, Qlik, MSSQL

Responsibilities:

• Transformed and analyzed data on QlikSense and published it using Qlik View to be able to view and alert any discrepancies.
• Developed Qlik Dashboards with charts for team level metrics.
• Extensively used Pandas, NumPy libraries for data clean ups, transformation and presentations.
• Built a system that could scale up and down as required with no human intervention.
• Used PySpark, Map Reduce technologies for faster runtimes.
• Used Spark SQL and MSSQL for querying databases.
• Created Spark - Qlik Connectors to improvise and stabilize connectivity under both development and production environments.
• Published Qlik Apps into streams to enable view to users in that stream.
• Worked on automating data upload to Qlik Apps which then updates all the dashboards in that App.
• Scheduled and supported notebook automated jobs to run periodically which creates daily, weekly and monthly dashboards and reports for high level understanding of system metrics.

Confidential

Graduate Research Assistant

Technologies/ Tools used: Python, Pandas, NumPy, Matplotlitb, MATLAB, Data Analytic models. Provided Python, MATLAB expertise towards Graduate Research.

Responsibilities:

• Worked on Data Analysis and Data Extraction from various weather stations and satellites.
• Worked on Mann Kendall Tests, Petit Tests, Singular Value Decomposition analysis and many other data analysis methods.
• Supported various research work in the climatology department by providing Python scripting.
• Worked on various research papers related to climatology by providing graphs and plots using Matplotlib and other plotting libraries from Matlab and Python.