Big Data Engineer - Spark Developer Resume IN - Hire IT People

SUMMARY

2 years of Big data Analytics development experience with Hadoop, Apache Spark, Scala, Spark Core, Spark SQL, Hive, UDFs, Data pipeline, ETL, JavaScript, D3, HighCharts, Github, Jira, EC2, and Linux.
20+ years of Information technology application development experience ranging from client server, Data warehouse, ERP and Web Applications and recently to Big data and for vertical industries: Retail, Mining, Oil& Energy, Manufacturing, Finance and ecommerce.
Currently working with Predictive Analytic product development team using Spark, Scala, Hive, Play Framework and HighCharts.
Using Spark APIs to cleanse, explore, aggregate, transform and store machine sensor data.
Working knowledge on how to integrate multiple systems with massive data sets.
Experience in SQL query tuning and ETL parameter optimization,
Data Test plans preparation to execution.
Deep domain experience in sensor data analysis, machine learning and ETL programming.
8 years experience in Data Warehouse applications design and development.
Working knowledge with ETL applications architecture including, data ingestion/transformation pipeline design, data modeling and data mining, machine learning and advanced data processing.

TECHNICAL SKILLS

Hadoop, Spark/Scala, Hive, SQL, Spark Streaming, MLlib,
Java, JavaScript, HighCharts, Play Framework, Hadoop: Pig, Flume, Scoop, Kafka, Strom, Oracle, MySQL, SAP, Jira, Github, visualization, Databricks Cloud, Python, R, D3.js, NoSQL Database: Cassandra, HBase, EC2, Linux

PROFESSIONAL EXPERIENCE

Big Data Engineer - Spark Developer

Confidential, IN

Responsibilities:

Developing predictive analytic product for manufacturing industry to analyze sensor data using Apache Spark Scala APIs: Spark SQL, MLlib, /Hive, Play Framework, JavaScript, and HighCharts.
Writing Spark programs to load, parse, refined and store sensor data into Hadoop and also process analyzed and aggregate data for visualizations.
Written Spark/Scala function to read data from different formats: text and parquet and save data into Hadoop
Developing data pipeline programs with Spark Scala APIs, data aggregations with Hive, and formatting data (json) for visualization, and generating. E.g. Highcharts: Outlier, data distribution, Correlation/comparison, and 2 dimensional charts using JavaScript.
Provided design recommendations and thoughts to sponsors/stakeholders that improved review processes and resolved technical problems.
Mentoring and training on-board team members.
Preparing test datasets and Performing Testing, validating raw data and performance tuning for 1TB files.
Performing Integration task and on boarding new team members.
Worked as Sr SAP Payroll Lead consultant at fortune companies SAP implementations for US, Canada, Expat, International payroll systems.
As a functional consultant: Worked on requirement gatherings, application blue-printing (design), customizations, writing PCRs, designing and testing interface programs for finance, CRM and 3rd Party systems.

Confidential

Sr ERP Techno-Functional & Consultant

Responsibilities:

Designed, developed and implemented organization wise applications: Inventory, membership, Mass(email) marketing, career Training, shipment tracking and direct deposit payment bank interface to FI-Payment, GL interface and etc.
Designed and developed numerous Star/Snow-flake data warehouse schema data-marts with Oracle, KPI & Dashboards with Crystal Reports, ETL tools and Java
Front End Developer, Oracle Database Procedures Developer, and Oracle Application technical consultant.
Part of Telecom-Billing and reservation development team: developed front-end screens for satellite transponder reservation system and also written oracle stored procedures for billing estimation and calculations
Performed Oracle Database, Oracle ERP upgrades and implemented and UPS Logistics system, Conference Maintenance Applications, Badge printing application.
Played major role on Implementation company first ecommerce application.

Confidential

Sr Software Engineer

Responsibilities:

Front End Developer, Oracle Database Procedures Developer, and Oracle Application technical consultant.
Part of Telecom-Billing and reservation development team: developed front-end screens for satellite transponder reservation system and also written oracle PL/SQL stored procedures for billing estimation and calculation
Oracle ERP Financial Applications Technical Consultant: Customized FI-AP/AR-Collection modules and written and maintained interfaces and feeder system to another modules for a truck leasing client.
Designed and developed a scheduled maintenance order generation software application for nuclear power plant using PowerBuilder and Oracle database