We provide IT Staff Augmentation Services!

Big Data Engeer - Spark Developer Resume

IN

SUMMARY

  • 2 years of Big data Analytics development experience with Hadoop, Apache Spark, Scala, Spark Core, Spark SQL, Hive, UDFs, Data pipeline, ETL, JavaScript, D3, HighCharts, Github, Jira, EC2, and Linux.
  • 20+ years of Information technology application development experience ranging from client server, Data warehouse, ERP and Web Applications and recently to Big data and for vertical industries: Retail, Mining, Oil& Energy, Manufacturing, Finance and ecommerce.
  • Currently working with Predictive Analytic product development team using Spark, Scala, Hive, Play Framework and HighCharts.
  • Using Spark APIs to cleanse, explore, aggregate, transform and store machine sensor data.
  • Working knowledge on how to integrate multiple systems with massive data sets.
  • Experience in SQL query tuning and ETL parameter optimization,
  • Data Test plans preparation to execution.
  • Deep domain experience in sensor data analysis, machine learning and ETL programming.
  • 8 years experience in Data Warehouse applications design and development.
  • Working knowledge with ETL applications architecture including, data ingestion/transformation pipeline design, data modeling and data mining, machine learning and advanced data processing.

TECHNICAL SKILLS

  • Hadoop, Spark/Scala, Hive, SQL, Spark Streaming, MLlib,
  • Java, JavaScript, HighCharts, Play Framework, Hadoop: Pig, Flume, Scoop, Kafka, Strom, Oracle, MySQL, SAP, Jira, Github, visualization, Databricks Cloud, Python, R, D3.js, NoSQL Database: Cassandra, HBase, EC2, Linux

PROFESSIONAL EXPERIENCE

Big Data Engineer - Spark Developer

Confidential, IN

Responsibilities:

  • Developing predictive analytic product for manufacturing industry to analyze sensor data using Apache Spark Scala APIs: Spark SQL, MLlib, /Hive, Play Framework, JavaScript, and HighCharts.
  • Writing Spark programs to load, parse, refined and store sensor data into Hadoop and also process analyzed and aggregate data for visualizations.
  • Written Spark/Scala function to read data from different formats: text and parquet and save data into Hadoop
  • Developing data pipeline programs with Spark Scala APIs, data aggregations with Hive, and formatting data (json) for visualization, and generating. E.g. Highcharts: Outlier, data distribution, Correlation/comparison, and 2 dimensional charts using JavaScript.
  • Provided design recommendations and thoughts to sponsors/stakeholders that improved review processes and resolved technical problems.
  • Mentoring and training on-board team members.
  • Preparing test datasets and Performing Testing, validating raw data and performance tuning for 1TB files.
  • Performing Integration task and on boarding new team members.
  • Worked as Sr SAP Payroll Lead consultant at fortune companies SAP implementations for US, Canada, Expat, International payroll systems.
  • As a functional consultant: Worked on requirement gatherings, application blue-printing (design), customizations, writing PCRs, designing and testing interface programs for finance, CRM and 3rd Party systems.

Confidential

Sr ERP Techno-Functional & Consultant

Responsibilities:

  • Designed, developed and implemented organization wise applications: Inventory, membership, Mass(email) marketing, career Training, shipment tracking and direct deposit payment bank interface to FI-Payment, GL interface and etc.
  • Designed and developed numerous Star/Snow-flake data warehouse schema data-marts with Oracle, KPI & Dashboards with Crystal Reports, ETL tools and Java
  • Front End Developer, Oracle Database Procedures Developer, and Oracle Application technical consultant.
  • Part of Telecom-Billing and reservation development team: developed front-end screens for satellite transponder reservation system and also written oracle stored procedures for billing estimation and calculations
  • Performed Oracle Database, Oracle ERP upgrades and implemented and UPS Logistics system, Conference Maintenance Applications, Badge printing application.
  • Played major role on Implementation company first ecommerce application.

Confidential

Sr Software Engineer

Responsibilities:

  • Front End Developer, Oracle Database Procedures Developer, and Oracle Application technical consultant.
  • Part of Telecom-Billing and reservation development team: developed front-end screens for satellite transponder reservation system and also written oracle PL/SQL stored procedures for billing estimation and calculation
  • Oracle ERP Financial Applications Technical Consultant: Customized FI-AP/AR-Collection modules and written and maintained interfaces and feeder system to another modules for a truck leasing client.
  • Designed and developed a scheduled maintenance order generation software application for nuclear power plant using PowerBuilder and Oracle database

Hire Now