Big Data Engeer - Spark Developer Resume
2.00/5 (Submit Your Rating)
IN
SUMMARY
- 2 years of Big data Analytics development experience with Hadoop, Apache Spark, Scala, Spark Core, Spark SQL, Hive, UDFs, Data pipeline, ETL, JavaScript, D3, HighCharts, Github, Jira, EC2, and Linux.
- 20+ years of Information technology application development experience ranging from client server, Data warehouse, ERP and Web Applications and recently to Big data and for vertical industries: Retail, Mining, Oil& Energy, Manufacturing, Finance and ecommerce.
- Currently working with Predictive Analytic product development team using Spark, Scala, Hive, Play Framework and HighCharts.
- Using Spark APIs to cleanse, explore, aggregate, transform and store machine sensor data.
- Working knowledge on how to integrate multiple systems with massive data sets.
- Experience in SQL query tuning and ETL parameter optimization,
- Data Test plans preparation to execution.
- Deep domain experience in sensor data analysis, machine learning and ETL programming.
- 8 years experience in Data Warehouse applications design and development.
- Working knowledge with ETL applications architecture including, data ingestion/transformation pipeline design, data modeling and data mining, machine learning and advanced data processing.
TECHNICAL SKILLS
- Hadoop, Spark/Scala, Hive, SQL, Spark Streaming, MLlib,
- Java, JavaScript, HighCharts, Play Framework, Hadoop: Pig, Flume, Scoop, Kafka, Strom, Oracle, MySQL, SAP, Jira, Github, visualization, Databricks Cloud, Python, R, D3.js, NoSQL Database: Cassandra, HBase, EC2, Linux
PROFESSIONAL EXPERIENCE
Big Data Engineer - Spark Developer
Confidential, IN
Responsibilities:
- Developing predictive analytic product for manufacturing industry to analyze sensor data using Apache Spark Scala APIs: Spark SQL, MLlib, /Hive, Play Framework, JavaScript, and HighCharts.
- Writing Spark programs to load, parse, refined and store sensor data into Hadoop and also process analyzed and aggregate data for visualizations.
- Written Spark/Scala function to read data from different formats: text and parquet and save data into Hadoop
- Developing data pipeline programs with Spark Scala APIs, data aggregations with Hive, and formatting data (json) for visualization, and generating. E.g. Highcharts: Outlier, data distribution, Correlation/comparison, and 2 dimensional charts using JavaScript.
- Provided design recommendations and thoughts to sponsors/stakeholders that improved review processes and resolved technical problems.
- Mentoring and training on-board team members.
- Preparing test datasets and Performing Testing, validating raw data and performance tuning for 1TB files.
- Performing Integration task and on boarding new team members.
- Worked as Sr SAP Payroll Lead consultant at fortune companies SAP implementations for US, Canada, Expat, International payroll systems.
- As a functional consultant: Worked on requirement gatherings, application blue-printing (design), customizations, writing PCRs, designing and testing interface programs for finance, CRM and 3rd Party systems.
Confidential
Sr ERP Techno-Functional & Consultant
Responsibilities:
- Designed, developed and implemented organization wise applications: Inventory, membership, Mass(email) marketing, career Training, shipment tracking and direct deposit payment bank interface to FI-Payment, GL interface and etc.
- Designed and developed numerous Star/Snow-flake data warehouse schema data-marts with Oracle, KPI & Dashboards with Crystal Reports, ETL tools and Java
- Front End Developer, Oracle Database Procedures Developer, and Oracle Application technical consultant.
- Part of Telecom-Billing and reservation development team: developed front-end screens for satellite transponder reservation system and also written oracle stored procedures for billing estimation and calculations
- Performed Oracle Database, Oracle ERP upgrades and implemented and UPS Logistics system, Conference Maintenance Applications, Badge printing application.
- Played major role on Implementation company first ecommerce application.
Confidential
Sr Software Engineer
Responsibilities:
- Front End Developer, Oracle Database Procedures Developer, and Oracle Application technical consultant.
- Part of Telecom-Billing and reservation development team: developed front-end screens for satellite transponder reservation system and also written oracle PL/SQL stored procedures for billing estimation and calculation
- Oracle ERP Financial Applications Technical Consultant: Customized FI-AP/AR-Collection modules and written and maintained interfaces and feeder system to another modules for a truck leasing client.
- Designed and developed a scheduled maintenance order generation software application for nuclear power plant using PowerBuilder and Oracle database