Resume
Lead Big Data Analyst - Energy, ManagemenT
SUMMARY
Over 16+ years of IT experience including 2+ years on Big Data Hadoop Projects.
TECHNICAL SKILLS
Big Data: Hadoop, MapReduce, Tez, Spark, Pig, Hive, Hbase, Flume, YARN, Ambari, Sqoop.
Cloud: AWS, Adobe Creative Cloud.
Database: MySQL, MS SQL Server, Oracle, SQLite, MS Access.
Tools: MySQL Workbench, MS Visio, Adobe Creative Suite, GIT, Visual Studio.
Programming: Java, PHP, ASP.NET, C++, C, Python.
Virtualization: VMware, Oracle Virtual Box, Hyper V.
Others: SQL, Java Script, HTML5, CSS, XML, Bootstrap, Unix Shell Script.
PROFESSIONAL EXPERIENCE
Lead Big Data Analyst - Energy Management
Confidential
Responsibilities:
- Architecture to develop data pipelines to ingest and process electricity voltage data (10 TB) from oil rigs around teh world into HDFS.
- Architecting for Big Data Projects aimed to minimize maintenance and damage to equipment.
- Setup of shopping mall building automation using IOT Echelon Smartserver 2.2 FT embedded hardware and software to reduce cost expense for clients.
- Increase income by millions of dollars by saving electricity cost for shopping mall by providing data analysis using spark on AWS EMR (Elastic Map Reduce).
Lead Software Developer
Confidential
Responsibilities:
- Analysis weather pattern data criteria such as solar, wind, rain from last 20 years from National Oceanic and Atmospheric.
- Predicted energy usage for shopping mall to estimate accurate expense budget.
Software & Web Developer
Confidential
Responsibilities:
- Provided technical assistance to end users with their reporting interface and customize SQL queries to full-fill their requirements.
- Provide support to more than 30 vendors on third party applications and technical assistance on in-house software.
- Design and Architect
- Bigdata Development
- Client Interaction & Support
- Team Management
Web Developer
Confidential
Responsibilities:
- Responsible for designing and implementing strategies, architectures, ingestion, storage, consumption and delivery processes for complex, large-volume, multi-variant, batch and real time data sets used for modeling, data mining, and research purposes.
- Created Hive queries that halped market analysts spot emerging trends by comparing fresh data with EDW reference tables and historical metrics.
- Wrote Hive and Pig scripts for joining teh raw data with teh lookup data and for some aggregative operations as per teh business requirement.
- Used Pig as ETL tool to do transformations, event joins, filter both traffic and some pre-aggregations before storing teh data onto HDFS.
- Exported teh analyzed data to teh relational databases using Sqoop for visualization and to generate reports For teh BI team.