Engineer Resume NY - Hire IT People

SUMMARY:

Overall 10+ years of experience with 2 years of experience on Big Data technologies and Hadoop stack.
Experienced in manipulating and analyzing complex, high volume, high dimensionality data from varying sources.
Strong experience working with HDFS, MapReduce, Spark, Hive, Pig, Sqoop, Flume, Kafka and HBase
Good exposure to hive queries, map - reduce jobs, spark jobs.
Familiar working with Spark Streaming & Spark MLlib
Worked on various Hadoop Distributions (Cloudera, Amazon AWS).
Strong database skills, Object Oriented Programming, development and troubleshooting skills.
Involved in different phases of SDLC (Analysis, Planning, scheduling, Effort Estimation, Design, Development, Testing and Delivery activities)

TECHNICAL SKILLS:

Languages: Python, Java Script, C, Scala

Databases: Oracle, SQL Server, MS Access, HBase, Terradata

Hadoop Environment: Spark / Streaming, Mapreduce, HiveQL, Pig, Sqoop, Kafka, Flume, AWS, MLib

Web: HTML, CSS, PHP, XM

Operating Systems: Linux, UNIX, Windows server, Windows OS, UbuntuData analysis Tools: Python pandas

Methodologies: SDLC, Agile, Scrum

PROFESSIONAL EXPERIENCE:

Confidential

Engineer

Technology: Hadoop Ecosystem, HDFS, MapReduce, Flume, Sqoop, Hive, Spark, Spark SQL, Python

The system pulls information from multiple data sources and ingests it into the system data lake after which it helps in identifying trends/stock volume data for profitable stock purchasing or selling.
Worked on a live 30 nodes Hadoop cluster running CDH5.
Worked with unstructured and semi structured data of 23 TB in size.
Developed python/Scala scripts to scrape data from sources and stored it into buckets to run analytics.
Developed a Sqoop incremental Import Job, Shell script & CRON JOB for importing data into HDFS.
Imported data from HDFS into Hive using Hive commands. Created Hive Partitions for Date and Stock using imported data.
Developed programs using Scala for spark to handle mathematical calculations using RDDS and deployed it in the cluster.

Confidential

Engineer

Technology: MySQL, JavaScript

Data-center engineer responsible for implementing day to day document migration for infrastructure projects using DWR Cosmos web application.
Maintained dynamic MySQL database for Cosmos website that handles millions of dollars monthly.
Provided admin support to end users by identifying and fixing bugs to access departments' website.
Designed, coded and tested various apps for cosmos website.

Confidential, NY

Engineer /Analyst

Data-center engineer responsible for implementing day to day document migration for infrastructure projects.
Used/Tested PIMS Data Warehousing software based on Oracle to process monthly payments, budget change orders and overruns. Reported errors to development team by sending screen shots to rectify errors so that the software can be used to process payments.
Create and manage used budget vs expected analysis and generate budget /variance report at various management levels to procure additional funding.

SI Engineering, NY

Engineer /Analyst

Used/Tested PIMS Data Warehousing software based on Oracle to process monthly payments, budget change orders and overruns. Reported errors to development team by sending screen shots to rectify errors until they are fixed to use software to process payments.
Evaluate approved bids for various infrastructure projects including civil, utility and electrical contractors; analyze change of scopes and overruns for technical / commercial review all in a timely manner to meet business unit expectations and deadlines for contract completion. Present negotiated change orders to the operating committee with reference to past project’s comparable pricing, economics and budget.
Negotiate project savings by comparing procurement cost with reference pricing, current market/material cost, inflation, estimates/budget and conduct rigorous vendor negotiation techniques

Various Organizations

Project /Lead Engineer

Worked as project lead/engineer on various projects including preparing/reviewing budgets and schedules for various projects.