Engineer Resume

CAREER SUMMARY:

Overall 10+ years of experience with 2 years of experience on Big Data technologies and Hadoop stack..
Experienced in manipulating and analyzing complex, high volume, high dimensionality data from varying sources.
Strong experience working with HDFS, MapReduce, Spark, Hive, Pig, Sqoop, Flume and HBase
Good exposure to hive queries, map - reduce jobs, spark jobs.
Worked on various Hadoop Distributions (Cloudera, Amazon AWS).
Strong database skills, Object Oriented Programming, development and troubleshooting skills.
Involved in different phases of SDLC (Analysis, Planning, scheduling, Effort Estimation, Design, Development, Testing and Delivery activities)

TECHNICAL SKILLS:

Languages: Python, Java Script, C, Scala

Databases: Oracle, SQL Server, MS Access, HBase

Hadoop Environment: Spark / Streaming, Mapreduce, HiveQL, Pig, Sqoop, Kafka, Flume, AWS

Web: HTML, CSS, PHP, XM

Operating Systems: Linux, UNIX, Windows server, Windows OS, UbuntuData analysis Tools: Python pandas

Methodologies: SDLC, Agile, Scrum

PROFESSIONAL EXPERIENCE:

Confidential

Engineer

Technology: Hadoop Ecosystem, HDFS, MapReduce, Flume, Sqoop, Hive, Spark, Spark SQL, Python

Responsibilities:

The system pulls information from multiple data sources and ingests it into the system data lake after which it helps in identifying trends/stock volume data for profitable stock purchasing or selling.
Worked on a live 30 nodes Hadoop cluster running CDH5.
Worked with unstructured and semi structured data of 23 TB in size.
Developed python scripts to scrape data from sources and stored it into buckets to run analytics.
Developed a Sqoop incremental Import Job, Shell script & CRON JOB for importing data into HDFS.
Imported data from HDFS into Hive using Hive commands. Created Hive Partitions for Date and Stock using imported data.
Creating and configuring the flume agent with proper source, channel &sinks to add data into HDFS.
Developed programs using Scala for spark to handle mathematical calculations using RDDS and deployed it in the cluster.
Developed programs using Scala for spark streaming to handle live data using Spark Streaming to analyze market trends.

Confidential

Engineer

Technology: Hadoop, Hive, Hbase, MySQL, PHP

Responsibilities:

Involved in data analysis plannings to reference preselected key e-mail words(like project name/numbers) with existing MySQL server databases and highlight all available data links with reference to the given keyword so that the user can access the data easily instead of separate searches to save time and improve productivity.
Maintained dynamic MySQL database for Cosmos website that handles millions of dollars monthly.
Provided admin support to end users by identifying and fixing bugs to access departments' website.
Designed, coded and tested various apps for cosmos website.

Confidential, NY

Engineer /Analyst

Responsibilities:

Data-center engineer responsible for implementing day to day document migration for infrastructure projects.
Used/Tested PIMS Data Warehousing software based on Oracle to process monthly payments, budget change orders and overruns. Reported errors to development team by sending screen shots to rectify errors so that the software can be used to process payments.
Create and manage used budget vs expected analysis and generate budget /variance report at various management levels to procure additional funding.

Confidential, NY

Engineer /Analyst

Responsibilities:

Used/Tested PIMS Data Warehousing software based on Oracle to process monthly payments, budget change orders and overruns. Reported errors to development team by sending screen shots to rectify errors until they are fixed to use software to process payments.
Evaluate approved bids for various infrastructure projects including civil, utility and electrical contractors; analyze change of scopes and overruns for technical / commercial review all in a timely manner to meet business unit expectations and deadlines for contract completion. Present negotiated change orders to the operating committee with reference to past project’s comparable pricing, economics and budget.
Negotiate project savings by comparing procurement cost with reference pricing, current market/material cost, inflation, estimates/budget and conduct rigorous vendor negotiation techniques

Confidential

Project /Lead Engineer

Responsibilities:

Worked as project lead/engineer on various projects including preparing/reviewing budgets and schedules for various projects.