Principal Big Data Engineer / Architect Resume
Cambridge, MA
SUMMARY:
- Certified Cloudera Hadoop Developer.
- Proven ability to quickly learn new technologies.
- Experienced in the full development life cycle (Agile - TDD/ DBR ).
- Experienced in OOD, OOP, SOA, Hadoop Ecosystem, Spark.
- Proven ability to successfully lead, manage, and develop multiple projects on time and within budget.
- Proven ability to successfully interact and communicate with a diverse customer base on high profile projects.
- Team-worker and self-starter able to work with minimal supervision.
SKILLS:
Programming / Markup Languages: Java - 13 yrs, JSP - 6 yrsOracle PLSQL - 6 yrs, OO PERL- 10 yrs, C # - 2+ yrs, ASP.NET - 2+ yrs, ASP - 4 yrs, Java Script - 7 yrs, Unix Shell (Korn, C, Bash) - 9 yrs.
Frameworks: Spark - 4 years, Hadoop - 5+ yrs, Oozie - 3+ yrs, MapReduce - 5+ yr, Lucene - 3+ yrs, Amazon Web Services (EC2, S3, EMR - Spark/Hive/HBase/Drill on YARN, Elastic Search, Elastic Cache, Kafka, VPC, AWS Security.
Internet Technologies: JMS - 3 yrs, J2EE - 4+ yrs, EJB 2.0 - 3+ yrs, J ava EE7 - 3 yr, EJB 3.0 - -2 yrsWeb Services (Restful 3+ yrs), Java Servlets, JDBC.
Database Technologies: Hadoop - 5+ yrs, Hbase - 5+ yrs, Hive - 5+ yrs, Hibernate - 4 yrs, Oracle 8i - 4 yrs, Oracle 9i - 4 yrs, Oracle 10g - 2+ yrs, Postgres - 4 yrs, PostGIS - 2 yrs, MYSQL - 9 yrs, Oracle PL/SQL Stored Procedures - 6 yrs.
Servers: Tomcat, Tom-ee, IIS, Oracle Application Server, 9iAS.
Version Control: Git, CVS, SVN, Visual Source Safe.
Operating Systems: Unix (Linux, Windows)
Development Tools: Maven 2, Jenkins, Archiva, Contiuum, Ant, Vi, Net Beans, Sun Java Studio Enterprise, Log4j, JUnit, Visual Studio 2005, Toad, Squirrel, PL Edit, SQL Plus, SQL Analyzer, Xml Spy.
Software: Matlab, Visio.
PROFESSIONAL EXPERIENCE:
Confidential, Cambridge, MA
Principal Big Data Engineer / Architect
Responsibilities:
- Apache Spark/Hive/Hadoop/SparkR on Yarn via AWS EMR.
- Transient and long running EMR Clusters.
- S3 as source.
- Apache Drill (EMR).
- Elastic Search.
- Elastic Cache.
- Customer facing Rest Interface.
- Sqoop.
- Tableau integration with S3.
- VPC
- RDS.
- AWS Security
Confidential, Needham, MA
Principal Big Data Engineer / Architect
Responsibilities:
- Apache Spark (Streaming)/Hive/Hadoop on Yarn via AWS EMR.
- Transient and long running EMR Clusters.
- S3 as source.
- Kafka.
- Redshift.
- Elastic Search.
- VPC
- RDS (MySql).
- AWS Security
Confidential, NH
Big Data Architect / Principal Principal Hadoop Engineer
Responsibilities:
- Hadoop (Cloudera).
- HBase.
- Oozie.
- Hive
Big Data Architect
Confidential
Responsibilities:
- Designed and implemented Big Data Platform Architecture using AWS
- Hadoop/hive on Yarn via AWS EMR.
- Transient and long running EMR Clusters.
- S3 as source.
- VPC.
- RDS
- AWS Security
Confidential, Burlington, MA
Principal Software Engineer (Big Data)
Responsibilities:
- Providing Data Analytics for Confidential Analytics Collector (phone application feature usage) using Hadoop Map/Reduce, HBase, Hive, Oozie, Sqoop, Lucene, Amazon Web Services (EC2, S3, AWS SDK for Java, AWS EC2, AWS EMR/HBase, AWS EMR/HIVE) and dash boarding results.
- Provided Development and architecture for Ingest Pipeline (ETL) to ingest 100+ TB of data per month for over 56 services.
- Provided Data Insights for places recommendations using Data Mining (Common Crawl Corpus, Custom Web Crawl - Nutch, Twitter Streaming API, Facebook API, Foursquare API, Mahout (Recommendation), AWS S3, AWS EMR, AWS EC2, AWS EMR/HBase, AWS EMR/HIVE, Lucene, Solr Cloud.
- Contributed to POC for platform migration from Cloudera to AWS EMR, s3, and Data Pipeline. POC for client side data encryption to AWS s3, EMR.
Confidential, Lexington, MA
Software Engineer
Responsibilities:
- Providing Agile development, as well as team lead, and architecture for Cloud Computing using Hadoop, Hbase, Lucene, and numerous SOA projects using Web Services, Soap, Axis1, Axis2, JMS, JaxB, JaxR, XmlBeans, UDDI, XMPP, Spring, NetBeans 6.1, Tomcat 6.0, Ant, Maven2, Continuum, Archiva, JPA, Hibernate, Oracle 10g, Postgres, Sybase, MySql.
Confidential, Lebanon, NH
Software Engineer
Responsibilities:
- Key contributor providing development for ZENworks Asset Management Software Suite using Servlets, JSP, Eclipse 3.1, Tomcat 5.5, Apache, Ant, Maven, Hibernate 3.0, Sybase.
Confidential, Beverly, MA
Sr. Programmer
Responsibilities:
- Provided development for Java configuration management system using Stateless CMP 2.0 with Oracle 9i, Tomcat 5.5, Net Beans 5.5, J2EE 1.4, Jboss 4.0.5, Struts 1.3, JSP, Servlets, Web Services, XSLT for reports.
- Provided orchestration development for B2B messaging to ERP system using BizTalk 2004, C#, Visual Studio.
- Provided development for B2B Message Tracking Application using C#, Threads, Object Serialization/De-serialization, Visual Studio.
- Provided R&D and implementation for SOA using Microsoft UDDI server.
- Provided development for Samsung B2B Messaging using C#, Web Services, Object Serialization/De-serialization from/to xml, Visual Studio.
Confidential
Software Engineer
Responsibilities:
- Provided development, requirements gathering, and documentation for mission critical FTP applications using Shell scripting (Korn) on Unix platform with Cron integration
Confidential, Boston, MA
Software Engineer/Consultant
Responsibilities:
- Provided development, requirements gathering, and documentation for mission critical custom FTP client/server using SQL Server 2000, OO Perl 5, PGP and DES encryption/decryption, with job -scheduler integration.
