SUMMARY:

• Cloudera Apache Hadoop Developer Certification
• 5+ years experience big - data projects
• Strong quantitative and communication skills
• Capable of working independently with little or no supervision

TECHNICAL SKILLS:

• Hadoop Ecosystem (Hadoop, Hive, Pig, Spark, HBase)
• Amazon Web Services (EC2, EMR, Redshift, DynamoDB, S3)
• Server-Side Scripting (bash, Ruby, Python, R)
• SQL (Microsoft SQL Server, MySQL, Oracle)
• MATLAB
• Javascript
• Java Server Pages (JSP/JSTL)
• XML
• XSL/XSLT
• CSS
• Unity3D
• Adobe Photoshop and Illustrator
• Microsoft Office

PROFESSIONAL EXPERIENCE:

Freelance Consultant and Developer

Confidential

Responsibilities:

• Machine Learning and Predictive Analytics.
• Neural Network Design and Analysis.

Confidential

Senior Data Analyst

Responsibilities:

• Developed Extract-Transform-Load (ETL) processes as part of a design to migrate a client’s in-house system to the Amazon cloud (AWS). Data was extracted from Oracle using Sqoop, processed with Hive and Pig, and then inserted into MongoDB.
• Proof-of-concept machine learning project for a Confidential .
• Developed a data profiler to analyze files located in a local file system, HDFS or Amazon S3. The profiler dynamically created and executed Pig and Hive scripts to process the files and produced a report including per-field statistical summaries and SVG graphs (viz., the profiler would try to infer the type of the data in a field as part of its analysis).
• Developed a machine learning demo on AWS to identify clients at risk of switching product platform. The demo also illustrated cost and performance advantages over proprietary Data Management Platform (DMP) solutions.
• Created a Facebook Messenger Chatbot proof-of-concept with a Node.js backend. Wrote up a business case and an analysis of the emerging chatbot landscape.
• Developed a proof-of-concept virtual reality (VR) application using Unity3D and the Oculus Rift SDK for a nonprofit rehabilitation and research organization. Custom game dynamics scripts were written in C# (Unity Mono).
• Developed tools and documentation for an internal communications training program.

Confidential

Senior Data Analyst

Responsibilities:

• Prior to the availability of Redshift, designed and wrote first-generation ETL process using shell scripts to coordinate feed ingestion, aggregation and insertion to analytics datastore using Pig and Hive scripts for ETL and HDFS and S3 storage for staging.
• Wrote Python User-Defined Functions (UDFs) for Pig scripts to scrub and transform feed data and pivot output to match intake requirements.
• Wrote automation scripts to pull data files from Confidential, Doubleclick-for-Advertisers (DFA) and SFTP servers using OAuth2 and DynamoDB for session management
• Wrote Ruby scripts to synchronize content between FTP and S3 storage and between S3 and Glacier archives to ensure feed repositories were up to date and archived. Scripts would automatically discover new client data feeds and update feed specifications.
• Used Pig, Hive, shell scripts and Amazon Ruby SDK for ETL and data transfer between S3, HDFS, Hive, Redshift, Microsoft SQL Server and MySQL
• Wrote Ruby scripts to extract data from Excel spreadsheets and load database tables
• Wrote utility Ruby and shell scripts (e.g., log rotation, FTP transfers)
• Used Jenkins CI to manage and monitor scheduled jobs including feed ingestion, database transfers, log rotation and file source synchronization.

Confidential

Senior Developer

Responsibilities:

• Updated Hadoop cluster monitoring with custom filters.
• Wrote Ruby scripts for load testing of internal applications.

Confidential

Data Collection Engineer

Responsibilities:

• Refactored a processing job using R and Hadoop streaming that produced a fifteen-fold decrease in processing time from thirty-plus hours to two hours.
• Wrote unit tests in C# with associated SQL Server stored procedures.
• Updated browser-usage statistics which improved search engine responses.
• Converted Search Engine Results Page (SERP) parsing scripts from a regular expression to XPath based approach.
• Identified inline DNS lookups as a source of latency in the web crawler project; caching of the lookups resulted in approximately a four-fold improvement in performance.

Confidential

Technical Producer/Front-End and Middle

Responsibilities:

• Developed front-and-middle tiers of the “Compare” research tool and co-designed the targeting logic for the custom in-house “conquest” ad product
• Designed and programmed a publishing system that reduced Editorial workload and eliminated a dependence on legacy application servers.
• Programmed crawlable regional aggregate inventory searches and XML site maps.
• Programmed in-page logic with Javascript for scoring interactive advice “quizzes”
• Wrote XSL templates to convert XML content to JSP files for publishing Editorial stories

Confidential

Consultant/Data Analyst/Web Application Developer

Responsibilities:

• Designed and developed proof-of-concept data model and extranet for trading in the MISO (Midwest ISO) electric power market.

Confidential

Web Developer

Responsibilities:

• Created new and maintained existing JSP applications, including a subscription-based vendor listing, industry news-feed channels and secure membership applications.

Confidential

Consultant/Freelance Web Developer

Responsibilities:

• Full e-commerce and catalog management functionality including:
• Secure, IP-restricted private management portal for authorized employees
• Custom promotions and discount codes
• Inventory parameter to remove items from display when unavailable
• Credit cards and "Caribou Cards" (see below) were accepted for purchases
• Functionality for "Caribou Cards" ( Confidential ’s custom gift card, managed by Givex):
• Selected and managed the subcontractor to implement “Balance Increment” service to check and add to the available balance of Caribou Cards
• Secure password recovery and user authentication
• MapQuest-powered store locator and a keyword site-search service
• Designed the “Holiday Gift Selection” section that implemented a custom look-and-feel consistent with Confidential 's holiday theme for that year.
• Adapted print-ready in-store promotions, product displays and packaging for use on the web site.
• Coordinated photo shoots and edited the images for use on the web and in print.
• Performed routine system maintenance: log rotation and SSL certificate management

Confidential

Freelance Web Designer and Application Developer

Responsibilities:

• Consultant for bandwidth trading web portal. Co-developed company’s public web site and designed a bandwidth trading environment demo.

Confidential

Software Engineer

Responsibilities:

• Developed web interfaces for expert systems.