SUMMARY

• Proven track in leading and delivering end - to-end systems using the cutting-edge technology to address business/behavior intelligence, data governance, security, compliances, disaster recovery, backup/migration, testing & release management.
• Hands on experience in handling terabytes of data ingestion/streaming of data using ETL process using hadoop HDFS, HBase, MongoDB, HiveQL, Python based modules NLTK for text mining, sklearn, numpy, matplotlib, Tensor flow, Keras and AI neural networks, pandas, Predictive modeling techniques. EDW, Kafka, AWS EC2 (both Dense computing/Dense storage), dynamo, S3 RDS, & Azure cloud, blob containers, Bash shell.
• Strong domain knowledge in Financial (includes Capital markets), E-Commerce, Social, Manufacturing & Healthcare
• Lead the DevOps and BI (core analytics) teams with DaaS and PaaS & SaaS models, along with Docker, jenkins, github (end-to-end) implementation which includes continuous integrations build, tokenize based API Micro services with dual factor authentication & Virtual Private Security.
• Consolidated 2 Silicon Valley datacenter creating a saving of 3 quarters of million.
• Team player, ready to adapt to new challenges & changes. Ready to face problems with solving mentality.

TECHNICAL SKILLS

• Cloudera Hadoop
• HiveQL with UDF/UDAF
• Pig
• Flume
• Sqoop
• YARN
• Teradata
• Oracle
• Oracle RAC
• MySql
• Python
• NLTK
• Numpy
• Sklearn
• Pandas Matplotlib keras
• TensorFlow
• PySpark
• Pytorch
• AI Java
• Stanford NER
• Junit
• Docker containers AWS (EC2, DS/DC)
• RDS
• Dynamo DB & Many others
• Azure Blob container
• Azure Virtual
• Azure DW
• Bash Shell
• Korn Shell
• C Shell Solaris
• Linux
• Github
• Jenkins nagios
• Informatica
• Pentaho
• Talend
• MS Office Suite

PROFESSIONAL EXPERIENCE

Confidential

Sr. Consultant

Responsibilities:

• Architected the migration the existing SAP BIDW ETL process to Azure Sql server (heavy SQL and Procedures) & Hadoop clusters. Heavy involvement Hive with large data ingestion.
• Designed, developed the Machine Learning process for the data science & visualization team with deep text mining for Da-Vinci Robotic systems using Azure Cloud
• Created ML models for customized medical keywords search engine using Python NLTK, Stanford NER, word net corpus, and extensive use of Pandas data frame. This helped 80% search improvement for phone support customers
• Identification and removal of PHI data (eliminated 95%+ lawsuit), encryption of PII data from HIPAA cloud using Stanford NER and NLTK based NER, pandas, and stored into Azure blob container which was further consumed by ETL process.
• Brought marketing campaign data using python based Rest API from survey monkey, Qualtrics and created sentiment score using NB classifier, calculated Net Promoter score
• Created 5 cluster buckets for reported procedure using Pandas, sklearn, matplotlib on various surgery information that are given to Food and Drug Administration using K-Means clustering algorithm.
• Various trial and error of using predictive modeling techniques such as KNN, Naïve Bayesian, Random Forest, linear, logistic regression algorithms to solve business problems
• Created bench mark between MongoDB vs Mark Logic NoSQL on performance, adaptability, scalability, security and many more.
• Codes are built continuous integration using Jenkins, GitHub as a part of release management.

Confidential

Big Data Architect/Engineer

Responsibilities:

• Loyal3 was a startup company which democratized the capital markets by launching pre-IPO companies to public. Position includes leading the team, hands on development and business interaction.
• Designed/Developed/Delivered scalable, near real time (DaaS) and PaaS & SaaS based enterprise DW/BI and behavior system using MySQL including 3 copies of replication with memcache (later migrated to Hadoop on EC2 clusters providing significant 80% increase in business decision making process
• Technology includes Python, Linux bash shell, Hadoop, Hive, Tableau, Pentaho, Docker, rundec, puppet, zabbix, pager duty, Splunk for log processing
• Created, managed and monitored day-to-day ETL activities, which includes integrating with 30 external API using python and Pentaho, created micro services using Kong for downstream data consumption.
• Delivered various executive level dynamic dashboard/KPI metrics which talks about user Acquisitions, Engagements & Monetization based on users, products (IPO and Follow-On), cohorts, NPS, IPO issuer, fraud, stock loyalty index, stock trends, LTV, DRIP and many more
• Lead the DevOps team and saved $750K by closing San Francisco/Santa Clara data center and migrate the prod and dev systems to AWS cloud architecture. Duties includes setting up of EC2/S3, RDS instances, Github repositories, load balancers, Docker based containers & Artifacts to run ETL and prod jobs using dual authentication system.
• Created fault tolerant backup & DR systems across AWS California, Oregon and Virginia on AWS VPC
• Setup Kafka POC to see how it can be used in business.
• Setup the end-to-end continuous integration using GitHub, Docker, Jenkins for release management. Built Docker Swarm kind of tool for docker monitor and integrate the log outputs to splunk.

Confidential

MTS 2 Big data architecture & Data science

Responsibilities:

• Lead, architect and delivered the fully secured Customer DNA subject area, a single source of truth for 140M users which includes heavy hands on work on tuning SQL scripts, python, Hadoop Map/Reduce, Hive, Pig/Latin code reviews, hackathons, Toastmasters.
• Customer DNA has 150 dimensions and personalized behavior analytics consumed by various downstream. Process 9 to 17 B records per day using 4000 nodes of Hadoop cluster with Hive, Pig and Teradata.
• Oversight the data science project for creating various dimensions score such as Device Dominance, Purchase power prediction score, customer Loyalty Index score, Life time value score using NB algorithm and many others consumed by customer DNA using Python, Pandas etc.
• Created the metadata management, data governance, business & technical glossaries for 234 subject areas
• Managed, lead 45 subject areas across 20 cross-functional teams to address day-to-day business operations and enhancements
• Managed over 30 subject areas to fulfill the needs of Confidential bucks, Confidential daily deals.

Confidential

Sr. Consultant - Data Warehouse & Big Data

Responsibilities:

• Re-architect and designed the new Enterprise Data Warehouse (EDW) to handle the 50x growth transactions and stored them in Oracle, Teradata. Informatica for ETL processing, Micro Strategy to cater deep analytics.
• Lead the architecture team during migration and cutover from existing DW to new EDW. Created failover, testing methods, data governance plan, rollback plans during cutover.
• Hourly/Daily KPI indicators, LTV, churn analysis, visits, visitors, time spent, answering polls etc., to provide the pulse of the site to venture capitalists and to top executives
• Attended Hadoop conference at Yahoo to learn about the new technology to be used at Confidential .

Confidential

Sr. Data Architect

Responsibilities:

• Designed and architect the Merchant services data mart to cater the needs of 100+M customers for the fast-growing global consumers using Oracle/Teradata, Informatica tools
• Supported and handled big customers/partners Chase Payment Tech, Royal Bank of Scotland, South West airlines to cater their day-to-day operations/enhancements via Confidential gateway.
• Integrated & delivered button factory, mass mail invoices, subscription, VT into Merchant Service.

Confidential

Sr. Enterprise Architect, Data Warehouse

Responsibilities:

• Designed, delivered the new EDW using Postgres, Pentaho ETL tools, Microsoft SQL Reporting, which generates various KPI dashboards, podcast listens, advertisement, subscription of API based Armstrong & Getty shows, customer churning, conversion rate, peak listens trends.
• Worked with external customers/partners Fox, MSNBC, JC Penny, Pepsi to integrate their commercials into podcasting, and generate various summary, detailed metrics/scores that are published in their portal.

Confidential

Sr. IT Consultant

Responsibilities:

• Lead and delivered the business requirements of Customer Insights (a part of Campaign management system) to track the campaign launch, leads, fulfillments, promotions, scores for potential sales targets, conversions using Oracle, Informatica tools
• Lead the tools consolidation project (migrated to Epiphany lead generation tool) to reduce cost