TECHNICAL SKILLS

Development Languages: Python, PySpark, Pandas, SQL, Linux Bash scripting, R, VBA, Awk, etc

Data Integration & BI Tools: Pentaho PDI, MicroStrategy 10 Enterprise. Tableau 10, Crystal Reports SQL Server Reporting Services (SSRS), SQL Server Integration Services (SSIS), SQL Server Analysis Services (SSAS), etc

Databases: Teradata, Postgres, SQL Server, MySql, etc

System: Linux, AWS, Active Directory

PROFESSIONAL EXPERIENCE

Data engineer

Confidential

Responsibilities:

• Helped the transition of of Machinima's payment system to Fullscreen's payment system.
• Developed/improve data pipeline for payment system, using Python, Pandas, Redshift, AWS glue (PySpark) for ETL and using Luigi for workflow.
• Developed Django web application, Youtube asset mapper, allowing netops to map the asset to custom id for payment purpose.
• Built data lake using AWS S3 and AWS Athena.

LEAD Data engineer

Confidential, Burbank, CA

Responsibilities:

• Perform design, development, enhancements, and ongoing support for Data Integration/ETL frameworks and payment processing workflows - analytic and transactional environments.
• Develop and support ETL processes to extract, transform, and load data from multiple data sources: YouTube, Facebook, Google DFP (DoubleClick for Publishers), Twitch, Crimson-Hexagon, Salesforce etc. Focus on APIs, financial/biz performance reporting, etc.
• Productized numerous data integration/ETL processes to support easy configuration (reusability) and multi-tenancy across various enterprise business units as well as outside companies.
• Automate Youtube ETL jobs using Google API, Youtube Analytical API and Youtube Reporting API.
• Automate Facebook using Face Graph API.
• Automate Crimson Hexagon monitors data extraction for sentiment analysis.
• Develop an Enterprise Data Warehouse from the initial implementation. Create both logical and physical data models in support of BI analytics and transactional payment processing.
• Design and develope Youtube partner payment system, including statement generation with MicroStrategy.
• Created visualizations (dashboards and reports) using both Tableau and MicroStrategy 10.
• Administer Tableau 10, MicroStrategy 10 (devops and sysops activities).
• System administration including AWS and associated components e.g. EC2s, various storage types (S3, EBS, etc), security (roles, bastion, etc), DNS and identity management, etc.

Microstrategy architect / Developer

Confidential, Los Angeles, CA

Responsibilities:

• Designed architecture, report and dashboard for Best Buy eLearning Lounge BI Reporting Project; It gives Best Buy the ability to access all participation metrics for the CyberScholar Retail Network.
• Designed architecture, report and dashboard for C.A.P. (Creative Channel Portal). It is an internal interactive, self-serve portal that gives our users the ability to access participation metrics for the CyberScholar Retail Network, including Best Buy Learning Lounge and Walmart. C.A.P. allows Analytics to automate several manual processes, as well as provide CPMs/RPMs with a robust tool to easily analyze data and convert insights into storylines for clients.
• Administered the MicroStrategy server, SQL server for data warehouse. Performed MicroStrategy upgrade from version 9.1 to 9.2 and 9.2 to 9.3.
• Participated in data warehouse architecture and database model design.

DBA / BI Developer

Confidential

Responsibilities:

• Developed report, document and dashboard using Microstrategy 9
• Created Narrowcast services to automatically deliver reports to users
• Administered the SQL server, Microstrategy server, Narrowcast Server.
• Developed report using MS SSRS
• Optimized T-SQL code, maintain existing code and fix bugs whenever needed
• Participated in data warehouse architecture and database model design.
• Developed and maintained ETL routines for importing data from heterogeneous data sources into the data warehouse, For example, sales data are from other Confidential independent stores as well as other retailers, such as the Bay, Zellers, Dillard’s etc.

DBA / BI Consultant

Confidential, Farmington Hills, MI

Responsibilities:

• Designed data warehouse for the corporate sales analysis, implement the data warehouse on SQL Server.
• Developed automated and reusable routines to cleanse and extract data from all stores daily using T-SQL queries, stored procedures and SSIS packages.
• Designed and implemented Auto-Lab Sales Reporting System using MicroStrategy, SSRS for web user and MS Access interface for desktop user.
• Created reports for ALBMS (AutoLab store sales management system) using Crystal Reports XI.
• Administered Windows 2008 Server, Active Directory, Terminal Service, IIS Service and SQL Server etc.
• Implemented and maintained system backup and restore strategy for database servers.
• Maintained the company website with VB.Net.

SQL DBA / Developer

Confidential

Responsibilities:

• Administered SQL Server and Membership System for Detroit Youth foundation.
• Maintained data integrity and information backup process.
• Implemented database mirroring and log shipping and table replication.
• Designed and implemented Web Reporting System to customize existing Membership System using SQL Reporting Services, SharePoint Server and Web Parts.
• Developed MS Access VBA applications for different departments of the agency. For example, Foster Care Billing system for LSSM using MS Access VBA and integrated it to accounting system (MS NAV).
• Created various reports using different reporting tools, such as Microsoft Access, Business Intelligence Development Studio for SQL Server Reporting Services(SSRS) and Crystal Reports XI.
• Developing, enhancing and maintaining in-house relational databases.
• Created data services to be consumed by downstream applications.

System Administrator / Database Administrator

Confidential

Responsibilities:

• Administered Windows 2000/2003 network consisting of 14 locations (one corporate and 13 retail chain stores). The branch locations were connected to corporate location through SonicWALL VPN Connections.
• Maintained DST Shop Management System in branch locations. Retail solution contains 2-3 computers locally networked using DST Shop Management System as POS; and using PC-Charge to process credit cards and checks.
• Maintained SQL Server and implemented backup and restore strategy for database server.
• Created DTS package and SQL store procedures to export sales data etc.