SUMMARY

• More TEMPthan 10 year experience related to data managing and reporting on database and data warehouse.
• Installing, configuring, testing Hadoop ecosystem components.
• Capable of processing large set of structured, semi - structured and unstructured data and supporting systems application architecture.
• Managing large datasets using Teradata, Hadoop, MySQL, Microsoft SQL, Oracle, Business Intelligence tools (Business Objects, Alteryx, SSIS).
• Optimizing and automating ETL workflows.
• Well communicable in a multi-group environment to provide the desired marketing business deliverables. Affable, able to effectively communicate and collaborate with team members to resolve problems, enhance efficiency and accomplish targeted objectives.
• Excellent in translating business needs into actionable technical requirements.

TECHNICAL SKILLS

• Spark, MapReduce, Hive, Oozie, Sqoop, Map-reduce, HDFS
• Zookeeper, Sqoop, Flume
• Teradata, MySQL, Oracle, Microsoft SQL Server, Hbase, Accumulo, SAS, DB2
• Tableau, Alteryx, SSRS, SSAS, Excel
• Python, SQL, PHP, HTML, Matlab
• Linux, Unix, Windows

PROFESSIONAL EXPERIENCE

Confidential, Hayward, California

Senior Big Data Engineer / ETL Developer

Responsibilities:

• Designed and implemented new ETL tools for raw data gathering, cleaning, transformation and loading into databases, which helped the engineers to review the correct test results as real-time (it is first time in the company’s history), greatly accelerated the product development.
• Installed and configured HDFS, MapReduce, Hive; Implemented Hadoop cluster and did performance tuning and monitoring.
• Created Hive tables and python codes to load large sets of structured, semi-structured and unstructured data into Hadoop cluster, which coming from a variety of portfolios.
• Created Mysql databases&tables to store Hadoop processed data.
• Set up and fully automated ETL data workflows: raw data - hadoop cluster - sqoop - Mysql DB.
• Created web-based request system using PHP and Mysql.
• Responsible for administration of Hadoop, Hive, python codes and Mysql DB.
• Managed and reviewed Hadoop log files.
• Troubleshooting all kinds of data issues in the data flow, data storage and applications.

Confidential, San Francisco, California

Senior Data Warehouse Engineer

Responsibilities:

• Gatheird, Analyzed and documented business requirements for Mailing Service Data Integration project. Translated Mailing Service business requirements into technical solutions, identified all kinds of data issues and resolve them, wrote complex SQL queries in Teradata data warehouse and set up automatic calculation processes, built Tableau reports for data visualization. theirfore, the company could audit several million-dollar business with 100% accuracy and completeness.
• Independently worked as a liaison between business and IT stakeholders to elicit, analyze, communicate and validate business needs, features and requirements.
• Building complex SQL Queries in the Teradata data warehouse and analyzing profitability data at product, customer segment and channel. Providing the findings to senior managers for decision support, revenue and expense forecasting.
• Analyzing complex data, troubleshooting and discovering root causes of the problems utilizing SQL queries, Hive, SAS, Alteryx and Excel.
• Used Alteryx to develop validating processes for Capital planning and stress testing
• Worked closely with Accounting team, ALM team and Risk team to map GL balance sheet with the other systems.

Confidential, Salt Lake City, Utah

Senior Data Analyst

Responsibilities:

• Maintained daily operations, systems, and data related to Confidential .com’s email programs.
• Worked with Email Marketing Coordinators to build and optimize campaigns by monitoring email campaigns, analyzing results and collaborating with team members.
• Executed complex SQL queries from data warehouse —Teradata and Hadoop.
• Collaborated with BI team in design and development of Enterprise Customer engagement metrics into Teradata data warehouse.

Confidential, San Francisco, California

Marketing Data Analyst

Responsibilities:

• Maintained and supported Oracle 11g data warehouse and Hadoop, optimized SQL queries to improve performance.
• Primarily supported Email marketing and Analytic functions of Macys.com by working with Macys.com CRM Data Mart and systems.
• Developed conversion funnel and metrics reports based on Hive by analyzing the raw feed data
• Responsible for the day-to-day operational activities and help in the execution process of enhancements to the email marketing programs by performing the roles of data auditor, data mapping, issue investigator, system analyst and business implementation support.
• Maintained Epiphany ETL processes.
• Coordinated with Technology and Business teams for migrations of some reporting assignments to a production environment.

Confidential, Issaquah, Washington

BI Developer

Responsibilities:

• Independently developed ad hoc SQL queries for product research, problem resolution, website maintenance, database automation, or to meet the specific needs of various internal clients. Wrote stored procedures using T-SQL and created jobs in SQL Server 2008 to refresh data daily.
• Independently did the data mapping and produced some monthly & weekly commercial reports using T-SQL from ad agency data and company data warehouse. Imported new data into SQL Server 2008 database staging tables and prepared them to append to main database schemas. Created scorecard measures to evaluate Microsoft vendors on compliance with Company policies. Built ad-hoc analyses and metrics using T-SQL from diverse data sources and data warehouse including SQL Server, SharePoint, flat files, and Excel and provided these to managers and team mates. Wrote ETL packages to process the data for BI analysis and making decision.
• Successfully provided accurate business data and analysis to internal users for making decision. Discussed with internal users for reports requirements to match with different types of projects. Made the SSRS and Excel reports to support NA stakeholders.

Confidential

Data Analyst

Responsibilities:

• Independently implemented Oracle 11g and SQL Server 2008 R2 databases, developed process loading Apache web log data into staging tables in database, tan doing data cleansing, data mapping and load into final destination tables using T-SQL or PL/SQL functions and procedures. Developed the OLAP Cubes and created dimensions, levels and hierarchies.
• Independently developed many T-SQL and PL/SQL procedures, analyze data in the destination table using advance SQL group functions, sub-queries. Used MS Access and SSRS to generate business report such as: daily, weekly, and monthly web click, daily unique IP visitors report, most frequently clicked web page report.