SUMMARY:

Experienced and versatile Big Data, data warehouse and database expert with very strong engineering background. Expert in NoSQL Big Data technologies as Hadoop and large Data Warehouses.

EXPERIENCE:

Sr. Software Dev Engineer

Confidential, Bellevue, WA

Responsibilities:

• Modified and wrote some new futures of an existing ETL Java application, that resides on AWS S3 bucket location, used to load data from varieties of sources - Teradata, MS SQL and MySQL to S3 and from S3 to Terada or AWS Redshift. The data is mainly used for lodging analysis from different teams in US and Europe.
• Wrote java classes and beans to integrate AWS Vault to the application to ensure better security of access passwords and tokens.
• Wrote java classes and methods to create, modify and delete hive tables and views on Qubole Data Service that are sourcing the data files directly S3 bucket locations.

Sr. Big Data Architect/Developer

Confidential, Bellevue, WA

Responsibilities:

• Worked with Azure, HDInsight, and Hive and C#.
• Worked with telemetry event raw data, coming from Minecraft and Xbox gaming activities and transformed it to dimensional model and ad hoc tables for reporting and to support data scientist’s needs.

Sr. Big Data Engineer

Confidential, Seattle, WA

Responsibilities:

• Worked with Hadoop using Hue and Cloudera Interfaces.
• Architected the schema, designed and developed some of the hive tables in an existing BI EDW
• Wrote multiply complicated hive scripts and Oozie workflows.
• Wrote Python scripts for extracting and deposit data form and to external services as Google Ad word and Bing ads and Confidential S3.
• Created multiply shell scrips to sftp in and out files for use in Oozie workflows.
• Familiar with Spark, Kafka and Flume.

Sr. BI Data Warehouse engineer

Confidential, Seattle, WA

Responsibilities:

• Wrote custom queries for an internal data distribution BI system based of Oracle and AWS Redshift to supply the reporting needs for Confidential Prime department.
• Redesigned and created new custom queries based of new reporting metrics requested by the business.
• Modified an existing Ruby script, running on Red Hat Linux to back filling the data.

Business Intelligence/Big Data and Data Warehouse Consultant

Confidential, Bellevue, WA

Responsibilities:

• Wrote complicated Big Data COSMOS Scope scripts, reducers and combiners using C# to build BI multidimensional Data Warehouse.
• Wrote a C# command line application for decryption and encryption of pii values residing in big size data files, either exported or to be imported to COSMOS. The application allows multiple columns to be selected and to be processed in big batches for better performance.
• Wrote another C# command line application to extract data from Azure Table Storage and uploaded it to a SQL table in batches, providing an additional pii data needed for the BI reporting.

Senior Business Intelligence/Data Warehouse Engineer

Confidential, Seattle, WA

Responsibilities:

• Redesigned optimized and improved the performance of an existing real time Business Intelligence Data Warehouse, built with MS SQL technology and currently used as the main BI reporting tool in the company.
• Optimized and wrote multiple varieties of T-SQL stored procedures and SSIS packages.
• Added new source extracts and implemented business logic to flow the data to the target dimensional model schema.
• Migrated the entire system to a new server in a different data center, including all exiting ETL modules like SSIS packages, Hadoop on Google cloud, Java and Python scripts, MySQL connections.

Principal Consultant

Confidential, Bellevue, WA

Responsibilities:

• Architected designed and built hundreds of TB No SQL Big data warehouse using MS COSMOS technology as part of an another project for Confidential marketing group. Wrote SCOPE scripts, Reducers, C# functions and libraries as part of the implementation of dimension and fact stream sets. Optimized the scope script to improve performance and limiting and avoiding data skews.
• Worked on a project for Confidential advertisement group where I have redesigned the existing and created some new MS SQL 2012 stored procedures, views, SSAS cube structure and measure groups, implemented partitioning for the big tables and redesigned indexes of a data warehouse application, used for as main BI analysis tool in the customer group. The target was to improve performance without to change the business logic. It was achieved with a customer satisfaction and with over 60% overall processing time improvement and allowing gradual and independent and parallel partition processing instead of full ETL and SSAS cube the customer had before.
• Provided a quick fix for BI analysis and reporting data mart build on MS SQL and SSAS technologies and SSIS ELT tool, used at Confidential, B2B team.
• Provided diagnostic and full redesign plan for the data mart above, rationally to satisfy the business analytical and reporting needs on different aggregation levels, drill through and dashboard.
• Provided a diagnostic and redesign plan for a complicated SQL/SSAS data warehouse for another customer - Confidential .

Senior Architect and SDE

Consultant, Kirkland, WA

Responsibilities:

• Remodeled, redesigned and improved of the performance of the backend database on an internal Confidential Tax adjustment application.
• Created new tables and views. Wrote new and modified some of the existing stored procedures.
• Created new jobs to maintain defragmentation of the biggest reporting tables.
• Created and modified existing SSRS reports.
• Deployed all database instances to AWS Cloud and developed the necessary security changes.

Senior Data Warehouse Developer

Confidential, Bellevue, WA

Responsibilities:

• Wrote new SSIS packages as part of the ETL process.
• Provided architecting, modeling and development consulting of a big data warehouse for the BI needs of Confidential Office 365 .
• Work with the internal Confidential ’s big file based data warehouse system - COSMOS
• Architected, designed and build an automated tool for generating large numbers of SCOPE scripts (the scripting language used in MS COSMOS) and configuration files using C# 2012 .
• Wrote new and modified existing SCOPE scripts.

Senior Database Developer

Confidential, Seattle, WA

Responsibilities:

• Modified, optimized and improved performance of existing stored procedures views and functions with highly usability of the company’s web applications.
• Designed, developed and built multiply new stored procedures tables and views needed to fulfill the new projects requirements and customer’s requests.
• Build of highly efficient stored procedures, replacing existing inline SQL queries embedded in the web pages.

Senior Data Warehouse Developer Developer / Architect

Confidential, Bellevue, WA

Responsibilities:

• Architected, designed and developed and improved performance (including modifying, merging or rebuilding stored procedures and views) of 50TB data warehouse application including existing ETL with around 25+ GB daily loading extracts with critical importance of the company business. The application has more than 40 sources such as flat files and link servers to Oracle and other MS SQL databases.
• Designed and created scripts and stored procedures for migrating and managing of existing historical and current data into multiple physical database file groups and file.
• Designed and created stored procedures for creation and management of page compression for the file groups and data above.
• Created, modified and performance tuned of MOLAP SSAS databases, DS, DSV, dimension and cubes and the underling measure groups, measures and partitions on SSAS (Analysis Services 2008 and 2005) applications having the MS SQL 2008 application above for source. The current application contends over 150 dimensions and over 100 cubes.
• Built a C# tools, using AMO namespace for multithreaded processing of partitions, modifying and creating SSAS (Analysis Services 2008 / 2005) objects such as partitions, dimensions, cubes, measure groups.
• Wrote MDX scripts needed for customer file exports and reports.
• Architected, designed and developed another SQL 2008 database for an application personally requested from the senior VP of sales of the company.
• Managed and mentored team of 7 developers giving then daily tasks and requesting the status of their work. Giving them directions on how to implement their tasks.

Development Manager and Lead Engineer

Confidential, Seattle, WA

Responsibilities:

• Redesigned and migrated a legacy MS Access & VB6 system into a robust SQL Server 2000, ASP.NET and SQL Reporting Services application
• Built core implementation and created modular framework to enable future extensions of the system
• Made essential use of pivoting & unpivoting, integrated joins between XML documents and physical database objects
• Defined the exchange of data between the application database and internal databases using SQL replications and SQL Agent Jobs
• Created a managed-code library for encryption/decryption of sensitive data such as SSN and Alien numbers
• Created custom ASP.NET web controls, base page templates and C# parent classes for the front-end interface

Applications Developer

Confidential, Redmond, WA

Responsibilities:

• Designed ETL queries for extracting, data transforming & scrubbing procedures for an internal Business Intelligence forecast system. Streamlined queries and optimized performance. Created C# front-end interface. Implementation took advantage of new MS SQL 2005 features such as XML, pivoting and CTE (common table expression)
• Mentored another developer to create a Web Services component for integrating data from disparate data sources through ETL