Data Warehouseengineer Resume Profile
Data WarehouseEngineer
Data Management - Database Operations - Data Warehouse Engineer - Data Modeler - PL/SQL and T-SQL developer
I make data work by designing and building data focused ecosystems that use the right tool for the job. Transactional systems need high performance, high availability transaction capable systems. Reporting systems need databases and infrastructure designed for the needs of the business analyst. Big Data and Analytics processes need lots of hardware and the capabilities for elastic growth. Data has to flow efficiently between these systems. Designing all aspects of this data ecosystem requires taking a use-case approach for each component of the ecosystem. Each type of use-case has a different set of requirements. I work passionately to understand the needs of each type of use of data, and apply best practices to the whole data architecture.
Core competencies
- Data Warehouse infrastructure Data modeling PloyGlot management
- Database operations Data Integration Transition planning and support
- ETL Development Data Analysis Incident Management
Career Overview
- I engineered a cloud-based infrastructure for the management of health care data for 3M customers. Using RightScale to manage our clouds Rackspace,Azure,AWS , and direct configuration tools for our hosted data centers SunGard . Our data platforms are diverse: Data Stax Enterprise Cassandra, SQL Server 2008, ClouderaHadoop, and Percona MySQL using Gazzang as an encryption technology to ensure we comply with HIPAA in protecting our PHI data. I perform data server configuration, capacity planning, data modeling, Pentaho Deployment, performance tuning and on-call support as the need arises. Our primaryapplicationsupports the medical coding industry by using natural language processing on physician transcriptions. The enrichment, management, organization and analysis of this medical data is the main goal of our organization. The secondary goal is to transition to an analytics based organization using this data to improve the lives of physicians and patients throughout the world.
- Lead Data Engineer
- My first project was to lead a data warehouse implementation using Data Vault Methodology for an origination analytic project. We were using Informatica as the ETL platform, Oracle as our database platform, and Cognos as the reporting platform. The entire Architecture is designed in ERWin as we pull data from various sources and populate our data marts visualized with Cognos.
- My current project is to make recommendations for the adoption of a PolyGlot Analytics Framework for a large grocer based in Cincinnati
- I am a Data Architecture consultant providing expertise in Data Architecture to clients of Clear Measures. In addition to my project responsibilities, I am also the BigData Competency lead for Clear Measures. This requires me to do internal training on Hadoop and Cassandra, as well as review project candidates for these technologies.
Confidential
Data Warehouse Developer
Rent the Runway is a high fashion rental portal that allows women to rent designer items for events they wish to attend. The Drupal based web site does not lend itself to analytical type operations. I built the foundation of a data warehouse to optimize the performance of the analytical team. This entails the creation of a new data model and development of ETL procedures to load the new data model.
Data Warehouse Developer
- The current OBIEE dashboards give a high degree of visibility into current data updated on a nightly basis. This high level of turnaround for the data gives Financial analysts, community executives, and corporate executives almost immediate visibility into the financial performance of the various communities at Sunrise Senior living.
- The prior system ran once a month and loaded the data into a macro controlled excel spreadsheet. I specifically worked on loading the data into fact tables, performance optimization of the queries generated by OBIEE, and custom calculations done at the data layer to improve performance of OBIEE.
- The financial data mart I worked on brought together actual and budget data from PeopleSoft. We developed the data models, created the PL/SQL code to populate the models and assisted the BI team with query optimization and tuning. We had a DBA group that we coordinated with for implementations. Our PL/SQL code ran on a nightly basis for loading the data models.
Data Management Consultant
I worked as a data management consultant working with various customers in the Washington D.C. area. The systems that I have worked on include migration of Microsoft Access based systems to SQL Server 2005 conversion of applications from Microsoft Accessbased system to LAMP based PHP/MySQL back-end. Provide review and recommendations services for LAMP based web-site upgrades. I have also deployed the Zabbix network-monitoring tool to increase the reliability of one of the network.
Director of Data Warehousing
I led our Enterprise Data Warehouse project. The EDW was an Oracle based data warehouse that brought in data from Oracle, SQL Server and MySQL based systems. We used Business Objects Data Integrator and Pentaho Data Integrator for our ETL tools. The data warehouse,designed as a Data Vault architecture, used for consolidation of multiple system and key integration of our disparate systems. From the Data Vault, we began feeding traditional star schema based data marts for reporting via Business Objects. In addition to my duties managing the Data Warehouse infrastructure, I also participated in the review, and maintenance of our PL/SQL code to find opportunities for improvement to our Java based storefront. I managed multiple teams at Freshdirect these teams were:
- We supported 16 production and development database servers as well as a number of MSDN licensed SQL Server instances installed on local machines of developers and DBA's. These databases range from Clustered SAN based systems to stand-alone servers. We ensured that scheduled DTS packages, jobs and processes complete in a timely manner.
- Database Server infrastructure
- As new users were migrated into the Business Intelligence environment, we certified them in training, and then added them in Business Objects security. We also maintained backups of the Universe. We did installation and configuration of our Informatica services, as well as maintenance, upgrades, and troubleshooting of any problems the ETL developers ran into.
- BI and ETL infrastructure
- The Operational Data Store was the centralized repository for the consolidation of data from our diverse systems. We loaded the campaign data from the marketing department, and processed it such that it could be loaded onto both the dialer as well as the .Net application. At the end of the day extracts were done from the dialer, the Cache' system, and the .Net application for the production of consolidated reports. This consolidated picture of data is given to the various departments for analysis. These Key Performance Indicators KPI's were the critical data points for the entire organization. Producing and delivering the KPI's was my teams' primary responsibility.
- Our legacy application was built on the Cache' database and all of our reporting was done in MS SQL Server. As we were beginning to exceed the capabilities of our legacy telemarketing systems, we deployed a new internally developed .Net application.This new application interfaced directly to multiple AVAYA dialers based on location.
- Production Operational Data Store
- The External Pentaho Data Integrator team was an offshore development team responsible for development of the ETL code responsible for delivery to the External BI reporting team. Managing this offshore team consisted of setting goals and deadlines, code reviews, and managing time spent on the project.
- External ETL team
- The External BI reporting team was responsible for the development of a standalone Data Mart for reporting to the marketing department. I acted as a liaison to this group ensuring the technical goals of the marketing data mart weremet. This consisted of code-review, data validation, testing and review of reports, and ensuring that service level agreements were met.
- External BI reporting team
- Our Business Objects Data Integrator team was responsible for the development of our internal data warehouse. This team was responsible for the installation and configuration of the ETL software as well as the development of the ETL code to consolidate the different data sources into our Integration Sector for our internal Data Warehouse.
- Internal ETL team
- Our Business Objects deployment is for internal reporting of operational systems. The time demands for this team's time came from all departments I negotiated priorities with the various departments to ensure that the team was able to meet expectations.
- Internal BI reporting team
- Software Developer
- I worked as a Database administrator for a Sybase and Oracle based project. This was a web application that has to use Sybase's DCO product to integrate data from the Oracle database with the Sybase database maintained by our application. The front end is a Java Server Pages based application using BEA's WebLogic web server.
- I worked as a developer on an Information Assurance team where we maintain a lab environment for testing of Intrusion Detection Software. I wrote an IP stack emulator on Linux to fool the nmap network-mapping tool. I was responsible for designing and building a multi-tiered network-traffic generation application. I currently teach courses on Linux, Network Programming and TCL programming. In addition to these duties, I assist the lab administration staff as well as others with the maintenance of Linux platforms.
Software Developer
- I worked on a team to update a sales commissioning system. This is a C application running on a HP-UX 11 with Oracle 8i as the backend. The application creates commission data based on customer orders for sales agents. I also co-maintain our local Linux server.
- to Yellow Dog Linux running on an embedded Radstone PPC1A board. As part of this conversion I Worked on the port of DCE/RPC to the PowerPC platform, as well as the port of the application itself. This was a short-term proof of concept project. MITRE needed to prove that an existing VxWorks application could be ported over to LINUX in a timely fashion and we proved the concept.
- Responsibilities include participating in a project to port part of the dispatch application from Win32 to HP-UX11. This consists of porting Windows DLL's written with MFC to Unix Shared Libraries. Converted DLL's from MFC to ANSI C using STL. I also wrote a quarterly Payphone reporting system in PERL. I built and maintained a LINUX test environment where I have been testing the feasibility of a port of our legacy systems to LINUX.
Software Developer
- My responsibilities included developing and maintaining a Visual C application that used embedded SQL with ODBC to communicate to SQL Server 6.5, installation and configuration of the Oracle Test Database, and porting the code to use Oracle as a database in addition to SQL Server. Writing and distributing SQL scripts for maintenance of the database. I maintained our existing 16-bit and 32-bit code. Maintenance to the database and stored procedures, enhancements to our existing products, interfacing to new products or systems, and traveling to customer sites to troubleshoot application, database and network configuration problems.
Software Developer
- Led a team that maintained and supported a pseudo real-time DOS based C application deployed at 20 different field locations. This application communicated with specialized hardware to enable Fuel trucks to load petrochemical products onto the truck. I was in charge of redesigning this application into a more Real-time application.
Software Developer/QA Engineer
- Professional Services Consultant: I traveled to various customers' sites troubleshooting both Software AG Products, and non-Software AG products with many related problems. My area of expertise is Middleware, and database connectivity. Designed and wrote a Client/Server application for the Houston Police department using LU 6.2 connectivity to a back office ADABAS/Natural server program. I designed an Intranet application based on IXPRESS for the ConroeIndependentSchool District.
- Senior Quality Assurance Specialist Responsibilities included testing of Entire APPC Server A LU 6.2 based messaging product , maintenance of Novell LAN, maintenance of Windows NT Server, and assistance in testing of Entire NetWork. As a tester, I was responsible for developing test cases for Entire APPC Server with various partners. As a Novell LAN administrator, I was responsible for the maintenance of user definitions and troubleshooting various hardware and software problems that occurred with LAN.
Database Administrator
- I was responsible for the operations of a large ADABAS/Natural environment. My responsibilities included installation, conversion, tuning, and troubleshooting all databases including programs accessing the database. I provided coordination for large projects involving multiple groups. My Systems Programmer Responsibilities included providing technical assistance, troubleshooting, and maintenance of various proprietary products including running on the MVS/XA operating system.