Lead Data Engineer Resume
SUMMARY:
IT Professional with over 20 years of experience in MSSQL RDBMS Architecture, Design, Development and Database Administration, as well as Application Development using a variety of languages. Additional Experience in Data Warehouse Design, Development DBA, and ETL using SSIS and Alteryx. Excellent understanding of business applications, and fully committed to 24/7 support of mission critical applications and databases during their full life cycle from development to production to sun setting. Team player with excellent communication skills and proven ability and desire to produce results, and contribute to the growth and success of organizations. Also happy to teach and mentor budding developers and like to help turn interns and fresh graduates into productive pillars of the company.
PROFESSIONAL EXPERIENCE:
Confidential
Lead Data Engineer
Responsibilities:
- Designed, implemented and maintained the new big data nation wide property database using PostgreSQL, Datagrip, Alteryx and Amazon Web Services (AWS). Implemented and separated new development environment from old production server.
- Designed and implemented reporting using Tableau using Tableau desktop hosted on tableau online.
- Maintained and extended other databases in PostreSQL and MSSQL on local Linux servers, as well as databases on Amazon Redshift.
- Trained and mentored new graduates teaching SQL and Reporting skills using Tableau and PostgreSQL as well as other office software as needed.
- Designed and built a multitude of ETL processes to support the business needs.
- Provided emergency troubleshooting on data imports as needed.
- Designed and implemented database backup strategy for the production servers.
Confidential
Sr. Database Administrator/ Data Architect
Responsibilities:
- Implemented, configured and maintained MSSQL Servers ( versions) using Amazon Web Services (AWS) windows Servers for multiple clients using Umbraco CMS and other Website solutions.
- Implemented, configured and maintained MongoDB servers on Linux and windows servers to be used on Sitecore CMS websites.
- Implemented, configured and maintained PostgreSQL servers on Linux for use as the database backend for several custom websites.
- Implemented, configured and maintained MySQL servers on Linux to serve as the database infrastructure for several client TV/video websites.
- Responsible for Backups, restorations and disaster planning for all databases (MSSQL, MySQL, PostgreSQL, MongoDB.
- Provided Ad - hoc reporting from various databases.
- Assisted programming team with SQL development.
- Tuned and optimized database performance for multiple high volume clients.
- Implemented Security on all databases to HIPAA standards as required for the client needs.
Confidential
Sr. Database Administrator
Responsibilities:
- Implemented, configured and maintained log shipping plans for production critical servers in a SQL 2008/2012 environment.
- Implemented regular maintenance plans to keep Development \ Stage environments in sync with the production environment.
- Created new indexes as needed to prevent recurring blocked processes from occurring on high traffic production servers.
- Implementation of SQL server best practices reduced the SQL job failure rate by 90%.
- Used Dell Spotlight and lite speed management products for system monitoring and backup and restore functions.
- Administrated security in a HIPAA environment that requires need to know data access.
- Provided rapid resolution of production problems created by user errors.
- Managed and implemented monthly server updates avoiding production downtime.
- Managed and produced reports in SSRS.
Confidential
Database Architect
Responsibilities:
- Responsible for backups and restores of databases using Red Gate SQL backup in a SQL 2008/2012 environment.
- Oversaw software Life Cycle promotions from Dev to UAT to Production using Red Gate SQL compare.
- Provided support and training for junior developers/DBAs, acting as top level support and troubleshooting resource.
- Managed replication of important tables in a 2008/2012 environment. This included both setting up mirror databases using snapshots and then implementing transactional replication to keep the subscriber databases in sync with the publisher database.
- Designed and implemented new Stored Procedures, Functions and Triggers as needed using Confidential -SQL.
- Provided and maintained security rules for SQL and active directory groups and users in a high security HIPAA environment.
Confidential
Sr. Database Administrator
Responsibilities:
- Responsible for performance monitoring, tuning and troubleshooting, backup and restore, as well as deployment of stored procedures and table changes made by developers, as well as other standard DBA tasks.
- Oversaw various upgrades and migrations of SQL Server 2000/ and 2012. Confidential the time most data bases are in SQL 2008 R2.
- Implemented high availability failover clustering, which successfully ran when production server failed.
- Implemented RAID environment for the protection of data in an always on environment.
- Held primary responsibility for ensuring daily ETL data loads from numerous vendors and clients into our data warehouse. Monitoring and troubleshooting of these systems was a 24/7/365 job. Data loading included multiple GB sized loads from vendors such as Google and Microsoft, and well and product listing files from clients in multiple formats using SSIS, SQL stored procedures using Confidential -SQL, and power shell scripts.
- Designed and implemented the feeds based import export system for online shopping engines. This involved developing ETL/ELT processes to import product data daily from hundreds of different clients in various formats, transforming them to our standard, and then exporting the product listings to dozens of different comparison shopping vendors with their own unique formats.
- Managed both linked servers and table replication on SQL and 2012 servers.
- Designed and implemented dimensional structure in the new data warehouse in order to normalize data storage.
- Managed AWS servers for data processing.
- Implemented capacity planning for or largest databases by maintaining efficiency and performance from our data warehouse as it grew from around 100 GB to the multi TB database it is today.
- Worked with business analysts and end users to develop client facing and internal reports.
- Converted Access based databases developed by users into robust SQL based databases.
- Managed processing on offsite virtual servers using Amazon Web Services, as well as virtual servers hosted Confidential our remote server location.
- Trained and managed offshore team in India responsible for insuring smooth operation of nightly data loads.
- Designed and implemented the FTP distributor system to allow provision of vendor files from various sources to other subcontractors, in a secure and timely way.
- Responsible for Data mining reports to client teams, on both an automated and ad hoc basis using Confidential -SQL and VB scripting in SSIS.
- Used Microstrategies for creating client dashboards and reports.
- Provided and maintained security rules for SQL and active directory groups and users.
- Trained, helped and supervised development of younger employees.
- Used Visual Studio 2013 as needed to produce executables used in SSIS packages.
- Performed and or generated set based processing scripting as needed to increase data transformation performance.
- Wrote numerous VBA macros to assist client services employees with their daily work.
- Helped oversee two different data center moves, both successfully avoided having negative impacts on our users.
- Experience with troubleshooting Windows servers 2000/2003/2008/2012.
Confidential
Database Administrator/ Analyst
Responsibilities:
- Designed, developed and maintained databases and Confidential -SQL stored procedures, and documentation for corporate data warehousing using SQL 2000 for the Order Management and Activation department for the Confidential & Confidential U-verse product.
- Created and maintained backup, tuning, and indexing strategies to increase the performance and reliability of the U-verse reporting database.
- Developed and maintained automated schedule plan to report daily installation work load Confidential the manager and executive level.
- Planed and created web based reporting using PHP and MySQL.
- Provided ad-hoc SQL reports on an as needed basis for managers, area managers, and executives.
- Produced and maintained a SQL data driven application to assist in implementing automated outbound calls intended to ensure customer compliance with FCC regulations. This project uses ETL techniques to extract customer data from very large 200+ GB data bases and load into smaller project oriented DBs.
Confidential
Database Administrator
Responsibilities:
- Designed and maintained databases, DTS packages, SQL stored procedures, triggers, crystal reports and documentation for corporate data warehousing using SQL 2000 and SQL 2005.
- Converted Old SQL 2000 DTS packages to SQL 2005 SSIS packages, and developed new SSIS packages.
- Planed databases, DTS packages, and SQL stored procedures for data integration between legacy retail point of sale (POS) database and new SQL 2005 based POS database.
- Developed and maintained clustering, log shipping, backup, tuning, and indexing strategies to increase the safety and performance of the various corporate databases.
- Produced and maintained integration packages to keep our local and hosted web databases synchronized
- Provided data services for executive, marketing, operations, and accounting departments on both a regular scheduled basis, and on an ad hoc basis.
- Provided and maintained security rules for SQL and active directory groups and users.
Confidential
Business Consultant
Responsibilities:
- Developed database administration skills while producing and supporting applications to support automated enrollment and payment reconciliation Confidential a nationwide health insurance company.
- Made an immediate impact within a week of starting by developing an application that allowed the reconciliation of 200,000 person-months of coverage that had fallen into arrears.
- Planed and produced the MS SQL version of the Group Auto Enrollment system GAE that Confidential uses to process the insurance eligibility transactions for client groups.
- This involved creating a new MS SQL database with the tables, views, stored procedures, triggers, DTS packages to facilitate ETL, and security roles necessary to implement the new database.
- Developed a number of reports for the users on an MS Access front end.
- Designed several applications designed to automate daily administration routines previously; there was a daily routine to generate, download and apply the updates from the mainframe system to the local Recon and GAE systems.
- Someone had to come in early every day and spend around an hour doing the updates, but the process was prone to human error.
- Along with team, developed automated routines to update our local databases. Also developed an automated FTP process for our evening upload to the mainframe DB2 database.
- The Business Application Support team Confidential did not have any version control software for any of the applications that we developed and supported when I joined.
- Helped implement an OSS installation of Subversion on an old server which allowed us to have version control available Confidential a very low cost to the company.
- This also allowed for greater productivity, since it allowed multiple programmers to work on an application Confidential once.
Confidential
Programmer / Analyst
Responsibilities:
- Developed, supported and made additions to systems that provide financial production, servicing, and collections functions.
- Supported and developed additions to the IMAX system, an intranet system of ASP web pages, using SQL to connect to various databases.
- Created Collection and Service letters module for creating letters to be sent to customers as needed.
- Created a Paid in Full module for automating the creation of PIF forms, which are required by the various states.
- These two modules both required the extraction of data from a MS SQL database to provide the necessary date to fill in the mail merge letters.
- Developed additions to the Imax Brain, the Visual Basic program that reads a customer’s credit report from a SQL database and makes the decision to approve or decline a loan or refer the loan to a loan analyst.
- Lead development of a Data Warehouse for the end of month financial activity reporting.
- Used a Visual basic program to extract the necessary data from multiple Sybase SQL tables and insert the data into a monthly data warehouse.
- The data warehouse was then used to provide data for various reports.
- Developed the reports using Crystal Reports fed by SQL stored procedures.
- Supported and developed a New Loan Setup system. This is a program written in Perl that creates a data file that automates the movement of data from a Loan Origination system and a Loan Servicing system.
- This program runs on our Linux server; also provided administration to this server.
- All applications were maintained through Visual Source Safe and managed with Microsoft Project.
Confidential
Information Associate
Responsibilities:
- Performed both programming and administrative duties.
- Developed and executed various web-based solutions to problems within the assembly plant. Developed a web-based interface for the Windows NT paging system that allowed plant floor users to send text pages to anyone in the database using their PCs.
- This involved developing ASP scripts to interface with the paging software, and producing HTML pages dynamically using SQL that would list the various people and groups that are available for paging.
- Developed a tracking database that allowed users to change and delete records for parts orders in the body shop and paint shop.
- Developed this on an AIX/Apache server using Perl scripts and DBMedit.
- Administered and supported various production systems Confidential the GM plant in Arlington. These systems included the Strategic Front End (SFE), a set of pass-through servers that provided communications between the plant floor systems and the local mainframe.
- The SFE used the AIX UNIX operating system, and utilized high availability cluster management.
- Managed the Flexible Scheduling System (FLEX), which contained the database of vehicle build data.
- Ran searches on the database in order to find vehicles that matched the requirements of the production management.
- In addition to managing these systems and others, assisted other team members in the administration of their systems as needed.
- Met with plant managers each evening as the lead customer contact during the night shift, and took on the duty of providing PC support and user education.
- Installed and configured hardware and software for several new systems during the construction of a new body shop
