Database Engineer, Etl Ssis Developer Resume
Atlanta, GeorgiA
SUMMARY:
- Senior SQL Server Database Engineer with 18 years of experience implementing Information Technology Solution in Data Warehouse, Business Intelligence, ETL with data mitigation, integration and consolidation expertise. Focus drive in analysis of data and data quality issues in Operational, Analytical, and Metric based reporting. Worked in both Agile, Waterfall, and Rapid Design environments, Export in Source to Target and Business Rule documentation. Work on several ETL and Data warehouse migration projects. In addition, providing large data Database Administration Duties and designing HA, RPO, RTO, Security solutions
- ETL 15+ years’ experience in Data Migration and Implementation with medium to large conversion projects: creating data flow diagram and source to target mapping documentation, extracting data from multiple data source.
- Report and analytics 18+ years’ experience as BI developer with custom report request, SSRS, Power BI, Excel and visualization with graphing and charting report and addressing data quality standardization, outlier discover, and basic statistic understanding.
- EDW 10+ years’ experience in refactoring and developing solutions: process modeling using Star Schema and defining attributes and measures, designing fact table with the following patterns Transaction, Snapshot, and Accumulated, and designing type 1,2,3 dimensions.
- OLTP 10+ years’ experience in relational modeling solutions in the Third normal form (3NF) designing and developing, from concept, the physical and logical models to support transaction processing system.
- T - SQL 18+ years’ experience in batch scripting, performance tuning, and optimizing, stored procedures, functions, triggers, views, indexes, constraints, file groups, partitions, tables, data types., Sequence objects, Temporal Tables, CDC
- DBA 18+ years in SQL Server EDW DBA with Production support medium to large installation, expert in scheduling SQL Agent jobs, migration, consolidation, upgrades, backup and restore, log shipping, mirroring, replication, performance tuning, Indexes, patch management, capacity planning, troubleshooting, server hardware and components, disk subsystems Raid Set, SAN LUN, Solid state.
TECHNICAL SKILLS:
Languages: T-SQL, VB.Net, C#, VB, VBA
Data Bases: SQL Server 2000, 2005, 2008 R2, 2012, 2014, 2016
ETL Tools: T-SQL bulk insert, DTS, SSIS
Reporting Tools: SSRS, Excel, Power BI, MDS
PROFESSIONAL EXPERIENCE:
Confidential, Atlanta, Georgia
Database Engineer, ETL SSIS Developer
Responsibilities:
- Wrote high level test plans and dataflow documents on how the QA team would test.
- Create t-sql scripts to execute against QA and production to compare results.
- Automated for QA test team using Excel pivot tables and charts to identify outliers in the data points.
Confidential, Atlanta, Georgia
Database Engineer, ETL SSIS Developer, DBA
Responsibilities:
- Documented SSIS ETL workflow in Visio and Created source to target mapping and defined business rules in Excel.
- Migrated existing ETL Process to automate the loading of the new Fact and Dimensions tables in EDW.
- Organized and upgraded 180 SSIS packages from version 2012 to 2016 and create 9 projects based on ETL batch processing subject area and used SQL Server Agent jobs to schedule and create an ETL workflow.
- Create a repeatable ETL test plan to automate loading and testing data load process and to discover data quality issues.
- Performance tuned stored procedures and T-SQL used in reports, adjustments to SSIS parameters, and Indexed tables.
Confidential, Atlanta, Georgia
Database Engineer, Data Warehouse Solution Architect, ETL TSQL Developer, DBA
Responsibilities:
- Analyzed current SQL Server 2016 EDW environment and made appropriate recommendations and system adjustment to address performance and recover point objective (RPO). Also providing Day to Day SQL DBA services.
- Refactored the current inventory fact, supporting dimension, and reports by interviewing users and understanding the measures that would be needed then using Excel pivot function prototyping possible reports.
- Created additional summary fact table to model measurement of inventory flow on how the company measures inventory turnover and on-time, in-full (OTIF)
- Used existing inventory models created in Excel to create new fact summary tables and new ETL process to automate the loading of data for reporting.
Confidential, Atlanta, Georgia
Database Engineer, Data Modeler, SSIS Developer, DBA, Solution Architect
Responsibilities:
- Created a Logical and Physical model for a 2 tier Web based application to manage a system of records for Work Request and Test event tracking in SQL Server 2016 and IIS 10.
- Used User Requirement documents to create Software Requirements Specification (SRS) to described system functionality.
- Create Schema, Tables and Column naming conventions and assigned appropriate datatype, null ability and default values and constraints.
- Implemented SQL 2016 CDC (Change Data Capture) and Instead of Triggers to track data changes and what user, what application, and what machine the request came from.
- Designed Test status tracking component using SQL 2016 Temporal Tables.
- Used SQL 2016 Sequence objects to manage a range of Primary Key assignments based on codes for Test records
- Constructed using SQL 2016 Table-Valued Parameters so the application would bind a set of values to a collection class (array) which bind to the grid control to pass a set of changes or a set of new records to a stored procedure.
- In addition, the Table-Valued Parameters passed into the stored procedure used T-SQL MERGE statement or the T-SQL EXCEPT statement to manage what records were removed, updated or added.
- Designed an application and database accessing security model by using schema, views, stored procedure and SQL Server roles to managed how records where accessed or modified.
- Designed a field display matrix concepts based on record type to help the Grid Control determine what fields to show, hide, set as read only and validate.
- Created a build process to manage weekly build cycle and Loading default data.
- Created Test cases to validate application functionality and to help with regression test.
- Designed SSRS report to print out Sign off documents per test phase and Power BI report for Metric reporting.
Confidential, Atlanta, Georgia
Database Engineer, SSIS Developer, Data Conversion Analyst
Responsibilities:
- Designed a Data Migration and Integration plan (ETL) to use SQL server 2016 and SSIS to manage the ETL process to pull data from Bond Adapt applicant tracking systems to confirm to Microsoft CRM input file formats.
- Worked with 3rd party vendor’s developers to create project plan and tasks and deliverables.
- Create a process to pull a set of Accounts by certain parameters and all the dependent sets of corresponding data such as, business contact, office, billing, and job location addresses, job orders, application (submittals), assignments, and recruits and all the recruits’ dependent attributes and documents (resumes).
- Reverse engineered the source of data from the Bond Adapt ATS forms by using SQL profiler traces and using excel to document the data path to CRM input file formats.
- Created MDM tables to manage attribute translations between systems.
- Performance tuned the ETL process by indexing staging and MDM tables, and creating pre-staging tables, and using query plans to find bottlenecks in the ETL T-SQL code.
- Mapped the Microsoft CRM input field to the Bond Adapt ATS field by using SQL profiler to see where and how data was being stored.
Confidential, Alpharetta, Georgia
Database Engineer, SSIS Developer, DBA
Responsibilities:
- Modified existing Data Migration and Integration process to support multiple time zones and locals to support EDW.
- Documented user requirements to Software Specification Requirements by using Word, Excel, and Visio.
- Fostered meeting with senior managers to define fact and dimension models and measures for the EDW.
- Mentored junior developers with understanding data semantics, T SQL Code, SSIS, and DBA tasks.
- Create a performance model to measure the performance of a cell phone insurance claim being filed to the time the claim is fulfilled by the warehouse and the device is sent to customer.
- Create a performance model to measure the performance of a cell phone insurance claim when a same unit repair involves repair vendors.
- Developed the T SQL code that would transform the transactional ODS data to a linear model of time sequences to measure the length of claim processing and repair cycles at various point.
- Created Excel workbooks to access SSAS cubes to layout the various models of the data using pivot tables, charts, and slicers.
- Installed SQL Server 2016 MDS application and configured models and entities and loaded data to support business requirements and created a custom DDL trigger to inforce and automatically assign roles security to views to access the data from the MDS/MDM database.
- Performance tuned complex T SQL ETL code for performance and ease of reading, used techniques such as CTE, temp tables, in memory tables, columnar store tables,
- Designed a SSIS and C# batch control system to import flat files without having to create a new SSIS package each time.
- Coded a T SQL table partition process to dynamically switch out data from tables.
- Managed 8 2014 and 2016 SQL Server DB with about .5 terabytes of data.
- Involved with SOX security audit and setup of role base groups in Dev, QA, UAT, and Production.
- Create SSRS and Power BI operational reports to measure internal insurance claims SLA to measure time to delivery.
- Monitored various production SSIS ETL loads and managed index.
Confidential, Duluth, Georgia
Database Engineer, Data Modeler, SSIS Developer, DBA, Solution Architect
Responsibilities:
- Engineered 3 Data Migration and Integration of retail POS data warehouse from concept to implementation.
- Mentored junior developers with design, coding practices, and SSIS development.
- Created customer dimension table to manage merging multiple customer accounts into one Account.
- Developed algorithm using T-SQL for exact pattern matching and SSIS fuzzy matching to find customer account that would roll up to one account.
- Automated with SSIS, address standardization, DPV, and CASS, geocoding, and profile mapping.
- Automated with SSIS NCOA (National Change of Address) process to send and receive address information.
- Implemented a reverse append process that would send method of payment credit card information to a 3rd party vendor that would send back a customer name and address for processing
- Used SSIS to automate file directory, FTP, SFTP, and FTPS file downloads and uploads.
- Collaborated with Data Analysis team to create Customer Segments by analyzing shopping patterns such as purchases, visits, tenure, and also creating Geographic Profiles buy analyzing loyalty and closest store.
- Created various operational reports about sales data and identify data quality issues.
- Maintained backups, security, index and T-SQL tuning, stored procedure and function coding.
Confidential, Norcross, Georgia
Database Engineer, SSIS Developer, Solution Architect
Responsibilities:
- Collaborated in a 4 person Data Migration and Integration team to document online webstore data warehouse from data source to fact and dimension tables.
- Used Excel to create mapping data flow documentation and used Visio to create data flows diagram.
- Worked with system Architects to understand and document business processes.
- Worked with senior partners to create project plans to assign task and resources.
Confidential, Georgia
Database Engineer, Data Modeler, Excel Programmer
Responsibilities:
- Used an existing Excel workbook application that managed the broadcast scheduling of programs, I facilitate scope and discovery with the client and gathering requirements that outlined the functional and non-functional requirement for a SQL Server 2008 R2 database and Excel VBA forms and reports application.
- Created a 10 table 3 normal form data model in SQL Server 2008 R2 and developed store procedures for the calling application and coded triggers for auditing.
- Developed Excel forms to enter and update the data; in addition, to developing Excel reports.
- Imported and mapped data from Excel worksheet into the tables using SSIS and T-SQL code.
Confidential, Atlanta, Georgia
Database Engineer, Data Modeler, SQL Server DBA, ETL Developer (SSIS), T-SQL Developer
Responsibilities:
- Provided SQL Server 2008 R2 DBA production and development support, troubleshooting poor server performance, optimizing stored procedure, functions, and adhoc T-SQL, index tuning, and creating new table and triggers.
- Data Migration and Integration 32 Hospital data sets into a Datamart for reporting and benchmark analytics.
- Assigned ownership of Healthcare Business Intelligence application for Cardiac Catheterization Lab (CCL) and Ortho Spine and Joint information management systems.
- Assigned the task to document, automate, and correcting reporting and benchmark anomalies in the manual quarterly data marts process.
- Create Individual or peer grouping of medical facility benchmark models of CCL procedures involve case documentation of supplies and medications used, as well as procedure and outcomes.
- Ex (Best in Class, National Averages, Volume Class Averages, by Quantity Used, Inventory Cost, Total Cost, Procedure Time, and Length of Stay (LOS); in addition to, grouping the data by procedure classes such as CRM, EP, Ablation, Stenting, Ballooning, Value replacement, by various vascular location or cardiac defect.
- Engineered a solution to automate the manual running of 17 T-SQL scripts and ETL of data from the ODS.
- Refactored the T-SQL code by organizing function and batch scripts using schemas, using tables to store runtime parameters, and using T-SQL reformatting tools to format code for easy of reading.
- Scripted main style store procedure to call all other procedures as a single batch.
- Used SQL Profiler to capture underperforming T-SQL code, then either added indexes and statistics or refactored the T-SQL code to improve performance.
- A star schemas type 1 model of cases was used to control sample size and data quality reporting.
- In addition, summary statistic, such as, central tendency, standard deviation, percentile, quartile, skewness, kurtosis, five-number summary where derived from the star schema model.
- Coded percentile, skewness, and kurtosis statistical equations in T-SQL.
- An Excel workbook that would query the tables for a set of data to display in Excel to be used in boxplot, histograms, and bell shape column charts, to help understand data distribution before and after outlier removals for Length of Stay, Total Cost, Total Time by clinical procedures.
- Created an Excel dashboard to display 400+ benchmark outcomes and transaction data used.
- Used Visio to create ER models and Data flow diagrams, and used excel to create mapping of parameters, tables, and columns used by benchmark.
- Create an Excel file format and data element capture protocols to load hospital patent billing information.
- Create 2008 R2 SSIS packages that used the new XML configuration file, used Script task, script component, Control Flow and Data Flow tasks to transform the data, and for data imports and exports to and from Excel and text.
- Import the data into tables, using rules to classify outliers, then used mathematical rules (Two-Sigma rule OR 99.9 percentile, to remove additional outliers.
- Design mapping tables to map department (cost centers), activity, and UB92 codes to standard transaction Identification.
- Create Staging table to preaggrate dataset by combining attributes such as MSDRG Codes, doctors, Day of Admit and Discharge, additional analysis by segment based on type of room and cost of room and board, Length of Stay, type of blood, insulin dependent, and age.
- Loaded Star schema Fact and Dimension tables with final results.
- Created and Excel workbook using VBA, ADO, and Excel 2012 automation to pull data out of fact tables and load worksheets link to either pivot tables or charts.
- Provided SQL Server 2008 R2 DBA production and development support, backups and restore, performance tuning, file migration, memory tuning, processor tuning,
- Data Migration and Integration of national banking institution Saving and Checking purchase to analysis shopping behavior
- Created 2008 R2 SSIS ETL Bus frame work, with the following components: Batch File Control system to load files and provided an audit trail of when and who processed the file, if the file completed processing and added metadata to the record to track what file the record came from or what file and record provided the change.
- Created a SSIS Batch Scheduling Control system to create data files by tracked the date range of records in the files and if the file was ever created.
- Created audit tables and triggers to capture and log changes to finical transactional data.
- Used T-SQL merge statement to captor updates and deletes of data changes and write what data changed to audit tables.
- Designed Active directory OU to manage role-based security.
- Optimized SSIS packages and SQL Server 2008 R2 to insert 1 Billion record files.
- Create star schema model to support both Type 1 and Type 2 record inserts and updates with a partition design both using federated tables and SQL Server partition indexes’
- Designed tables to file groups to SAN LUN mappings and sizing guides to support 1 TB size tables and 3 TB databases.
- Designed table partition by Month and year to map to file groups
- Created operational SSRS Reporting Service reports.
- Performance tuned data warehouse workloads by change locking, threading, and index strategies.
- Tested and bench marked NAND Flash SSD Storage Solutions: Violin Memory, Kaminario K2, and FusionIO with Data warehouse loads and as TempDB accelerators.
- Worked with system teams to benchmark vendors HBA hardware and EMC Clarion CX300 SAN by configuring various Raid types and LUN.