We provide IT Staff Augmentation Services!

Sr. Data Engineer Resume

5.00/5 (Submit Your Rating)

Jacksonville, FL

SUMMARY

  • 8+ years of experience as a SQL Server Developer 2012/2014/2016/2017/2019
  • 2yrs experience in Snowflake Datawarehouse development and maintenance
  • Strong experience in using Data modeling for designing logical and physical data models.
  • Experienced in database programming in writing T - SQL Stored procedures, Triggers, Constraints (Primary Key, Foreign Key, and Unique) Indexes and Batch Scripts using various Data Definition Language (DDL) and Data Manipulation Language (DML) commands.
  • Experienced in OLTP and OLAP database modeling, design, and development
  • Experienced in teh use of XML, JSON, and TSQL including TSQL XML datatype methods and TSQL JSON manipulation methods
  • Excellently skilled in TSQL, SSIS and SSRS
  • Strong Debugging skills
  • Experienced in Azure DB development, Azure data lake, and Azure Data Factory ETL
  • Experienced in C#, Java, Python, and JavaScript
  • Experienced in Agile/Scrum SDLC Environment
  • Experienced in Advanced SQL Performance Tuning and Query Optimization
  • Excellent verbal and written communication wif interpersonal and strong analytical skills.

PROFESSIONAL EXPERIENCE

Confidential, JacksonVille, FL

Sr. Data Engineer

Responsibilities:

  • Created Snowflake SQL stored procedure and UDFs using both JavaScript and SQL
  • Wrote dynamic SQL in Snowflake using LISTAGG function
  • Developed and maintained SQL Server Stored Procedures
  • Integrated Snowflake wif SQL Server using Azure Data Factory
  • Developed ADF ETL pipelines as part of Snowflake and SQL Server integration
  • Used Azure ARM template to deploy ADF pipelines across environments
  • Used ADF azure function activity to execute a C# program I developed as part of ETL
  • Created and monitored Snowflake tasks
  • Wrote complex SQL queries using window functions, CTEs, set operators among others
  • Used various Snowflake JavaScript APIs such as getRowCount, getColumnValue, createStatement among others
  • Developed SSIS packages to perform scheduled operations
  • Worked in Agile environment wif JIRA, Pivotal, and Service-Now ticketing tools

Confidential, Bay Area, CA

Sr. Data Engineer

Responsibilities:

  • Created and managed Snowflake SQL stored procedure and UDFs using both JavaScript and SQL
  • Developed and maintained SQL Server Stored Procedures
  • Wrote complex SQL queries using window functions, CTEs, set operators among others
  • Performed data analysis to fix exceptions, improved SQL Query performance, and maintained data integrity
  • Used SQL NTILE window function and Python Multithreading to enhance teh speed and performance of running tasks and programs
  • Created and maintained Python scripts for routine data operations and administrative tasks
  • Created monitoring reports wif connection to Snowflake from Python
  • Used Python pip install to install and maintain python modules like snowflake-connector-python used to connect to Snowflake
  • Executed commands in Linux shell terminal
  • Scheduled tasks dat run indefinitely using Linux nohup command and python schedule module
  • Used WinsSCP SFTP to upload and download files from Linux server
  • Used PUTTY to configure and connect to Linux Ubuntu shell terminal
  • Used Python pandas module wif SQL for in-depth data analysis
  • Worked in Agile environment wif JIRA tool

Confidential, Nashville TN

MS SQL Server Database/BI Developer

Responsibilities:

  • Created SSIS ETL packages to implement CDC between OLTP DB and OLAP data mart
  • Used different SSIS Adapters like OLEDB, ODBC, ADO.NET
  • Wrote complex SQL queries wif CTES and Window functions to implement complex business logic
  • Used SSIS script component as a source wif output buffers to add data to teh data pipeline
  • Programmatically created excel documents in SSIS script task using C#.NET microsoft.interop.office.excel.dll assembly
  • Created Azure external tables and data sources like Azure blob
  • Developed SSIS Packages to implement complex ETL/ELT requirements
  • Used both SSIS script task and script component wif C#.NET to deliver complex and advanced ETL solution
  • Created advanced SSIS package wif C#.NET to implement complex business logic
  • Converted .xls and .xlsx excel documents to csv files using C#.NET’s excel interop in SSIS
  • Implemented both ETL (Schema on-write) and ELT (Schema on-read) solutions
  • Used both SSIS script task and script component wif C#.NET to implement and deliver complex ETL and ELT solutions

Confidential, Nashville TN

MS SQL Server Database/BI Developer

Responsibilities:

  • Created and loaded data into Azure cloud database
  • Used advanced SQL including dynamic SQL, CTES, and Window functions in SPs
  • Used SSIS Adapters like flat file connection, excel source/destination
  • Developed SSIS Packages to implement complex ETL/ELT requirements
  • Integrated Azure wif SSIS ETL solution
  • Created parameterized data pipelines and linked services in ADF (Azure Data Factory)
  • Enhanced performance of data factory pipeline using parallel processing
  • Created HTTP trigger azure app function using C# and VS and consumed it in data factory using app function activity
  • Consumed and produced different types of files in SSIS wif C# in script task and script component
  • Used copy data activity in ADF as part of Azure BI/ETL/ELT solution in cloud
  • Deployed projects to SSISDB catalog and scheduled SQL Server agent jobs
  • Scheduled SSIS ETL packages and TSQL Script execution using SQL Server Agent Jobs
  • Wrote T-SQL stored procedures to be used by SSIS execute SQL control flow task
  • Used TSQL Transaction isolation levels to control race condition
  • Used SQL Server 2017’s “FOR JSON” and “OPENJSON” commands to store and retrieve database records in JSON objects
  • Designed, reviewed, and created primary database objects like views, indexes, tables, stored procedures and functions.
  • Created data warehouse using Kimball methodology
  • Modeled database using Erwin
  • Peer-reviewed SQL codes using Git source control pull requests
  • Wrote complex TSQL queries using CTEs, SET Functions, and dynamic SQL
  • Used aggregate and analytic functions in TSQL
  • Tuned Stored Procedures for performance
  • Reduced slow-running stored procedures from over 8 seconds to under a few milliseconds
  • Implemented data cleansing and scrubbing using SSIS ETL and TSQL

Confidential, San Jose, CA

Sr. SQL Server Database/BI Developer

Responsibilities:

  • Created SQL Agent jobs to schedule SSIS packages and database backups and restoration
  • Designed, developed and maintained replication for over one hundred and fifty databases across multiple servers
  • Developed Stored Procedure dat takes Database name, Subscriber, Publisher server names and some other input parameters and creates publication for teh database, adds articles to teh publication, adds subscription to teh publication, and starts teh snapshot agent
  • Created an SSIS project dat adds publications, articles and subscriptions to over one hundred and fifty databases using parallel processing and theirfore completing in just about 14 minutes
  • Created a TSQL script dat generates table and User-Defined-Table type definition including indexes, constraints and computed columns from Publisher server and executes in Subscriber server to recreate them as part of replication
  • Documented my replication deliveries wif user manual
  • Developed and documented SQL best practices for other junior and less-skilled developers
  • Peer-reviewed team members codes using Git source control pull requests
  • Used SSIS Adapters like flat file connection and OLEDB
  • Index creation including clustered, non-clustered and full text indexes
  • SSIS and SQL server error and log shipping using txt, xml, windows event log and SQL server table logs
  • Tuned stored procedures and TSQL queries for performance issues.
  • Used SQL Profiler to identify SP calls and TSQL queries dat has performance issues
  • Reduced execution time of certain SPs from about 5minutes to less TEMPthan a second
  • Backed up and restored Databases
  • Modeled OLTP database using Erwin
  • Used SSIS ETL packages to load data to newly created OLAP data warehouse
  • Created CLR functions using C#.Net and T-SQL
  • Used common table expressions (CTE) where possible instead of temp tables to improve TSQL performance
  • Used TSQL Set functions for a deeper data analysis and advanced stored procedure and ad-hoc query development
  • Used both TSQL Merge and SSIS conditional split data flow transformation to capture and load changed data to OLTP databases and OLAP data warehouse
  • Wrote email validation TSQL script as part of ETL data loading to data warehouse
  • Converted existing TSQL ad-hoc queries and stored procedures from row-by-row based query execution to set-based query execution which improved their performance by over 50%
  • Wrote advanced TSQL query dat takes date ranges and count business days while excluding weekends and holidays
  • Created Linked Servers among Subscriber, Distributor and Publisher servers as part of prerequisite for replication
  • Used TSQL OpenQuery to execute a query in Subscriber DB from Publisher DB as part of replication setup
  • Used dynamic SQL to programmatically retrieve articles from a table and add them to a transactional publication as part of database replication setup
  • Creating and deploying SSIS Packages using both project and package deployment models of SSDT 2012
  • Created environment variables and references and mapped them to project parameters in SSISDB catalog after deploying SSIS projects using project deployment model
  • Communicating wif business users to understand complex business problems and providing technical solutions to those problems
  • Migrated data from heterogeneous data sources like text files, Flat files, MS-Access, Excel, OLE DB, XML files, SQL server to SQL Server 2014 using SQL Server Integration services (SSIS).
  • Used data viewer in SSIS to trace data manually
  • Used both constraints and success values of SSIS precedence constraint

Confidential, San Francisco, CA

SQL Server Developer

Responsibilities:

  • Wrote stored procedures and TSQL queries to implement complex business logics.
  • Loaded data to Salesforce cloud database
  • Created different database objects like tables, views, functions, triggers, rules and UDTs.
  • Optimized database objects for performance
  • Reviewed and deployed developers’ codes into Apache Subversion source control and other environments using Red Gate SQL Developer Bundle
  • Created ETL solutions using SSIS and TSQL
  • Used TSQL Transaction isolation levels to control race condition and improve performance
  • Used TSQL query hints to change default behavior of SQL Server query optimizer
  • Scheduled deployed SSIS packages for execution using SQL Server Agent service
  • Unit-Tested deployed SSIS packages
  • Created SSRS reports such as matrix reports
  • Migrated data from heterogeneous data sources like text files, Flat files, MS-Access, Excel, OLE DB, XML files, SQL server to SQL Server 2008 R2 using SQL Server Integration services (SSIS).
  • Used package configuration to migrate data from development server to teh production server.
  • Created SSIS packages to extract data from OLTP to OLAP systems and scheduled jobs to call teh packages and stored procedures.

We'd love your feedback!