We provide IT Staff Augmentation Services!

Sr. Data Engineer Resume

SUMMARY:

  • Over 13+ years of IT Professional experience in Development, Client Analysis, Database Design, and Presentation using SQL Server 2014, 2012, 2008R2/2008, AWS, Redshift, Snowflake, Matillion .
  • Marine Corps veteran with over 7 years of service, experience included Access databases design, Excel, artillery chief(leadership), achieved the rank of E - 5.
  • Familiar with Hadoop HDFS, Java, Python data science libraries, and Azure factory.
  • Full System Development Life Cycle (SDLC) experience including Requirement Gathering, Analysis, Design, Development, Testing, and Implementation of various medium and large scale client/server applications in a structured development environment.
  • Extensive experience in Database Design and the development of Business Intelligence applications using SQL Server 2014, 2012, 2008/2005/2000 (T-SQL), Integration Services (SSIS), Data Transformation Services (DTS), and Reporting Services (SSRS).
  • Excellent T-SQL development skills, including the ability to write queries involving multiple tables. Strong ability to develop and maintain complex Stored Procedures, User Defined Functions, and other SQL Objects.
  • Strong experience in designing and developing large number of reports in SSRS using the data from ETL Loads
  • Extensive experience in developing Drill through and Drill down reports, parameterized reports, Linked reports, Subreports, Matrix reports, and Chart reports using MS SQL Server Reporting Services (SSRS)
  • Extensive experience in rendering reports, managing subscriptions, creating reports with report builder, report snapshot and report cache.
  • Experience in handling Database Consistency Checks using DBCC Utilities, and in using Distributed Queries using Linked Servers.
  • Extensive knowledge in database maintenance, SQL query optimization & performance tuning using performance tools like SQL Profiler, Index Tuning Wizard, and Database Engine Tuning Advisor.
  • Scheduled reports for Daily, Weekly, Monthly reports on sales and marketing information for various categories and regions based on business needs using SQL Server Reporting Services (SSRS).
  • Proficient in design of ETL and SSIS Packages for integrating data using OLE DB connection from heterogeneous sources (Excel, CSV, flat file, Text, XML, Access, Oracle, DB2, SQL) by using multiple transformations provided by SSIS such as Aggregate, Data Conversion, Conditional Split, Bulk Insert, Fuzzy Grouping, Fuzzy Lookup, Merge, Script task, and execution task using PowerShell scripts.
  • Proficient in designing OLAP (Online Analytical Processing), OLTP (Online Transaction Processing) systems.
  • Involved in daily loads (full & incremental) into staging and ODS areas, troubleshooting process, issues and errors using SQL Server Integration Services (SSIS) 2010.
  • Applied various data transformations like SCD (Slowly Changing Dimension) to maintain the history of the data, aggregate, multicasting, conditional split and derived column.
  • Extensive testing on the performance of the stored procedures.

TECHNICAL SKILLS:

Databases: SQL Server 2005/2008/2008 R2/2012, 2014, 2016 MS Access. SnowFlake

Programming Languages: T-SQL, C#, PowerShell, BIML, Python,Java, U-SQL, SnowSQL

Operating Systems: Windows 10, 8/2000/2003/XP/NT/Vista,/7, Windows 2000, Windows 2003 Enterprise Server

BI Tools: SQL Server BI Development Studio (BIDS), SharePoint, MS Visual Studio 2019,2017,2015, 2012, 2010, 2008

Version Control: Team Foundation Server (TFS), Visual SourceSafe (VSS), CollabNet

ETL Tools: SSIS, DTS, Matillion

Data modeling Tools: MS Visio 2003/2007/2010

Packages: Microsoft Office 2010/2007/2003

PROFESSIONAL EXPERIENCE:

Confidential

Sr. Data Engineer

Responsibilities:

  • Provide production support for existing products that include SSIS, SQL Server, stored Procedures, interim data marts, Matillion, AWS, Snowflake.
  • Lead and develop sustainable data driven solutions with current new gen data technologies to meet the needs of our organization and business customers - Master new technologies rapidly as needed to progress varied initiatives
  • Troubleshooted, and implemented complex ETL processes for CRM and financial data.
  • Designed, troubleshooted, and implemented Stored procedures, database objects, scalar functions, and views.
  • Created Powershell process to upload files to Sharepoint.
  • Troubleshoot and maintain ETL/ELT jobs running using Matillion.
  • Write reusable, testable, and efficient code in Python.
  • Worked with Agile Scrum methodology and Jira.
  • Worked with local and remote team members, scrum managers, architects, and directors.
  • Collaborated and assisted in building Power BI dashboards.

Confidential

SQL Developer

Responsibilities:

  • Provided solutions using the Microsoft stack business intelligence tools such as SSIS/T-SQL/SQL Server 2014 along with coaching new team members, code reviewing, and production support.
  • Designed, troubleshooted, and implemented complex ETL processes for various Electronic Medical Records.
  • Designed, troubleshooted, and implemented Stored procedures, database objects, scalar functions, and views.
  • Worked on performance tuning on tables with over a billion rows using temp tables, indexes, and execution plans.
  • Worked with various business customers on delivering ETL solutions from start to finish.
  • Took over a data warehouse project from a consulting firm and was responsible for completing and fixing the current challenges and was responsible to get project production ready.
  • Worked with Agile Scrum methodology and Team Foundation Server 2012.
  • Worked with local and remote team members, scrum managers, architects, and directors.
  • Attended training for Azure, U-SQL, Data Lake, and basic Machine Learning.
  • Used SSIS Lookup, merge, derived column, Fuzzy group transformations and Data flow tasks. Scheduled the SSIS package services to run at different intervals to fetch the data and transferring the data various destination.
  • Helped implement data governance procedures that comply with HIPAA.
  • Create complex SSRS reports as part of financial reporting.

Confidential

SQL Server/SSIS /ETL/ Developer

Responsibilities:

  • Created and maintained different database objects (tables, stored procedures, and views).
  • Gathered ETL requirements by department leaders, including company CTO.
  • Optimized the performance of queries with modification and testing different options in T-SQL queries, normalized tables, established joins, and created indexes.
  • Created and gathered requirements for SSRS reports and SpotFire reports.
  • Experienced in working with many complex SQL queries using joins and date functions to generate various reports.
  • Involved in generating and maintaining SQL scripts.
  • Created and documented the mapping of the database objects from source to target database.
  • Created SQL server configurations for the SSIS packages.
  • Created PowerShell scripts to be executed by SSIS solutions.
  • Created Complex Stored Procedures, Functions, Tables, Views and other T-SQL code and SQL joins to ensure efficient data retrieval.
  • Created SQL Agent Jobs for scheduling SSIS Packages.
  • Configured and fine-tuned ETL (Extract, Transform, and Load) workflows.
  • Created SSIS script task with C# code for obtaining parameters from the applications.
  • Created SSIS package to automate the process when files are dropped off by different business units and getting parameters from a SQL table by creating C# Scripts, PowerShell scripts to move files, unzip files.
  • Created SSIS Templates for developing SSIS Packages that can be dynamically deployed into Development, Testing and Production Environments.
  • Designed and developed a data warehouse, data marts and business intelligence using multi-dimensional models - star schema and snowflake schema.
  • Designed and developed SSIS Packages to import and export data from MS Excel, SQL Server 2012 and Flat files.
  • Created Entity Relationship (ER) diagrams based on requirements.
  • Expert in SSIS Lookup, merge, derived column, Fuzzy group transformations and Data flow tasks. Scheduled the SSIS package services to run at different intervals to fetch the data for transferring data into another database.
  • Worked with large data sets over 3 TB’s.
  • Migrated SSIS solutions from SQL Server 2008R2 to SQL Server 2014

Environment: SQL Server 2012 (SSMS), SQL Server 2014, SQL Server Business Intelligence Development Studio 2008 (BIDS), C# Scripting, MS Excel 2012.

Confidential

SQL Server/SSIS/SSRS/ETL/SSAS Developer

Responsibilities:

  • Created and maintained different database objects (tables, stored procedures, and views).
  • Optimized the performance of queries with modification and testing different options in T-SQL queries, normalized tables, established joins, and created indexes.
  • Experienced in working with many complex SQL queries using joins and date functions to generate various reports.
  • Involved in generating and maintaining SQL scripts.
  • Created complex stored procedures for complex reports developed using SSRS 2010
  • Developed various types of complex reports like Drill Down, Drill Through, and Sub-Reports
  • Developed drilldown, drill through, parameterized, and Ad hoc reports and charts using SSRS.
  • Advanced extensible reporting skills using SQL Server 2010 Reporting Services (SSRS). Created many complex stored procedures/functions and used them in SSRS directly to generate ad-hoc reports.
  • Studied the current transactional database in order to understand the existing system and created the approach documents for the migration task.
  • Created and documented the mapping of the database objects from source to target database.
  • Maintained Source Control by using CollabNet for Windows.
  • Created SQL server configurations for the SSIS packages.
  • Created PowerShell scripts to be executed during SSIS packages.
  • Created Complex Stored Procedures, Slow Changing Dimension Type 2, Triggers, Functions, Tables, Views and other T SQL code and SQL joins to ensure efficient data retrieval.
  • Created SQL Agent Jobs for scheduling SSIS Packages.
  • Configured and fine-tuned all the ETL (Extract, Transform, and Load) workflows.
  • Created SSIS script task with C# code for obtaining parameters from the applications.
  • Created SSIS package to automate the process when files are dropped off by different business units and getting parameters from a SQL table by creating C# Scripts, PowerShell scripts, keeping records of all files processed, changing encoding, and renaming files, zip folders, and archiving.
  • Designed and deployed reports with Drill Down, Drill Through and Drop down menu option and Parameterized and Linked reports.
  • Created SSIS Templates for developing SSIS Packages that can be dynamically deployed into Development, Testing and Production Environments.
  • Designed and developed data warehouse, data marts and business intelligence using multi-dimensional models - star schema and snowflake schema.
  • Designed and developed SSIS Packages to import and export data from MS Excel, SQL Server 2012 and Flat files.
  • Created Entity Relationship (ER) diagrams based on requirements.
  • Expert in SSIS Look up, merge, derived column, Fuzzy group transformations and Data flow tasks. Scheduled the SSIS package services to run at different intervals to fetch the data and for transferring the data into other database.
  • Designed Dimensional Modeling using SSAS packages for End-User. Created Hierarchies in Dimensional Modeling.
  • Responsible for troubleshooting cube processing.

Environment: SQL Server 2008 (SSMS), SQL Server 2012, SQL Server Business Intelligent Development Studio 2008 (BIDS), C# Scripting, Team Foundation Server 2008, MS Excel 2010.

Confidential

SQL Server/SSIS/SSRS/ETL Developer

Responsibilities:

  • Created and maintained database objects (tables, stored procedures, and views).
  • Optimized the performance of queries with modification in T-SQL queries, normalized tables, established joins, and created indexes.
  • Experienced in working with many complex SQL queries using joins and date functions to generate various reports.
  • Involved in generating and maintaining SQL scripts.
  • Created complex stored procedures for complex reports developed using SSRS 2008
  • Developed various types of complex reports like Drill Down, Drill Through, Gauges, Pie Chart, Bar Chart, Sub-Reports
  • Developed drilldown, drill through, parameterized, and Ad hoc reports and charts using SSRS.
  • Advanced extensible reporting skills using SQL Server 2008 Reporting Services (SSRS). Created many complex stored procedures/functions and used them in SSRS directly to generate ad-hoc reports.
  • Studied the current transactional database in order to understand the existing system and created the approach documents for the migration task.
  • Created and documented the mapping of the database objects from source to target database.
  • Migrated data from MS SQL Server 2005 to MS SQL Server 2008 using OLE DB connection by creating various SSIS packages.
  • Created SQL server configurations for the SSIS packages.
  • Filtered bad data from legacy system using Derived column, Lookups, Fuzzy Lookups, Conditional split.
  • Create store procedure specifically for cleansing data and used the same in SSIS Execute SQL Task.
  • Created Complex Stored Procedures, Triggers, Functions, Tables, Views and other T SQL code and SQL joins to ensure efficient data retrieval.
  • Created SQL Agent Jobs for scheduling SSIS Packages, SSRS reports and alerts.
  • Configured and fine-tuned all the ETL (Extract, Transform, and Load) workflows.
  • Created SSIS script task with vb.net code for obtaining parameters from the applications.
  • Created SSIS package to automate maintenance, database back up, update statistics, re-build indexes as well as create error log for event during data load.
  • Responsible for generating sales ranking reports using the migrated data.
  • Designed and deployed reports with Drill Down, Drill Through and Drop down menu option and Parameterized and Linked reports.
  • Identified and worked with parameters for creating cascading parameterized reports in SSRS 2008.
  • Created SSIS Templates for developing SSIS Packages that can be dynamically deployed into Development, Testing and Production Environments.
  • Experienced in critical problem solving, building tools to integrate and manage large sets of data.
  • Processed and generated manual reports for the end business users on a daily, weekly, and monthly basis.
  • Designed and created Report templates, bar graphs and pie charts based on the financial data.
  • Designed and developed data warehouse, data marts and business intelligence using multi-dimensional models - star schema and snowflake schema.
  • Designed and developed SSIS Packages to import and export data from MS Excel, SQL Server 2005 and Flat files.
  • Created Entity Relationship (ER) diagrams based on requirements.
  • Created SSIS Packages to migrate the data from database to Text files and developed SSIS packages for File Transfer from one location to the other using FTP task.
  • Expert in SSIS Look up, merge, derived column, Fuzzy group transformations and Data flow tasks. Scheduled the SSIS package services to run at different intervals to fetch the data and for transferring the data into other database.

Environment: SQL Server 2008 (SSMS), SQL Server 2012, SQL Server Business Intelligent Development Studio 2008 (BIDS), C# Scripting, Team Foundation Server 2008, MS Excel 2010.

Confidential

SQL Server/SSIS/SSRS/ETL Developer

Responsibilities:

  • Prepared and developed monthly sales management report from different investments companies and different format by using Access (data design, complex Join), advance lookup features of Excel, Macros, pivot tables for Sales Canada Group
  • Involved in installing and maintaining MS SQL Server 2005/2008.
  • Migrated DTS packages from SQL Server 2000 to SQL Server 2008 as SSIS packages.
  • Created efficient, robust SSIS packages for data movement and loading with error checking and well documented code.
  • Created SSIS packages to integrate data coming from text files and excel files.
  • Migrated old data from MS Access into SQL Server 2008 using SSIS packages in business intelligence development studio.
  • Created SSIS packages (.dtsx files) to validate, extract, transform and load data to data warehouse databases.
  • Extensively worked with SSIS tool suite, designed and created mappings using various SSIS transformations like OLEDB command, conditional split, lookup, aggregator, multicast and derived column.
  • Wrote stored procedures and User Defined scalar Functions (UDFs) to be used in the SSIS packages and SQL scripts.
  • Deployed SSIS package into production and used package configuration to export various package properties to make package environment independent.
  • Implemented event handlers and error handling in SSIS packages and notified process results to various user communities.
  • Data management and data processing solutions using SSIS, this includes error handling and slowly changing dimensions.
  • Maintained oversight of version control of documents within the SharePoint repository.
  • Created database maintenance plans for backup strategies and involved in database partitioning.
  • Optimized the performance of queries with modifications in T-SQL queries, removed unnecessary columns, and eliminated redundant and inconsistent data.
  • Created numerous efficient stored procedures to perform data cleansing and loading task when data is loaded into staging area.
  • Analyzed and tuned complex Queries/Stored Procedures in SQL Server 2008 for faster execution and developed database structures.
  • Mentored team members to optimizing SQL queries.
  • Responsible for development of complex reports by using SSRS. Developed various Cross Tab Reports, Drill down, Sub Reports, and Parameter Reports Developed heavy formatted, complex formula reports; reports with advanced features like conditional formatting, and multiple grouping reports.
  • Used SQL Server Reporting Services SSRS for developing various reports
  • Created views to facilitate easy user interface implementation and triggers on them to facilitate consistent data entry into the database.
  • Cleaned raw data and consolidated information of each territory using advanced formulas of Excel
  • Extracted monthly marketing data from various sources (flat files, spreadsheets, etc.) for corporate database using Access, VBA Macros and advanced formulas of Excel
  • Prepared operational document for sales management report procedure using Visio professional
  • Prepared monthly Focus Firm report using crystal report and MS SQL Server

Environment: Microsoft SQL Server 2000/2005/2008 R2 Enterprise edition, SSIS, SSRS, BIDS, Microsoft Visual studio, Windows server 2003, Microsoft Office SharePoint Server 2007, Internet Information Server (IIS), MS Excel 2007, MS- Access, Windows 2003 server

Confidential

SQL Server/SSIS/SSRS/ETL Developer

Responsibilities:

  • Responsible for enhancements, maintenance, and monitoring of the data warehouse on SQL Server and the daily ETL Process.
  • Formulated and documented the physical ETL process design based on business requirements and specifications. Demonstrated strong ETL design skills, including source to target mappings, transformations, lookups, aggregations, and expressions.
  • Created technical specifications, test plans and test data to support ETL system development lifecycle processes.
  • Participated in Quality Control processes such as design reviews, peer code reviews, version control, and documentation.
  • Participated in AGILE iterative development methodology.
  • Involved in requirements gathering, analysis, design, development, change management, deployment.
  • Installed and Configured SQL Server 2005 successfully
  • Generated database monitoring and data validation reports in SQL Server Reporting Service (SSRS).
  • Created partition table for very large database for good performance.
  • Designed dynamic SSIS packages to transfer data crossing different platforms, validate data during transferring, and archived data files for different DBMS.
  • Responsible for writing SQL queries, stored procedures, views, triggers, T-SQL and DTS/SSIS.
  • Deployed SSIS packages and reports to production servers.
  • Involved in Login and User Management- Adding logins, roles, groups to the Window NT and SQL Server and maintaining proper security procedures.
  • Involved in ER diagrams and mapping the data into database objects. Expertise in Database creation (DDL, DML), performance planning, backup planning and database administration.
  • Developed custom reports using SSRS/SQL server BI studio.
  • Created reports in SSRS with different type of properties like chart controls, filters, interactive sorting, SQL parameters etc. Created dashboards in SSRS 2005.
  • Created report snapshots to improve the performance of SSRS.
  • Meeting with end user, collecting requirements and converting into technical specifications.
  • Created design document for the data warehouse
  • Involved in the development of the Star Snowflake to Model the data warehouse.
  • Worked on Capacity planning involving in estimating and sizing of tables.
  • Scheduled Daily and weekly Jobs and Alerting using SQL Server Agent.
  • Evaluated database performance and performed maintenance duties such as tuning, backup, restoration. Wrote DTS scripts for effective data transfer.
  • Involved in design, programming, deploy and Unit Testing of requested Reports.
  • Worked with the Data Architect to migrate legacy data into the new analysis data mart and created reports for inventory module.

Environment: MS SQL Server Management Studio 2008, SQL Server BIDS 2008, MS SQL Server Integration Services (SSIS), MS SQL Server Reporting Services (SSRS) 2008, MS SQL server Analysis services, Windows.

Confidential

SQL Server/SSIS/SSRS/ETL Developer

Responsibilities:

  • Created new database objects like Procedures, Functions, Packages, Triggers, Indexes and Views using T-SQL in Development and Production environment for SQL Server.
  • Designed and developed SSIS packages to extract data from various data sources such as access database, excel spreadsheet and flat files into SQL server 2005 for further data analysis and reporting by using multiple transformations provided by SSIS such as data conversion, Conditional Split, Bulk Insert, merge and union all.
  • Worked on all activities related to the development, implementation, administration and support of ETL processes for large-scale data warehouses using SQL Server SSIS and DTS.
  • Created complex ETL packages using SSIS to extract data from staging tables to partitioned tables with incremental load.
  • Used various transformations in SSIS like lookup, fuzzy grouping, row count transformations.
  • Created SSIS packages and used analysis services processing task to update the cube with current data.
  • Maintaining records in Excel Spread Sheet and exporting data into SQL Server Database using SSIS.

Hire Now