We provide IT Staff Augmentation Services!

Msbi Developer/ Data Engineer Resume

2.00/5 (Submit Your Rating)

Dallas, TexaS

SUMMARY

  • Microsoft MSBI developer with 8 years of professional experience in SQL Server database development, extensively worked in Production, Test, Development using Microsoft technologies like SQL server, SSIS, SSRS, PowerBI, Snowflake, AZURE Data Factory, DataBricks and Python and Domain Knowledge on HealthCare, Insurance & Payments.
  • Strong experience in developing and deploying SSIS packages using dataflow and control flow components, creating SQL mail alerts and job scheduling using SQL Server/TWS Agent.
  • Hands on experience in creating indexed Views, complex Stored Procedures, effective functions, CTE’s to assist efficient data manipulation and data consistency.
  • Had exposure on Python, Pandas, Numpy, Statistics and Creating Machine learning models using Python and Flask.
  • Involved on administration tasks such as disaster recovery with Backup and Restore Strategies, Data Loading, Batch Jobs, Data Unloading, Upgrades, Creating Databases, Files, File groups, Transaction logs, dimensional database environments.
  • Strong understanding of the principals of Dataware housing concepts using Fact tables, Dimension Tables, And Star/Snowflake Schema modeling. designing and implementing a fully operational production grade large scale data solution onSnowflakeData Warehouse.
  • Developing ETL pipelines in and out of data warehouse using combination of Python and Snowflakes Writing SQL queries against Snowflake.
  • Expertise in solving Dead Locks/Long running queries using Performance Monitor and SQL Profiler
  • Expert in Microsoft SQL Server 2012 and 2008 backend programming, Extensive experience in creating database objects on MS SQL Server 2012 and 2008.
  • Involved in Huge data migrations, transfers using utilities like SSIS, Bulk Copy Program (BCP) and Bulk Insert.
  • Hands on experience in designing complex reports using SQL Server Reporting Services (SSRS) and Proficient in all phases of Data warehousing concepts, and experience in dimensional modeling using Star Schema and Snow - flake Schemas.
  • Ability to create SSIS Packages using various Transformation like Lookup, Derived Columns, Conditional Split, Data Conversion, Aggregate, Merge Join, Sort, Execute SQL Task, Data Flow Task, and Execute Package Task etc.
  • Clustering, Replication, Data Mirroring, Linked Servers, SQL Profiler, Log Shipping and Re-Indexing.
  • To generate underlying data for the reports and to export cleaned data from an Excel Spreadsheet, Flat file, MS Access and CSV files to the data warehouse.
  • Database development for both OLTP and OLAP systems using MSSQL Server.
  • A well organized, flexible, enthusiastic and project-oriented team player, to develop creative solution for challenging client needs and strong in management and leadership skills.
  • Good logical, analytical, interpersonal skills and commitment to perform quality work as well as an excellent team player.
  • Experience in publishingPowerBIDesktop reports created in Report view to thePowerBIservice.

TECHNICAL SKILLS

RDBMS/Databases: MSSQL Server 2008/2012/2014 , Azure database, cosmos Db, Neo4J

ETL Tools: SQL Server Integration Services (SSIS), BCP, Azure Data factory. Talend open studio

Platform & skills: SQL Server Management Studio, ETL, Visual Studio SQL Server Reporting services (SSRS), Power BI, Tableau, Active Batch, ECG, HPSM, Service Now.

Performance Tuning Tools: SQL Profiler, DTA (Data Tuning Advisor)

PROFESSIONAL EXPERIENCE

Confidential - Dallas Texas

MSBI developer/ Data Engineer

Responsibilities:

  • Involved in analyzing business requirements and understanding the functional work flow of information from source systems to destination systems.
  • Developed Stored Procedures, functions and database triggers and maintained referential integrity and implemented complex business logic to generate different market claims for different types of accounts.
  • Created and executed SQL Server Integration Service packages to populate data from the various data sources, created packages for different data loading operations for many applications.
  • Created SSIS Packages using SSIS Designer for exporting heterogeneous data from OLE DB Source, Excel Spreadsheet to SQL Server.
  • Experience on the Azure cloud. Experience in migrating SQL database to the Azure data lake, azure data lake analytics, and Azure SQL database. And azure data warehouse and controlling and granting database access and migrating on-premises databases to azure data lake store using Azure data factory
  • Good understanding of Big Data Hadoop and yarn architecture along with Job Tracker, Name Node, Data Node, and Cluster management.
  • Design and implement database solutions in Azure SQL Data Warehouse, Azure SQL
  • Azure Data Factory (ADF), Integration Run Time(IR), File System Data Ingestion, Relational Data Ingestion.
  • Worked on Devops tickets deploying user stories to different environments Using Azure GitHub.
  • Created Azure SQL Database and performed monitoring and restoring of Azure SQL Database. Performed migration of SQL Server to Azure SQL database.
  • Created pipelines in ADF using Linked Services/Datasets/pipeline/ to Extract, Transform and Load data from different sources like Azure Sql, Blob Storage, and Azure Sql Data warehouse.
  • Developed JSON scripts for deploying the pipeline in Azure Data Factory (ADF) that process the data using sql activity.
  • Migrate the data using Azure database migration service (AMS)
  • Bulk Loading from the external stage and internal stage to snowflake cloud using the copy command.
  • Developed Snowflake procedures for executing branching and looping.
  • Migrated DTS packages to SSIS packages and modified the packages with new features of SQL SSIS.
  • Designed ETL packages dealing with different data sources (SQL Server, Flat Files, and XMLs etc.) and loaded the data into target data sources by performing different kinds of transformations using SQL Server Integration Services (SSIS).
  • Scale up and scale down the Azure scaling jobs to reduce the cost.
  • Developed a web application (dashboard) using python, Flask, html which simplified a lot of the job monitoring and received a lot of accolades.
  • Developed python code to extract data from Elastic search and create custom reports send them as email attachment.
  • Worked on Hadoop, data load using scoop, Scala, data validation using Hive, impala, Hue
  • Clara bridge (speech to text conversion and sentiment analysis): creating large scale (s ql) data warehouse for data ingestion, data scrubbing, manipulation of billions of records and loading to Big data systems.
  • Scale up and Scale down Azuring Scaling jobs to reduce the cost of resource utilization.
  • Generated ad-hoc reports in ExcelPower Pivot and sheared them using Power BI to the decision makers for strategic planning.
  • Created reports utilizing SSRS, Excel services,Power BI and deployed them on SharePoint Server as per business requirements.
  • Performed data analysis using SQL Reporting, prepared datasets supporting development of data products.
  • Responsible for creating and changing the visualizations in Power BI reports and hierarchies using Bar charts and Pie charts according to the client requests.
  • Design, deployment, and maintenance of various SSRS Reports in SQL Server.
  • Designed and implemented Parameterizedand cascading parameterized reports using SSRS.
  • Built MDX queries and Data Mining Expression (DMX) queries for Analysis Services & Reporting Services.
  • Created multiple reports (SSRS) in Drill mode using tables, financial tables, crosstabs and chart.
  • Used SQL Profiler for troubleshooting, monitoring, and optimization of SQL Server and non-production database code as well as T-SQL code from developers and QA.
  • Backing up, restoring system & other databases as per requirements, and also scheduled those backups.
  • Used SQL Server Profiler to trace the slow running queries and tried to Optimize SQL queries for improved performance and availability.
  • Extensive use of Data Analysis Expressions (DAX) expressions in tabular models as per business requirements.
  • Developed anExecutive level dashboardsusing Tableau 9.0.
  • Designed and createdReport templates, bar graphsandpie chartsbased on the financial data.
  • Developed various types ofcomplex reportslikeDrill Down, Drill through, Cross tab reports.

Confidential, Minneapolis,MN

MS SQL/SSIS Developer

Responsibilities:

  • Worked on extracting the data from OLTP Systems to DWH using SQL Server Integration Services (SSIS).
  • Have used BCP, Bulk Insert to transfer data from and to SQL server database.
  • Responsible for Database and Log Backups & Restoration, Backup Strategies and Scheduling Backups.
  • Created Packages, Jobs and Sending Alerts using SQL Mail, database Backup, Recovery and Disaster Recovery procedures.
  • Analyzed business requirements and build logical data models that describe all the data and relationships between the data.
  • Created new database objects likeProcedures, Functions, Packages, Triggers, IndexesandViewsusingT-SQLinSQL Server 2008/2012.
  • Promoted database objects from test/develop to production. Coordinated and communicated production schedules within development team.
  • Modified database structures as directed by developers for test/develop environments and assist withcoding,designandperformance tuning.
  • Managed user access. Created and managed new security accounts.
  • Backupandrestoredatabases.
  • Developed and implemented database and coding standards, improving performance and maintainability of corporate databases.
  • Created theSSISPackagethroughETLProcess to vendors in which records were extracts from Flat file and Excel sources and loaded daily at the server.
  • Extensively used T-SQL in creating and altering stored procedures, functions, views, indexes, user profiles, relational Database models, data dictionaries, and data integrity.
  • Writing reports using Microsoft Reporting Services (SSRS)
  • Created jobs, alerts to run SSIS packages periodically. Created the automated processes for the activities such as database backup and SSIS Packages to run sequentially using SQL Server Agent job.
  • Designed, built and tested SSAS Cubes on SQL Server 2008.
  • Created Excel workbooks to enable Cube (SSAS) access for business users.
  • Used ETL (SSIS) to develop jobs for extracting, cleaning, transforming and loading data into the data warehouse.
  • Retired SSIS 2008 server and upgraded all existing SSIS 2008 jobs to SSIS 2012.
  • Developed, designed and deployed matrix and tabular reports with drill-down and drill-through features using SSRS.

Confidential - Minneapolis,MN

SQL Server/ MSBI Developer

Environment: SQL Server 2008R2, 2014, SSIS, T-SQL, Azure Data factory, Excel, Microsoft SQL Reporting

Responsibilities:

  • Participated in gathering User Requirements and System Specifications.
  • Used various SSIS tasks such as Conditional Split, Derived Column, Look-Up that were used for Data validation Scrubbing, Data checks during Staging, before loading the data into the Data Warehouse.
  • Experience in azure machine learning.
  • Created T-SQLscripts, which generated tables, relationships, based on the finalized ER-diagram.
  • Identified source, destination, staging area per ETL strategy and performed data cleansing and data profiling.
  • Modified ETL mapping document per changes in business requirement.
  • Designed the ETL process to pull and populate data from OLTP sources such as flat files, XML and Excel to the data mart.
  • Deployed the SSIS Packages to DEV and QA Environments and provided the proper instructions to DBA to deploy into Production
  • Designed drill through, drill down, linked, sub reports and parameterized reports utilizing SSRS.
  • SSRS reports formatting by applying parameters, assigned default values and data types.
  • Using ETL (SSIS) to develop jobs for extracting, cleaning, transforming and loading data into data warehouse.
  • Designed Database Maintenance Planner for the Performance of SQL Server, which covers Database Integrity Checks, Update Database Statistics and Re-indexing.
  • Created many SSIS packages using Import/Export Wizard. Designed many Packages using SSIS Designer by using Control Flow and Data Flow Tasks with ETL Tool.
  • Designed and developed SSIS Packages toimport and export datafrom MS Excel, SQL Server 2014andFlat files.
  • Created date and string expressions in SSIS packages and passed them to create dynamic queries for SSIS source SQL commands.
  • As part of the ETL process new stored procedures as created using MERGE command for doing insert and updates at the same time and hence increasing performance.
  • Involved indaily batch loads (Full & Incremental)intoStagingandODS areas, troubleshooting process, issues anderrors using SQL Server Integration Services (SSIS) 2012.
  • Involved in completeSSIS life cyclein creatingSSIS packages, building, deployingandexecuting the packagesin both the environments (Development and Production).
  • Involved in ETL architectureenhancementsto increase the performance using query optimizer
  • ImplementedEvent HandlersandError HandlinginSSISpackages.
  • Created and developed the stored procedures, triggers to handle complex business rules, history data and audit analysis.
  • Created and monitored Sql Agent/TWS jobs for SSIS packages
  • Used views, procedures and functions process staged data and loaded the final tables. Created tables, added columns to existing tables.
  • Wrote many adhoc queries for testing the old verses new architecture data to determine if the new system could meet the requirement of minimal loan failure.

Confidential - Ford Rd, Dallas

SQL Server Developer

Responsibilities:

  • Involved with Data Architects in designing New Data Model, EDW (Data Warehouse) and OLAP Data Model.
  • Created SSIS Packages to load Data from Existing Data Model to new Data Model and Data Ware House.
  • Involved in designing complex packages moving data from various servers and environments using SSIS.
  • Performance tuning the SSIS Packages by understanding the Data Flow Buffers and by designing for parallelism.
  • Involved in loading Dimensions and Facts in newly built data ware house which also involved in Type 1 and Type 2 slowly changing dimensions using SSIS.
  • Deploying SSIS Packages on respective server and effectively using configuration files for using same packages on other environments.
  • Scheduling the SSIS packages by creating a Job using SQL Agent in SSMS.
  • Worked with various transformations like Lookup, Fuzz Lookup, Merge, Sort, Multicast,
  • Conditional Split, Loop Containers, Execute SQL Task and lot more using SSIS.

We'd love your feedback!