We provide IT Staff Augmentation Services!

Azure Data Engineer Resume

2.00/5 (Submit Your Rating)

Englewood Cliffs, NJ

SUMMARY

  • 10+ years of experience in Business Intelligence Using Microsoft SQL Server 2016/2019, BI Stack, PowerBI and Microsoft Azure.
  • Hands on Experience on Unified Data Analytics with Data Bricks, Databricks workspace user interface, Managing Databricks Notebooks, Delta Lake With Python, Delta Lake with Spark SQL.
  • Strong Knowledge on Power BI to import data from various sources such as SQL Server, Azure SQL DB, SQL Server Analysis Services (Tabular Model), MS Excel etc.,
  • Experience in Extracting, Transforming and Loading (ETL) data from Excel, Flat file to MS SQL Server using SSIS.
  • Experience in managing and automating control flow, data flow, events and logging programmatically using Microsoft .NET framework for SSIS packages.
  • Experience in creating partitions and designed various storage modes to increase the performance of cubes using SQL Server Analysis Services 2008/2019 (SSAS)
  • Expert in calculating measures and dimension members using Multi - Dimensional Expression (MDX).
  • Expert in writing DAX for writing custom calculations in power pivot MS Excel reporting.
  • Experienced working on OLAP database development including KPIs, Data Mining.
  • Expertise in designing complex reports like Dashboard Reports, Drill-Down Reports, Parameterized Reports, Cascaded Reports and Sub Reports using SQL Server Reporting Services based on client requirement.
  • Expert in creating complex Stored Procedures, User Defined Functions, DDL/DML Triggers, Views, Cursors and Indexes to facilitate efficient data manipulation and data integrity in Teradata.
  • Experience on High Availability/Disaster Recovery (HADR) solutions, Failover Clusters and Always on High Availability Groups, Replication, Log Shipping and Mirroring.
  • Designed, developed, implemented, and supported Power BI dashboards. Integrated data sources and databases with Power BI and designed and developed data models and backend queries for presenting data.
  • Experience in Azure SQL, Azure data lake, Azure data factory, Azure Blob storage and azure pipelines.
  • Good Hands-on Experience in Azure Data Factory Pipelines and building ETL Data Flows in ADF.
  • Understanding of MDM, Data warehouse / Data mart Experience with SQL Server in AWS environment.
  • Logged all types of objects in JIRA/Remedy from the requirement specification issues, mapping documentation defect and database issues.

TECHNICAL SKILLS

Database: MS SQL Server, MS Access, PostgreSQL, Oracle 10g, 11,12.

Programming Languages: T-SQL, SQL, PL/SQL, C, HTML, DHTML, XML, VB.NET, C#.Net, SharePoint.

ETL Tools: SQL Server Integration Services (SSIS), Data Transformation Service (DTS), Tableau, SQL Server Business Intelligence Development studio, Enterprise Manager, SQL Profiler, Query Analyzer, Import & Export (DTS), SSAS.

Reporting Tools: SQL Server Reporting Services (SSRS), Crystal Reports, Report Studio, Power BI, Tableau.

Cloud Computing: Azure SQL, Azure data Lake, Azure Data Bricks, Power BI, Data Factory, Spark Data Frame API, Spark Programming, Manage Cluster Databricks

Source Repositories: GIT, Azure DevOps

PROFESSIONAL EXPERIENCE

Confidential, Englewood Cliffs, NJ

Azure Data Engineer

Responsibilities:

  • Design Logical Data Model using notebooks in Azure DataBricks.
  • Extract Transform and Load data from Sources system to Azure Data Storage Services using a combination of Azure Data Factory, T-SQL, Spark SQL.
  • Worked on migration and conversion of data using Pyspark and Spark SQL for data extraction, transformation and aggregation from multiple file formats for analyzing and transforming from DataBricks Notebooks using Python.
  • Responsible for estimating the cluster size, monitoring and troubleshooting of the Spark DataBricks Cluster.
  • Ability to apply Data Frame API to complete Data Manipulation within spark session.
  • Created Data Quality Scripts to compare data built from spark data frame API.
  • Design and develop ETL Integration patterns using python on spark.
  • Analyzed SQL scripts and design it by using PySpark SQL for faster performance.
  • Migrated on -Prem ETL’s from MS SQL Server to Azure Cloud using Azure Data Factory and DataBricks.
  • Conversion of Data using Data Factory from On-Prem to Azure SQL Databases.
  • Performed ETL Transformation activities in Data Factory and built several pipelines and loaded data to Azure SQL Databases.
  • Built the Data flows using various transformation and scheduled pipeline runs.
  • Scheduled Jobs in Azure Data Factory and monitor pipeline runs and Debug pipeline failures.
  • Design and Develop Data Visualizations in Power BI.

Environment: Azure Data Lake & BLOB, Azure SQL, Azure data factory, MS SQL Server 2018, SQL Profiler, Data Bricks, Management Studio (SSMS), ETL, Integration Services (SSIS), Azure Data Bricks, Spark 3.1.2 Cluster, GIT, DevOps

Confidential, Dayton, OH

Azure Data Engineer

Responsibilities:

  • Design and implement end-to-end data solutions (storage, integration, processing, visualization) in Azure.
  • Worked on migration of data from On-prem SQL server to Cloud databases (Azure Synapse Analytics (DW) & Azure SQL DB).
  • Design and implement database solutions in Azure SQL Data Warehouse, Azure SQL.
  • Migrate data from traditional database systems to Azure databases.
  • Build Complex distributed systems involving huge amount data handling, collecting metrics building data pipeline, and Analytics.
  • Experience managing Azure Data Lakes (ADLS) and Data Lake Analytics and an understanding of how to integrate with other Azure Services like Synapse and Azure Data Factory.
  • Developed and created pipelines, jobs, scheduling triggers, Mapping data flows using Azure Data Factory(V2) and using Key Vaults to store credentials.
  • Worked on Azure BLOB and Data Lake storage and loading data into Azure SQL Synapse analytics (DW).
  • Had used T-SQL to write stored procedures, triggers, functions, tables, views, indexes and relational database models.
  • SSIS performance tuning using counters, error handling, event handling, re-running of failed SSIS packages using checkpoints and scripting with Active-X and VB.NET in SSIS.
  • Development using SSIS script task, look up transformations and data flow tasks using T- SQL and Visual Basic (VB) scripts.
  • Transferred the data (ETL) to data warehouse by SSIS and processed SSAS cubes to store data to OLAP databases.
  • Performance Monitoring with SQL Profiler Windows System Monitor.
  • Contributed to the project's overall understanding of Indiana Medicaid Management Information System Core MMIS.

Environment: Azure Data Lake & BLOB, Azure SQL, Azure data factory, MS SQL Server 2018, SQL Profiler, BIDS, Management Studio (SSMS), ETL, Integration Services (SSIS), DevOps.

Confidential, Mooresville, NC

Senior MS SQL, Azure, Power BI Developer

Responsibilities:

  • Participated in the requirement gathering sessions to understand the expectations and worked with system analysts to understand the format and patterns of the upstream source data.
  • Built Measures in tabular model using DAX queries and created partitions in tabular model.
  • Designed and implemented Dashboards and Scorecards with business KPIs using PerformancePoint Server and published them viaPower BI.
  • Built KPIs in tabular based on the end user requirements, worked on Performance of SSAS tabular model cubes.
  • Automate SSAS tabular model cube processing using XMLA queries.
  • Developed data model in Power BI and implemented Many to Many relationships.
  • Automate Power BI data refresh by using Power BI Enterprise gateway.
  • Expertise in DAX Queries to build Power BI calculated measures and Calculated columns.
  • Directly interact with end users to get the ad hoc requirements and report modifications.
  • Developed Tabular model and generates Power BI dashboards on top of that.
  • Using SQL Server Integration Services (SSIS) as an ETL Tool, the data has Extracted, Transformed and Loaded (ETL) from Excel and Flat file to MS SQL Server.
  • Implemented Event Handlers and Error Handling in SSIS packages.
  • Developed Azure Pipelines and getting data from IoT.
  • Migrated legacy SSIS packages into Azure data warehouse.

Environment: MS SQL Server 2012/2019, BIDS, Management Studio (SSMS), ETL, Integration Services (SSIS) 2008 R2/ 2012, Reporting Services (SSRS) 2008 R2/2012/2019,Power BI, TFS, SQL Profiler, SQL Server Query Analyzer, Tabular Models, Azure.

Confidential, Mechanicsburg, PA

ETL(SSIS), Power BI Lead/ Developer

Responsibilities:

  • Involved in the entire conversion lifecycle stages of Requirement Analysis, Data Profiling, Logical and Physical Data Mapping, Strategy, design, development, Unit testing, conducting conversion mock runs, SIT, UAT, Data Reconciliation and validation.
  • Created packages in SSIS with error handling as well as created complex SSIS packages using various data transformations like conditional split, Cache, for each loop, multi cast, Derived column, Data conversions, Merge, OLEDB Command, script task components.
  • Deployment of SSIS packages to the conversion server and create and schedule SQL Server Agent jobs to automate the run of SSIS packages on a weekly basis.
  • Developed data reconciliation SQL queries to validate the overall data migration. Prepared data reconciliation reports for conversion team/business. Maintained ETL functional specifications, test plans and data for data conversions. Automated the data reconciliation process to minimize the developer involvement in validating production migrations.
  • Developed, deployed and monitored SSIS Packages for new ETL Processes and upgraded the existing DTS packages to SSIS for the on-going ETL Processes.
  • Monitored Full/Incremental/Daily Loads and support all scheduled ETL jobs for batch processing.
  • Plan, design, and implement application database code objects, such as stored procedures and views.
  • Creating Azure Data factories for loading the data to Azure SQL database from Cosmos platform.
  • Utilized Power Query in Power BI to Pivot and Unpivot the data model for data cleansing and data massaging.
  • Created SSRS Reports and deployed on the report server and scheduled the reports using subscriptions and created jobs to deploy the reports to a specific location after every Release.
  • Involved in Resolving the Defects from the Defect Tracking Tool JIRA in all the environments from STAGING, UAT and PROD.

Environment: Power BI, SQL Server, Microsoft CRM 2015, JIRA, MS SQL Server 2008/2019, TSQL, SQL Server 2008, SQL BI Suite (SSIS, SSRS) /DBA, Oracle 11g, JIRA, Report Builder.

Confidential, Charlotte, NC

SSRS Developer

Responsibilities:

  • Maintained Microsoft Team Foundation Server TFS to allow for secure code, Reports and use as a repository to compare modified and unmodified code.
  • Creating reports using SQL Reporting Services (SSRS) for customized and ad-hoc Queries.
  • Wrote complex queries for the drill down reports and used conditional formatting using SSRS.
  • Scheduled and monitored all maintenance activities of SQL Server 2008 including database consistency checks and index defragmentation.
  • Actively supported business users for changes in reports as and when required using SSRS.
  • Analyzed reports and fixed bugs in stored procedures using SSRS.
  • Designed and optimized indexes, views, stored procedures and functions using T-SQL
  • Helped designing and implementing processes for deploying, upgrading, managing, archiving and extracting data for reporting.
  • Performed maintenance duties like performance tuning and optimization of queries, functions and stored procedures.
  • Designed high level SSIS architecture for overall data transfer from the source server to the Enterprise Services Warehouse.

Environment: MS SQL Server2005/2008, SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), AWS, MS Visual Studio.NET# 2008, Microsoft TFS (Team Foundation Server), Visual Basic6.0/VB.net, VB Script.

Confidential, Dallas, TX

POWER BI/SQL Developer

Responsibilities:

  • Developed dashboard reports using Reporting Services, Report Model and ad-hoc reporting using Report Builder.
  • Experience in creating Parameterized reports and Linked reports with thorough knowledge of report serving architecture. (Table, chart and matrix report).
  • Experience in using tools like index Tuning Wizard, SQL Profiler, and Windows Performance Monitor for Monitoring and Tuning MS SQL Server Performance.
  • Deployed SSIS Package into Production and used Package configuration to export various package properties to make package environment independent.
  • Designed SSRS reports with sub reports, dynamic sorting, defining data source and subtotals for the report.
  • Installed and administered Three-Node cluster Active/Passive on Microsoft Windows Server 2012 Enterprise Edition on SAN environment.
  • Created and Migrated Partially Contained Databases within Always On Availability Groups.
  • Used Power BI, Power Pivot to develop data analysis prototype, and used Power View and Power Map to visualize reports.
  • Published Power BI Reports in the required originations and Made Power BI Dashboards available in Web clients and mobile apps.
  • Used Power BI Gateways to keep the dashboards and reports up to date.

Environment: SQL Server 2012 Enterprise, SQL Server 2016, BIDS, Microsoft Reporting Service (SSRS), SQL Server Integration Services (SSIS), Clustering, Always On, Power BI, Mirroring, Replication.

Confidential, Montvale, NJ

SQL BI Developer SSIS/SSRS

Responsibilities:

  • Implemented Event Handlers and Error Handling in SSIS packages.
  • Converted Data Transformation Services (DTS) application to SQL Server Integrated Services (SSIS) as assigned.
  • Created packages using SSIS for data extraction from Flat Files, Excel Files, and OLEDB to SQL Server.
  • Developed Tabular Reports, ad-hoc reports using SSRS Report Designer.
  • Running DBCC consistency checks and fixing data corruption in application databases.
  • Configured SSIS packages using Package configuration wizard to allow packages run on different environments.
  • Worked with Meta-Data Driven SSIS Packages to pull the data from different Sources and load to Data mart.
  • Migrated SSIS Packages from SQL Server 2005 to SQL Server 2008.
  • Developed complex SSRS reports using multiple data providers, Global Variables, Expressions, user defined objects, aggregate aware objects, charts, and synchronized queries.

Environment: SQL Server 2012 Enterprise, BIDS, Microsoft Reporting Service (SSRS), SQL Server Integration Services (SSIS).

Confidential, Irving, TX

MS BI Developer SSAS/Teradata

Responsibilities:

  • solved complex business problems by designing, implementing, maintaining and monitoring multi-dimensional cubes using SQL Server Analysis Services (SSAS).
  • Designed OLAP cubes making use of Star and Snowflake Schemas.
  • Interacted with end-users in requirement gathering sessions, use case analysis, report layout design.
  • Used Calculated Member Builder to create custom measures.
  • Deploying cubes and reporting services reports to Production servers generated by the offshore team.
  • Writing SQL Server Stored procedures/complex queries to retrieve data from Teradata.
  • Writing MDX queries to generate OLAP reports.
  • Writing DAX queries to generate Excel and Drill to detail reports. Also created power pivot reporting from Analysis Services tabular model.
  • Created various complex reports like Dashboard, Drill Through, parameterized reports, Matrix and chart reports according to user specifications.
  • Scheduled the Reports to run on daily and weekly basis in Report Manager and also emailing them to end users and analysts to be reviewed in Excel Sheets.
  • Writing SSIS packages to load data into Facts and confirmed dim tables to build cubes.
  • Created Database Objects - Schemas, Tables, Indexes, Views, User defined functions, Triggers, Stored Procedure, and Constraints.
  • Involved in optimizing code and improving efficiency in databases including re-indexing, updating statistics, recompiling stored procedures and performing other maintenance tasks.

Environment: SQL Server 2012 SSIS, SSAS, SSRS, Teradata, Oracle, Visual Studio 2005, Windows Enterprise Server 2003, ADO.NET, Visual Source Safe, XML, HTML, Erwin.

We'd love your feedback!