Azure Data Engineer Resume
Nashville, TN
SUMMARY
- 6+ years of experience in designing and developing database, data warehousing and Business Intelligence using Microsoft technologies Power BI, Excel, SSIS and SQL Server.
- Strong development skills withAzure Data Lake,Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage Explorer
- Primarily involved in Data Migration using SQL, SQL Azure, Azure storage, and Azure Data Factory, SSIS, PowerShell
- Developed SSIS packages, custom Azure Data Factory pipeline activities for on - cloud ETL processing.
- Responsible to Extract Transform and Load data from source systems to Azure Data storage services using a Combination of Azure Data Factory, T-SQL and Azure data Lake Analytics.
- Working on creating Pipelines, linked services, blob storage containers, mapping data flows, activities (Data movement, data transform and control activities), datasets, triggers, Parameters and variables.
- Designing and maintaining dimensional data model with Star Schema having multiple facts and Slowly changing dimension (SCD) tables.
- Used SSIS to create ETL packages to validate, extract, transform and load data into data warehouse and data marts.
- Extracted and transformed SQL Server Source data to Azure data lake using Azure Data factory.
- Good experience in Power Query, Power Pivot and Power View for creating teh TEMPeffective reports and dashboards in Power BI.
- Strong experience in creating dashboards using Power BI visualizations.
- Experience working on Custom Visualizations like Chiclet Slicer, Pulse Chart etc.
- Expertise in publishing teh reports into Power BI Service and sharing teh dashboards to teh Users.
- Proficient in creating content packs and creating roles to implement Row Level Security (RLS) for teh reports.
- Experience on enabling various types of filters for reports and pinning visuals into dashboards.
- Hands on experience in importing data from developed excel into power bi desktop using get data option.
- Experience in using DAX expressions like Logical, Aggregate, and Time Intelligence & Date Functions to create business Calculations based on requirements.
- Experience in creating visual interactions using edit interactions to make few visual to TEMPeffect data based on requirement.
- Good skills in trouble shooting On-Premises Gateway to refresh teh dashboards/ reports.
- Experience in creating dashboards and sharing with users.
- Hands-on experience in Dashboard design on Power BI desktop, has done report creation using virtualization on Power BI.
- Extensively used DAX Functions like SUM, AVERAGE, MIN, MAX, CALCULATE and FILTER in almost all reports.
TECHNICAL SKILLS
BI Tools: Power BI, Power View, Power BI Desktop, Power Pivot
Databases: SQL Server, Azure SQL Database, Synapse, Cosmos DB
Programming Languages: SQL, T-SQL, DAX
Integration Tools: SSIS
Cloud Products AZURE: Azure Data Lake, Azure Data Factory(ADF) V2, Azure Power Query, Azure Data factory, Azure Data Bricks, Azure Data Lake.
Operating Systems: Windows
PROFESSIONAL EXPERIENCE
Azure Data Engineer
Confidential, Nashville, TN
Responsibilities:
- Gathering all teh data sources required to build teh Business solution.
- Responsible to Extract Transform and Load data from source systems to Azure Data storage services using a Combination of Azure Data Factory, T-SQL and Azure data Lake Analytics.
- Ingesting Data to one or more Azure services-(Azure Data Lake, Azure Storage, AZURE Delta Lake, Azure SQL, Azure DW, Azure Cosmo DB) and processed data in Azure data bricks.
- Created pipelines in ADF using Linked services/Datasets/Pipelines/to Extract, Transform, and Load data from different sources like Azure SQL, Blob Storage, Azure SQL Data Warehouse.
- Created blob containers and azure tables in ADLS gen 2 for storage purposes.
- Used copy, look up, filter activities in data flows to filter teh data for presentation layer.
- Monitored existing automated pipelines and created triggers to automate teh new pipelines.
- Implemented Visual Level, Page level, report level filters and pinning in dashboards.
- Written simple DAX calculation as per teh requirement to maintain business measures.
- Worked on report permissions and dashboard permissions to provide access to different users.
- Used Quick insights to get various types of visuals to match teh requirements.
- Worked on relationship tab to provide cardinality between fact and dimension tables.
- Created TEMPeffective reports, dashboards and published in to Power BI service.
- Created teh roles for teh dashboards, sharing teh developed dashboards to teh client in Power BI.
- Created content pack library for sharing teh dashboards and reports to teh colleagues.
- Developed best practices for database design and development activities.
- Connected, imported, shaped, and transformed data for business intelligence (BI).
- Developed Visualization reports and dashboards using Power BI.
- Implemented row level security on data and has an understanding of application security layer models in Power BI.
Environment: Azure ADF, Power BI, MSBI
Data Engineer - Power BI
Confidential, Austin, TX
Responsibilities:
- Designed and deployed reports with Drill Down and Dropdown menu option and Parameterized and linked reports using Power BI.
- Participated in regular technical reviews, defect review and walkthrough meetings with important project and business stakeholders throughout teh project life cycle.
- Created Data extracts for better performance and accessing data offline.
- Analysed teh requirements and discussed with managers and leads on teh functionality.
- Extracted data from different kind of source systems into Power Query and tan cleansed teh data by applying business rules and loading it into Power Pivot.
- Created new measures and columns with DAX in MS Power BI Desktop.
- Created visualizations like Pie Charts, Tree Map, Tabular and Matrix by using Power BI View.
- Designed different types of reports like drill down and drill through reports in Power BI.
- Knowledge in creating Groups and content packs in teh Power BI services.
- Worked on On-Premises Gateway to refresh teh data sources/creating a live connection.
- Created SQL Server (T-SQL) stored procedures, views, and Power BI reports for project planning and regulatory reporting.
- Implemented Role Based and Row Level Security as part of security in Power BI.
- Shared teh reports & dashboards to end user.
Environment: Power BI, Power Query, Power Pivot, Power BI View, MS Power BI Desktop, T-SQL, DAX
BI Developer
Confidential, Irvine, CA
Responsibilities:
- Worked on Backend database development in MS SQL Server, writing complex queries, stored procedures, views, triggers, cursors, UDFs.
- Scheduled and maintained daily and monthly loads of Legacy systems.
- Involved in installing and maintaining MS SQL Server 2000/2005.
- Created SSIS package for loading teh data coming from various interfaces like KOL, Confidential and different Gaming sites and also uses multiple transformation in SSIS to collect data from various sources.
- Worked on SSIS Package, DTS Import/Export for transferring data from Database (Oracle and Text format data) to SQL Server.
- Worked on SSIS script task, look up transformations and data flow tasks using T- SQL and Visual Basic (VB) scripts.
- Developed Visualization reports and dashboards using Excel 2013.
- Visualized data, authored reports, and scheduled automated refresh of reports.
Environment: SQL Server 2012 Excel, SSIS