SUMMARY

• Over 8+ Years experience as Azure Data Engineer/Azure Migration Engineer, Azure Data Factory (ADF) V2. Managing Azure SQL Database, Azure Data Platform services - Azure Data Lake (ADLS), Data Factory (ADF), Data Lake Analytics, Stream Analytics, Azure SQL DW, HDInsight/Databricks, NoSQL DB), LogicApp’s, Azure Purview SQL Server, Oracle, Data Warehouse etc.
• Expertise in Microsoft SQL Server, Azure PaaS components (Azure Data Factories, Data Bricks, Azure Logic Apps, Azure Data lake Analytics using USQL, Azure App Services, Geo-Replication, Azure Application insights and SQL Data Warehouse).
• Strong Working experience wif LakeHouse Architecture, Delta Lake, Databricks, Datafactory, SQL, Amazon Redshift.
• Strong development skills wifAzure Data Lake,Data Bricks, Azure Data Factory, SQL Data Warehouse, Azure Blob, Azure Storage Explorer.
• Experience managingBig Dataplatform deployed inAzure Cloud.
• Strong experience wif Python, Spark, Pyspark, SQL.
• Experience wif Databricks and performed Data Transformation, Data cleansing, Data Aggregations, Data enrichment activities Data Optimizing, Data Vacuum as per the business requirement.
• Experience in Azure Data Lake Gen1/Gen2. Build how the data will be received, validated, transformed and tan published.
• Experience in implementing hybrid connectivity between Azure and on - premise using virtual networks, VPN and Express Route.
• Experience managing Azure Data Lakes (ADLS) and Data Lake Analytics and an understanding of how to integrate wif other Azure Services.
• Experience in troubleshooting and resolving architecture problems including database and storage, network, security and applications.
• Design and implement database solutions in Azure SQL Data Warehouse, Azure SQL.
• Implement ad-hoc analysis solutions using Azure Data Lake Analytics/Store, HDInsight.
• Worked on Setting up Azure Purview, register resources, setup scan, add glossary teams, lineages etc.
• Worked on creating manual lineage in purview, Created notebooks in Databricks, defined purview entities and manually updated metadata to purview.
• Design & implement migration strategies for traditional systems on Azure (Lift and shift/Azure Migrate, other third-party tools).
• Design and implement end-to-end data solutions (storage, integration, processing, visualization) in Azure.
• Experience managing Azure Data Lakes (ADLS) and Data Lake Analytics and an understanding of how to integrate wif other Azure Services. Knowledge of USQL and how it can be used for data transformation as part of a cloud data integration strategy.
• Establish database standards for operations, upgrades, migrations and onboarding new applications and/or customers.
• Performed migration of Microsoft SQL server to Azure SQL database.
• Created Azure data factory Pipelines for moving data from databases and calling stored procedures using stored procedure activities, task is to extract the client product data as per the requirement of the client from cosmos clusters using Cosmos Scope scripts(USQL) and dump the data into Azure data lake and tan cook the data through USQL Scripts and dump the data again to Azure Data Lake and tan to Data Ware house using data factories.
• Experiece wif Azure LogicApp, setup custom notifications using sendgrid.
• Develop workload migration plan in conjunction wif other technical teams.
• Worked on Spark and Kafka.
• Design and implement streaming solutions using Kafka or Azure Stream Analytics.
• Code and automation create to New System for scaling deployment mission critical operation of Cloud.
• Azure Analysis Services (SSAS) and SQL Server Reporting Services (SSRS) and Familiarity wif Excel PowerPivot, PowerView and PowerBI.
• Creates and maintains Disaster Recovery procedures and participates in periodic disaster recovery testing
• Deploying Azure Resource Manager JSON Templates from PowerShell.
• Created Azure SQL database and performed monitoring and restoring of Azure SQL database. Performed migration of Microsoft SQL server to Azure SQL database.
• Advise on cost efficiency for future usage and cost optimization for current infrastructure.

TECHNICAL SKILLS

Operating Systems: RHEL/CentOS, Ubuntu/Debian/Fedora, Windows Server 2016/2012 R2

Languages: C# .NET, ASP.NET, python, Spark

CI Tools: Visual Studio 2015, SSMS, Adobe Analytics, Asimov DataGrid, Asimov X-flow, PowerShell, Power BI, Microsoft Excel, Adobe Analytics

Databases: SQL Server, MySQL

Scripts: Shell scripting and PowerShell script

SDLC: Agile, Scrum, Waterfall Methodologies

Monitoring Tools: Azure Application Insights, Cloud Watch

Microsoft Technologies: ASP.NET 2.0/3.5/4.0, WCF 3.5 MVC, REST API’s, Microsoft Azure Components like Azure Data Factories, Logic Apps, Azure Function Apps, Azure Data lake, Azure Data lake Analytics, Azure App Services, Azure SQL Databases, SQL Data Warehouse, Azure Management Tools, Azure Bot Framework, Azure Databricks.

PROFESSIONAL EXPERIENCE

Confidential, Peoria, IL

Azure Data Engineer

Responsibilities:

• Worked on Azure PaaS Components like Azure data factory, Data Bricks, Azure logic apps, Application insights, Azure Data Lake, Azure data lake analytics, virtual machines, Zeo-Replication, and app services.
• Involved in Full Life cycle implementation of the project and participated in the preparation of business analysis documentation.
• Gathering requirements from the functional team and developed technical specification for the requirements.
• Worked on SQL Server database for creating the schemas related to the physical data model of the project, creating SSIS Packages, External tables for extracting data from Azure Data Lake.
• Worked on Databricks and performed Data Transformation, Data cleansing, Data Aggregations, Data enrichment activities Data Optimizing, Data Vacuum as per the business requirement.
• Designed Lakehouse Architecture Ausing Azure Deltalake, Databricks.
• Worked on Azure Datafactory end-to end pipelines, ADLS gen2, Azure tables Databricks.
• Working expeerience in Azure Purview for data governence, worked on injesting manual lineage using Databricks.
• Work wifin multi-functional agile teams wif end-to-end responsibility for product development and delivery.
• Integrated data from Data warehouse and Data marts to cloud- based data structures using T-SQL.
• Developing ETL pipelines in Azure Databricks in and out of data warehouse using combination of Python and SQL.
• Exposure to Jupyter Notebook in Azure Databricks environment.
• Build, deploy and monitor Batch and near real time data pipelines to load structured and unstructured data into Azure Data Lake Storage.
• Took the ownership of live site team when project went to live, prioritizing the customer satisfaction.
• Migration of on-premise data (SQL Server) to Azure Data Lake Store (ADLS) using Azure Data Factory (ADF V1/V2), Azure Data Bricks
• Deploying Azure Resource Manager JSON Templates from PowerShell worked on Azure suite: Azure SQL Database, Azure Data Lake, Azure Data Factory, Azure SQL Data Warehouse, Azure Analysis Service.
• Architect & implement medium to large scale BI solutions on Azure using Azure Data Platform services (Azure Data Lake, Data Factory, Data Lake Analytics, Stream Analytics, Azure SQL DW, HDInsight/Databricks, NoSQL DB.
• Design Setup maintain Administrator the Azure SQL Database, Azure Analysis Service, Azure SQL Data warehouse, Azure Data Factory, Azure SQL Data warehouse.
• Deployed and manage MLflow libraries in Aure Databricks work space and to track servers outside Databricks.
• Worked on SQL Server Integration Services (SSIS), SSAS skills, stored procedures, triggers.
• Worked on Spark and REST API’s.
• Build Complex distributed systems involving huge amount data handling, collecting metrics building data pipeline, and Analytics.
• Participating in Technical Architecture Documents, Project Design, and Implementation Discussions.
• Work wifin and across Agile teams to design, implement, test, and support technical solutions across a full stack of technologies.
• Work closely across teams (Support, Solution Architecture) and peers to establish and follow best practices while solving customer problems.
• Collaborate wif application architects on infrastructure as a service (IaaS) application to Platform as a Service (PaaS).
• Created POWER BI Visualizations and Dashboards as per the requirements.
• Used various sources to pull data into Power BI such as SQL Server, Excel, Oracle, SQL Azure etc.
• Propose architectures considering cost/spend in Azure and develop recommendations to right-size data infrastructure.
• Design and implement database solutions in Azure SQL Data Warehouse, Azure SQL.
• Migrate data from traditional database systems to Azure SQL databases.
• Implement ad-hoc analysis solutions using Azure Data Lake Analytics/Store, HDInsight.
• Design and implement streaming solutions using Kafka or Azure Stream Analytics.
• Design and develop data visualizations in Power BI.
• Prepare documentation and architectural designs.
• Propose architectures dat consider cost/spend in Azure and develop recommendations to right-size Azure data infrastructure.
• Work wif similar Microsoft on-prem data platforms, specifically SQL Server and related technologies such as SSIS, SSRS, and SSAS.
• Automated tasks using PowerShell.

Environment: SQL Server Management Studio 2014, Visual Studio 2015, VSTS, Azure SQL, Azure Storage Explorer, Azure Blob, Power BI, PowerShell, C# .Net, Adobe Analytics, Fiddler, SSIS, SSAS, Asimov X-Flow, DataGrid, ETL Extract Transformation and Load, Business Intelligence (BI), Azure Storage, Azure Data Factory, DataBricks, Azure Application Insights, Azure SQL Analytics Azure Blob Storage, Azure Backup, Azure Files, Azure Data Lake Storage Gen 1, Azure Bot Framework, Azure App Services, Azure Web Apps, Azure Logic Apps, Azure Web Jobs, Azure Virtual Machine(VM),Windows Server, Unix, LINUX, Shell Script

Confidential, Kansas City, MO

Azure Data Engineer

Responsibilities:

• Design and implement end-to-end data solutions (storage, integration, processing, visualization) in Azure
• Architect and implement ETL and data movement solutions using Azure Data Factory, SSIS
• Develop dashboards and visualizations to help business users analyze data as well as providing data insight to upper management wif a focus on Microsoft products like SQL Server Reporting Services (SSRS) and Power BI.
• Engage wif business users to gather requirements, design visualizations and provide training to use self-service BI tools.
• Developed and maintained multiple Power BI dashboards/reports and content packs
• Created POWER BI Visualizations and Dashboards as per the requirements
• Used various sources to pull data into Power BI such as SQL Server, Excel, Oracle, SQL Azure etc.
• Design and implement database solutions in Azure SQL Data Warehouse, Azure SQL
• Migrate data from traditional database systems to Azure SQL databases
• Implement ad-hoc analysis solutions using Azure Data Lake Analytics/Store, HDInsight
• Propose architectures dat consider cost/spend in Azure and develop recommendations to right-size Azure data infrastructure.
• Work wif similar Microsoft on-prem data platforms, specifically SQL Server and related technologies such as SSIS, SSRS, and SSAS
• Design & implement data security and governance policies and standards
• Migrate data from traditional database systems to Azure databases
• Recreating existing application logic and functionality in the Azure Data Lake, Data Factory, SQL Database and SQL datawarehouse environment. Experience in DWH/BI project implementation using Azure DF
• Interacts wif Business Analysts, Users, and SMEs on requirements
• Designs Logical and Physical Data Model for Staging, DWH and Data Mart layer.
• Engage wif business users to gather requirements, design visualizations and provide training to use self-service BI tools.
• Developed and maintained multiple Power BI dashboards/reports and content packs.
• Created POWER BI Visualizations and Dashboards as per the requirements
• Used various sources to pull data into Power BI such as SQL Server, Excel, Oracle, SQL Azure etc.
• Propose architectures considering cost/spend in Azure and develop recommendations to right-size data infrastructure
• Experience managing Azure Data Lakes (ADLS) and Data Lake Analytics and an understanding of how to integrate wif other Azure Services. Knowledge of USQL and how it can be used for data transformation as part of a cloud data integration strategy
• Participating in Technical Architecture Documents, Project Design and Implementation Discussions
• Azure Automation through Runbook Creation, Migration of existing .PS1 scripts, Authorizing, Configuring, Scheduling
• Dev Ops tools, processes and best practices including automation of resource provisioning/maintenance
• Compute and Storage area in multi-platform environment such as Linux and Windows

Environment: Azure SQL, Azure Data Factory, Azure Data Lakes, Power BI, Azure Storage Explorer, Azure Blob, Shell Script, SSIS, SSRS, Windows.

Confidential, Los Angeles, CA

Azure Engineer

Responsibilities:

• Created and maintained continuous integration (CI) using tools Azure DevOps over different environments to facilitate an agile development process which is automated and repeatable, enabling teams to safely deploy code many times a day while ensuring operational best practices are supported.
• Design and document CI/CD tools configuration management.
• Responsible for orchestrating CI/CD processes by responding to Git triggers, human input, and dependency chains and environment setup.
• Build and Deployment CI/CD Pipelines.
• Managed User access control, Triggers, workflows, hooks, security and repository control in Bitbucket.
• Performed Configuration of Azure Web Apps, App services, Application insights,AzureDNS,AzureNetwork Watcher and Implementing Azuresite recovery,Azurestack, Backup and Automation.
• Experience in configuring ARM, VM Networking, Private Static IP Address and Public IP address inAzure.
• Created Virtual Networks inAzurefor hybrid connectivity wif On-premise networks (Express Route, VPN Gateways).
• Worked on MicrosoftAzurefor Development, Test and UAT environments for all customers regardless of final Production platform to speed up.
• DevelopedAzure PaaS services including WebJobs, AzureSQL, Azure BLOB storage, Azure Application Insights, Azure Data Factory, Azure functions, Azure BOT Service, Azure Active Directory, Azure Stream Analytics, Azure CDN.
• Implemented Infrastructure automation through Terraform and Azure DevOps for auto provisioning, code deployments, software installation.
• Used Terraform Enterprise version and integrated dat wif VCS repository hosted on Git to automate deployment of infrastructure of check in for Dev, Test and UAT environments.
• Designed and created multiple deployment strategies using CI/CD Pipeline and configuration management tools, wif remote execution to ensure zero downtime and shortened automated deployments.
• Deployed applications using Azure DevOps and troubleshooted build and release job failures.
• Build, deploy ASP.NET web application on using TFS Build Automation, Blob Storage and Portal.
• Experience in using Visual Studio .NET platform (C#, ASP.NET, ADO.Net), thorough knowledge of the architecture and the framework.
• Worked wif scrum and development team in overseeing bug tracking, test prioritization, test automation and releases.
• Improved team performance and accelerated release cycle accelerate delivery of new features and increase overall product qualities.

Environment: Git, Apache Tomcat, Agile/Scrum, SDLC, Windows, Linux, Azure, PowerShell, Splunk, Shell script, Power BI

Confidential

Azure Engineer

Responsibilities:

• Hands on Experience working wif the MicrosoftAzureCloud Services and Deployed the servers throughAzure Resource Manager Templates orAzurePortal.
• Planning and implementing Disaster Recovery solutions, capacity planning, data archiving, backup/recovery strategies, Performance Analysis and optimization.
• Strong Experience on Administration and Troubleshooting ofAzureIAAS Components (VM, Storage, VNET, OMS, NSG, Site to Site VPN, RBAC, Load Balancers, Availability Sets).
• Experience in setting up cluster environment for load balancing and high availability of Windows and Linux servers.
• Experience in Creating the CI/CDAzure DevOpsPipeline for the .Net, java & UI based Web Applications.
• Good Exposure inAzureSite Recovery andAzureBackup and ConfiguringAzureBackup vault for protecting required VMs to take the VM level backups forAzureand On Premises Environment.
• Working knowledge onAzureCloud IaaS and PaaS Services. Having Experience of Creating and Managing the users and groups inAzureAD.
• Experience in managing Microsoft Windows server infrastructure and data - center operations by effectively planning, installing, configuring and optimize the IT infrastructure to achieve high availability and performance.
• Designed Network Security Groups (NSGs) to control inbound and outbound access to network interfaces (NICs), VMs and subnets.
• Worked on the PowerShell Script to automate the Windows patching and created the release in Azure DevOps pipelines.
• 24/7 monitoring theAzureResources usingAzureMonitor and Web Apps for Application Insights.

Environment: Azure, Azure DevOps, .Net, PowerShell, SQL Server 2012,2008, SQL 2005,2000, Windows Server 2012, Windows 2008 R2, /2000 Server (64bit)