SUMMARY

• Overall, 8 + years of IT development experience wif Strong Experience in Data Engineering & Cloud architectures.
• Hands - on experience in setting up the Azure Data factory and creating the ingestion pipelines to pull data to Azure Data Lake Store and Azure Blob Storage.
• Experience in migration of on-premises databases to Microsoft Azure environment (blobs, Azure Data Warehouse, Azure SQL Server, PowerShell, and Azure components).
• Skilled in Azure, Azure Data Factory (ADF), Databricks, SQL Databases.
• Proficient in managing Azure Data Lakes (ADLS) and Data Lake Analytics and an understanding of how to integrate wif other Azure Services.
• Create ADF pipelines to schedule batch jobs.
• Expertise in building database services like Azure SQL server and Managed Instances, Azure Synapse, Azure Cosmos DB for handling the data in different projects.
• Utilize python/pyspark in Databricks notebooks when creating ETL pipelines in Azure Data Factory.
• Knowledge of Azure DevOps including CI/CD pipelines.
• Experience in developing scripts using Python or Shell Script for ETL process.
• Responsible for transforming raw data into business-related flattened files using Azure Databricks.
• Knowledge of database concepts, including normalization, indexing, physical and logical modeling, creation of SQL queries and performance tuning.
• Experience in all stages of SDLC (Agile, Waterfall), writing Technical Design documents, Development and Testing.
• Experience wif Python, Pyspark, Azure Cloud, Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, Azure Analytical services, Big Data Technologies (Apache Spark), and Databricks is preferred.
• Worked wif small and medium sized agile groups in two weeks’ sprints.
• Participated in Sprint planning, daily scrum, Sprint demos and Retrospectives.
• Good Interpersonal skills and ability to work as part of a team. Exceptional ability to learn and master new technologies and to deliver output in short deadlines.

TECHNICAL SKILLS

• Azure Data Bricks
• Azure Data Factory
• Azure Data Lake
• Azure Synapse
• Azure Cosmos DB
• Terraform
• SQL
• Python
• HMTL5
• CSS3
• TFS
• Git.

PROFESSIONAL EXPERIENCE

Confidential, Woonsocket, RI

Azure Data Engineer

Responsibilities:

• Created and implemented Azure Data Factories for various groups for their serverless data integration from multiple data sources.
• Data is processed using Azure Databricks and ingested to Azure services like Data Lake, Azure data lake Analytics, Azure SQL Database etc.
• Used terraform to create data factories, storage accounts, key vault access.
• Created linked services to snowflake, blob storage, SQL database.
• Scripted manually created pipelines via terraform to migrate across multiple environments.
• Write Databricks notebooks (python) for handling large volume of data, transformations and computations.
• Extensively worked on Accessing, Processing, Transforming and Analysis of big data using Databricks.
• Working knowledge in Python programming wif a variety of packages such as NumPy, Matplotlib, SciPy, and Pandas.
• Azure infrastructure creation was done wif Terraform (IaC), and YAML pipeline configurations.
• Extract Transform and Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL and Azure Data Lake Analytics.
• Working wif different data storage options including Azure Blob, ADLS Gen-1, and Gen-2.
• Experience in bulk importing csv, xml and Flat files data using Azure Data Factory.
• Complete automation of CI/CD process using Azure DevOps tools.
• Work closely wif product owners and Architects to develop the critical Azure Data factory pipelines.

Confidential, Fort Lauderdale, FL

Azure Data Engineer

Responsibilities:

• Created the pipeline and moved the on-premises Data to Azure cloud using Azure Data Factory (ADF).
• Manage and Create Storage Account and Affinity Group in Azure Portal.
• Used Databricks to read data from multiple data sources such as Azure Blob Storage, Azure Data Lake Storage and Azure SQL Data Warehouse.
• Good experience working wif Azure Cloud Platform services like Azure Data Factory (ADF), Azure Data Lake, Azure Blob Storage, Azure SQL Analytics, HDInsight/ Databricks.
• Performing statistical data analysis and data visualization using Python and R
• Used a blend of Azure Data Factory, T-SQL, Spark SQL, and U-SQL Azure Data Lake Analytics, gather, convert, and load the data from source systems to Azure Data Storage services.
• Creating and Modifying Tables, Stored Procedures, Views, Indexes, User-defined Functions, and Triggers as required.

Confidential, Dallas, TX

Azure Engineer

Responsibilities:

• Implemented Continuous Integration and Continuous Deployment (CI/CD) using Azure Pipeline.
• Created manual Testcases to check dat each of the deliverables meet user’s requirement.
• Worked on Microsoft Azure (Public) Cloud to provide IaaS support to clients.
• Exported Hadoop ETL data to the relational database using Sqoop for visualization as an input data to the Tableau dashboards.
• Create Virtual Machines through PowerShell Script and Azure Portal.
• Convert existing Virtual Machine from Standard to Premium Storage Account. Patching and Validating of Virtual Machine in Azure
• Used Azure Security Center for hardening entire Azure Infrastructure

Confidential, Atlanta

Programmer Analyst

Responsibilities:

• Wrote and executed various MYSQL database queries from Python using Python-MySQL connector and MySQL database package.
• Developed Python application for Google Analytics aggregation and reporting.
• Used Python scripts to update content in the database and manipulate files, build the python coding for data management and analysis and presented to the different business units Implemented configuration changes for data models, worked on the data management.
• Responsible for Design and development of web applications using HTML5 and CSS3.
• Developed monitoring and notification tools using Python.