We provide IT Staff Augmentation Services!

Senior Cloud Data Engineer Resume

SUMMARY:

  • SENIOR CLOUD BI ENGINEER with 8+ years of experience in the field of Data Engineering and Business Intelligence, specializing in OLTP, OLAP and Data Warehouse systems design, development, and management. In - depth noledge and extensive experience in Data Modeling
  • Database Design, Performance Turning, Data Engineering, ETL Workflow design, Data Mart, Data Warehouse implementation and Report Writing via both on-prem IT infrastructure and Cloud Platforms such as Microsoft Azure and AWS.

TECHNICAL SKILLS:

Scripting Languages: T-SQL, PL-SQL, MYSQL, AWS Redshift, C#, Python, JS, PowerShell, DAX, VB.NET, HTML, CSS, JavaScript, ASP.Net.

BI Stack: SQL Server, MySQL, Oracle, IBD DB2, SSIS, SSRS, SSAS, Power BI, Tableau, Cognos, Crystal Reports, DOMO. Azure DevOps, Agile Methodology, Visual Studio, TFS, GitHub, Git Bash, Git Kraken, CICD pipelines.

Cloud Engineering: Microsoft Azure SQL IAAS/PAAS/IAAS, Azure Synapse, Azure Data Lake, Azure Blob Storages, Azure Data Factory V2, Azure PowerShell, Azure Key Vaults, Azure Logic Apps, Azure Function Apps, Azure Runbooks, Azure Databricks. AWS MySQL RDS, AWS Redshift, AWS S3, AWS EC2.

Data Domains: Sales, E-Commerce, Supply-Chain, HR, Finance, Accounting, Loan, Manufacturing, Healthcare, Insurance, Energy, Procurement.

PROFESSIONAL EXPERIENCE:

Confidential

SENIOR CLOUD DATA ENGINEER

Responsibilities:

  • Served as Senior Cloud Data Engineer for implementing AzureCloudDataPlatform & Services. AzureDataFactory,AzureDataLakes,AzureDatabricks, Python, Spark,AzureSynapse, and Power BI.
  • Worked closely with thedataanalysts to get business requirements, design, and develop Power BI reports and create Power BI Service Workspaces with dashboards, reports, datasets from scratch.
  • Played an important role in migrating on-premises IT infrastructure to Microsoft Azure Cloud and built Azure Environments from scratch. Experience in migrating on premise to Windows Azure in Active Directory on cloud using Azure Recovery Vault and Azure backups.
  • Strong experience in Extracting, Transformation and Lading (ETL)datafrom various sources intoDataWarehouses andDataMarts using ETL tools such as Azure Data Factory, SSIS and Custom Scripts.
  • Create CICD Terraform automation scripts utilizing Azure Blob Storages, Azure Data Factory (ADF), Azure Resource Groups, AAD Groups, Azure Data Lake, Azure SQL, Cloud Services and (ARM), Azure Synapse SQL Pool, Function App, Logic App, Azure Purview.
  • Designed Data Pipelines for ADF ETL Jobs using LOOKUP, FOREACH, COPY, GET METADATA ACTIVITIES and load data int ADLS Gen 1 and Gen 2, Synapse SQL Pool and Azure SQL PAAS.
  • Deployed DATABRICKS NOTEBKS using Programming language and SPARK FRAMEWRK.
  • Worked on Serverless services (Azure Functions) created and configured HTTP Triggers in the Azure Functions with Application Insights for system monitoring.
  • Executed Power Shell Scripts to move Data from Lower to Higher Environments.
  • Perform problem assessment, resolution, and documentation in existing ETL packages, mapping, and workflows in production of ADF ETLs, Azure Function Apps and Logic Apps.
  • Implement and enhance the automated release process by which Azure DevOps (ADO) offering software flows from the developers to the customers. Defined the next generation CI/CD process and support test automation framework in the Microsoft cloud as part for the build engineering team.
  • Identify, develop, and implement measures dat transform and evolve the enterprise with innovative cloud solutions theirby changing the status.
  • Drive identity and access AD configuration management, and monitoring strategy for Azure.
  • Utilize native Azure services to meet the business’ technology and resiliency requirements.
  • Dynamic and result-oriented IT Professional with good experience in implementing/administering/supporting/automating Infrastructure and Code deployments in Cloud.
  • With a total IT experience of 5 yrs. in Deploying, Maintaining, provisioning the

    Infrastructure of MicrosoftAzureservices likeAZUREDevOps.

  • Designed and Developed BI concepts and practices of physical and Logical data model design (star and snowflakes) including multidimensional and relational reporting and analysis techniques Designing, developing, and maintaining user-friendlydatavisualizations and dashboards using complex datasets from different sources.
  • Designed and Developed Data Marts, Operational Data Store (ODS), SSAS Tabular/Cubes, Dimensional Modeling, Star Shema, Snowflakes Schema and Fact Constellation/Galaxy Schema.
  • Designed and Built Data Analytics reports using Power BI (utilizing DAX Expressions, Power Query, Power Pivot, Power BI Desktop) and SQL Server Reporting Services (SSRS).
  • Developed Complex calculated Measure, Calculated Column and Role level security using DAX.in Power BI Desktop, complex visuals in Power BI Desktop, scheduling reports in Power BI Service, implementing Power Query, Power Pivot and Excel.

Confidential, BROOKLYN, NY

DATA DEVELOPER

Responsibilities:

  • Worked with internal stakeholders to create and scape the requirements of the data platform.
  • Involved in full System Development Life Cycle (SDLC) including requirement gathering, analysis, design, development, testing and implementation of various medium and large-scale client/server applications in structured development environment.
  • Worked with the infrastructure team to maintain databases, design ETLs and build Analytics Reports.
  • Involved in complete SDLC life cycle during requirement collection, analysis, design, and development of BI solutions.
  • Used SSIS and T-SQL stored procedures to transfer data from OLTP databases to staging area and finally transfer int data warehouse.
  • Created very complex SSIS Packages with considering all the best practices like error handling, logging, configurations, deployments, maintenance.
  • Deployed SSIS packages to various environments like Dev, QA, UAT, PT and production using indirect XML and SQL server configuration.
  • Used various Data Flow Transformations, like Lookup, Derived Column, Data Conversion, Union All, Multicast and Copy Column while developing the packages.
  • Scheduled and executed SSIS Packages using SQL Server Agent configuration in XML and used them to deploy packages int SQL server
  • Created various SSRS Reports involving variety of features like Graphs, Filters, Sub-Reports, Drill down, Drill-Through, Multi-valued parameters using MS SQL Server) as a source system.
  • Created complex Stored Procedures, Triggers, Cursors, Tables and other SQL Joins and Statements for Applications by using T-SQL.
  • Creating ETL packages to validate, extract, transform and load data-to-data warehouse databases using SSIS.
  • Create SSIS packages using different sources and transform data using transformations, tasks, and containers such as Derived columns, Data Conversion, Merge Join, Conditional Split, Look Up, Sort, Union All, Multicast, File System Task, Script Task and Send Mail Task.
  • Scheduling Jobs and Alerting using SQL Server Agent.
  • Implementing Cloud Data solutions utilizing on-prem and cloud solutions. Extensive experience with Microsoft Azure ecosystem such as: Power Bi Service, Azure SQL Server, Azure SQL IAAS/SAAS/PAAS, AWS RDS SQL server, MySQL, Amazon Redshift, AWS EC2, AWS S3 buckets.
  • Clean and transformed data from staging tables base on business requirements using various transformations and load them into data warehouse.
  • Analyzed business requirements, worked closely with business users to understand business requirements, designed process for data extraction, business logic implementation, and loading into target tables.
  • Identified dimensions, Fact tables and designed data mart.
  • Created Stored Procedures, User Defined Functions, Views, and database triggers to check referential integrity of database.
  • Generated SSRS and Tableau reports, maintaining dimensional as well as relational data structures and managing operational data store and data warehouse. Utilized comprehensive understanding of data types and best practices for organization and display. Used SSRS to generate Sub-Reports, Drill down, Drill-through, and Parameterized reports.
  • Assisted users in accessing databases, troubleshooting malfunctions, and removing system-based barriers to task completion. Mapped data between source systems and warehouses. Prepared functional and technical documentation data for warehouses.
  • Cooperated fully with product owners and enterprise architects to understand requirements. Validated warehouse data structure and accuracy. Developed and modified programs to meet customer requirements.