Senior Microsoft Bi And Azure Cloud Data Engineer Resume
SUMMARY
- Overall 10+ Years of extensive experience in IT industry, which includes Data Warehouse, Azure Data Engineering, MSBI, SQL Server, and Python.
- 9+ years of experience in extracting data from multiple data sources and loading the same into Enterprise Data Warehouse for MSBI / PowerBI / paginated reporting. Completed five full BI Implementations with Extensive experience in Analysis, Design, Development, Data conversion, Data Modeling in various domains i.e. Financial, Retail (Supply Chain, Procurement & Spend), HR, Project Analytics, Automobile Dealership Management and Healthcare.
- 3 years of experience in Cloud applications and completed 2 full end to end Azure Synapse (Data Warehouse) / PowerBI Implementation extracting data from On Perm PeopleSoft, Database, Real Time APIs, and load in Azure Synapse analytics Data Warehouse and reporting using Power BI and Azure Analysis Service. With the support of MSSQL, Azure Data Factory, Power Apps, Azure Blobs, SSIS for data Transformation.
- Good understanding of source applications like E - business suite, PeopleSoft (GL, AP, AR, OM, Projects & Procurement Modules), Siebel CRM, Flat Files and Legacy Applications & implemented Incremental vs. Full load mechanisms and have Ability to design and develop Ad hoc Reports and dashboards using PowerBI and Excel Reporting.
- Good Understanding in customizing SSIS/ADF Dataflow mappings for sourcing data from heterogeneous data sources and perform Data Conversion, Cleansing & Validation.
- Experienced in designing Star / Snowflake Schema methodologies, Data security & Object level security, scheduling, configuring SQL server Agent jobs/ADF triggers to deliver analytics content based on schedule for PowerBI, SSRS and Excel Reporting.
- Experienced in Performance Tuning with Index management strategies, Statistics, Partitions and Distributions for efficient query/report performance.
- Strong experience with SQL SERVER / ORACLE Database in writing SQL, PL/SQL, TSQL, Procedures, Functions, Cursors, Triggers and Packages, Materialized view.
- Used Code repository tools like GitHub and Microsoft Version Control.
TECHNICAL SKILLS
BI Reporting Tool: PowerBI, SSRS, SSAS, Excel Reporting
ETL Tool: SSIS, Azure Data Factory,Talend, SnowFlake and ODI
Business Domains: Financial, Procurement & Spend, Projects, HR, Sales, Marketing, Call center, Supply Chain, Manufacturing, Automobile Dealership Management, Public Safety, Healthcare.
Operating Systems: Windows 2000/2003, UNIX, Linux.
Programming languages: SQL, Python, C, C++, PL/SQL, Unix, Linux, Shell scripting, RProgramming
Databases: SQL Server, Azure Synapse, Oracle
DB Tools: SSMD, TOAD, SQL Developer, SQL*Loader
Web Technologies: Python Django, HTML, XML, Java Script, CSS.
PROFESSIONAL EXPERIENCE
Confidential
Senior Microsoft BI and Azure Cloud Data Engineer
Environment: Azure Synapse, Azure Data Factory, Azure Data Lake, Azure SQL Data warehouse, Azure Power Apps, Azure Logic apps, Power BI, SSIS, OraclePeopleSoft, ODI, BIACM, FSM, Oracle 11g (SQL/PL-SQL), SSMD, DEVOPS
Responsibilities:
- Gather Requirements from Product Owner / Business Team and prepare FDD and TDD Documents
- Prepare Data models, ELT Design Documents to extract data from Source Systems (OLTP) and Load into Data warehouse (OLAP) using the best Practices and primarily used Azure Synapse and Azure Data factory to load data into DW Tables for PowerBI Reporting
- Migrated the Data from Oracle Data warehouse to Azure Cloud Synapse Analytics
- Working on Tuning SQL queries, Maintaining Data Integrity and Data Consistency, Performance Tuning and Query Optimization.
- Writing T-SQL (DDL & DML) in Implementing & Developing Stored Procedures, Triggers, Nested Queries, Joins, Cursors, Views, User Defined Functions, Indexes, Relational Database Models, Creating & Updating tables and checking the database consistency by executing DBCC Command.
- Migrated all ODI Interfaces to Azure Data factory Pipelines
- Migrated all the Load plans in Oracle BIACM to Azure Cloud and configured Incremental and Full loads to schedule on demand
- Redesigned the BI Publisher reports to PowerBI Reports using latest architecture & created project scope document & mapping documents
- Converted all the SQL Queries which was running in Peoplesoft App Engine to SQL Server Queries and loaded the data into Azure Data warehouse and created PowerBI Reports against the same
- Involved and worked with State DBA’s in Performance Tuning of Azure Pipelines for long running jobs, Implemented complex business rules by creating optimized and efficient Pipelines
- Performed Confidential analysis on the current OBIEE reports running against the source system, identify the facts and dimensions that areneed for building the new subject areas for Reporting in PowerBI and documented Technical Design Documents.
- Developed Data, Object level security in PowerBI based on Business Unit and user groups and roles defined in LDAP and tested the same using Test Users and documented the test cases for sign off before PROD migration
- Developed and customized executive level dashboards and reports with various views such as Pivot Views, KPI’s, Charts, View Selectors, Column Selectors to provide insight of State’s data
- Migrated Azure Datafactory Code from DEV to TEST to PROD using DevOps GITHUB and Validated the code and Data after migration
Confidential, San Francisco, CA
Azure ETL and Reporting Developer / Software Engineer
Environment: Azure SQL Server Database, Azure Data warehouse, Azure Data Factory (IR), Azure Storage (BLOB) Azure Data Lake, Azure Analysis Service, Azure Virtual Machine, Azure Batch Azure Stream Analytics (Basics), Azure Function (Basics), Azure HDInsight cluster Python, Power BI
Responsibilities:
- Gather requirement from Product Delivery Manager (PDMs) and Business users and document in confluence.
- Co-ordinate with Vendor Company’s like Courier Services, Warehouse Team, Call Center Team and define contracts for the source data format.
- Prepare data model and define schema with all best practices.
- Follow Confidential naming standards for SQL tables, columns and other objects.
- Apply normalization, index, partitions as necessary to achieve data retrieval and DML performance.
- Define Log tables, ETL control tables, MDM tables as required.
- Develop Extract Transform Load flows for different source systems.
- Test the code, record test results and test cases.
- Execute ETL code and load data from source to reporting Datawarehouse/database.
- Transform history data manually and load.
- Develop code to automate the manual data load process.
- Use MDM tables to achieve code re-usability.
- Create view to expose data to reporting tools.
- Develop Power BI reports, dashboard.
- Use DAX to achieve complex business formulas, rules and requirements.
- Use bookmark in Power BI to show/hide visuals to achieve user requirements and make reports user friendly.
- Implemented drill down, button action, Visual interaction and almost all major visuals and slicers.
- Used GitHub- version control, JIRA agile process, Confluence - Documentation, CA Workload automation- Scheduling agent, Zoom - Team socializing, etc.
Confidential, San Francisco, CA
MSBI Developer / Software Engineer
Environment: Microsoft Business Intelligence SQL Server Integration Service, SQL Server Reporting Service, SQL Server Analysis Service, Microsoft SQL Server 2016, T-SQL, MySQL, Teradata, Talend (ETL), CAWA (Work load Automation tool), C#, Azure SQL DB, Azure Data Factory. Azure Functions, Microsoft Power BI, Microsoft SQL Server 2016 Mobile Reports. Azure BLOB storage
Responsibilities:
- Responsible for ETL data from Teradata to Azure SQL DB and Azure SQL Data warehouse.
- Used Talend and MySQL for 1st level ETL and used Azure Data factory and SQL Stored procedures as 2nd level ETL.
- Used dynamic query generation in SQL Stored procedures to form KPI structured data format.
- Used API to expose data to front end.
- Used CAWA to schedule job steps, ETL process, KPI process.
- Used Jenkins CICD for migrate code to different environments.
- Used GitHub to maintain, track the code base.
- Reviewed and fine-tuned stored procedures and triggers before production migration.
- Involved in the Requirement Analysis, Design phase and Development phase of SDLC model system.
- Worked closely with Business Analysts to produce all required documentation.
- Worked with Product Development Team to architect Database Design and strategy
Confidential, Moorestown, NJ
MSBI Developer / Senior Software Engineer
Environment: Microsoft Business Intelligence, SQL Server Integration Service, SQL Server Reporting Service, SQL Server Analysis Service, Microsoft SQL Server 2008 R2, T-SQL, C#, Microsoft Power BI, Crystal Report 11
Responsibilities:
- Involved in the Requirement Analysis, Design phase and Development phase of SDLC model system.
- Worked closely with Business Analysts to produce all required documentation.
- Worked with Product Development Team to architect Database Design and strategy.
- Worked with Business Users to architect Data Warehouse strategy based on reporting, analytical and dashboard requirements
- Worked with DBA's to create a best-fit Physical Data Model from the logical data model.
- Developed database objects such as Stored Procedures, Functions, Tables and Indexes using T-SQL and SQL Analyzer.
- Created, insert, update and delete triggers on some tables in order to capture any DML activities happening on some crucial and confidential data.
- Improved Performance by creating Clustered and Non-clustered Indexes
- Creating the OLAP cubes using various dimensions and creating SQL Server Analysis Projects using SSAS 2008. Adept in defining referenced relationships and calculated members in SSAS, creating OLAP structures from OLTP database.
- Developed SSIS package to Export and Import data from SQL Server to Access, Text and EXCEL files and Configured SQL mail agent for sending automatic mails.
- Involved in deploying, configuring and managing reports using Report Manager and Report Builder.
- Increased query performance, necessary for statistical reporting by more than 25% after performance monitoring, tuning, and optimizing indexes using Performance Monitor, and Index Tuning Wizard.
- Created OLAP models based on Dimension and Facts for efficient loads of data based on Star Schema structure.
- Configured and maintained Report Manager and Report Server for SSRS.
- Worked on the Reports module of the project as a developer on MS SQL Server 2012 (using SSRS, T-SQL, scripts, stored procedures and views)
- Reviewed and fine-tuned stored procedures and triggers before production migration.
- Converting Crystal reports to SSRS reports.
Confidential, San Francisco, CA
MSBI Developer / Software Engineer
Environment: Microsoft Business Intelligence SQL Server Integration Service, SQL Server Reporting Service, SQL Server Analysis Service, Microsoft SQL Server 2016, T-SQL, C#, Microsoft Power BI, Microsoft SQL Server 2016 Mobile Reports.
Responsibilities:
- Participated in Database Design and Code Reviews to ensure optimum Performance.
- Using SSIS to create ETL packages to Validate, Extract, Transform and Load data to Data Warehouse and Data Mart Databases.
- Responsible for leading and coordinating cross functional teams on a project basis to effectively communicate database design related activities with a wide range of technical, non-technical, and third-party team members.
- Experience Working with Stored Procedures, Formulated Stored Procedure/T-SQL coding, Performance Tuning and Query Optimization.
- Involved and hands on development in every phase of the project right from Requirements Analysis, Scoping, Designing, developing (SSIS, SSRS, and SSAS) Debugging, Testing and Documentation, deployment and UAT.
- Using SSIS/ETL transformations to implement the Slowly Changing Transformation, to maintain Historical Data in Data warehouse.
- Implemented Configuration on SSIS packages for deploying onto different environments, error handling, error logging, and notifications.
- Designed SSIS Packages to transfer data between servers, load data into database, archive data file from different DBMS using SQL Enterprise Manager/SSMS on SQL Server 2012/2008 environment and deploy the data. Used Event Handlers for Exception Handling in SSIS packages.
- Created User Defined Functions, Triggers to store data into appropriate tables when data arrives and created indexes to the tables that have least updating to improve the query performance.
- Worked with Business Analyst and Business Users in requirements gathering phase actively cataloging and supporting various issues and providing their solution.
- Excellent in rendering reports, managing Data Driven subscriptions, creating reports with report builder.
- Implemented several reports such as drill down reports, parameterized reports, linked reports, sub reports, Matrix Reports and Chart reports using SQL Server Reporting Services sourcing from the Data Warehouse and OLAP Cubes.
- Created dashboard SSRS reports under report server projects and publishing SSRS reports to the report’s server.
Confidential
MSBI Developer / Software Engineer
Environment: .net, VB.net, HTML, Javascript, Microsoft Business Intelligence, SQL Server Integration Service, SQL Server Reporting Service, SQL Server Analysis Service, Microsoft SQL Server 2008 R2, T-SQL, C#
Responsibilities:
- Involved in the Design phase and Development phase of Agile SDLC model system.
- Developed various T-SQL objects such as Functions, Tables, Views, Constraints and created Dynamic and Static Stored Procedures and Queries to develop Decision Engine.
- Developed, monitored and deployed SSIS packages for Dynamic ETL flow to validate, extract, transform and load data into database.
- Performed Full load & Incremental load with several Data flow tasks and Control Flow Tasks using SSIS.
- Created SSIS package to Export and Import data from SQL Server to Access, Text and Excel files and Configured SQL mail agent for sending automatic mails.
- Configured Connection Manager files for SSIS packages to execute on QA server and Production server.
- Developed Parameterized, Drill-through, and Drill-down Reports to get monthly customers account details and profits using SSRS.
- Involved in deploying, configuring and managing reports using Report Manager and Report Builder.
- Reviewed and fine-tuned stored procedures and triggers before production migration.
- Collaborated with the .NET developers and involved in developing web services.
Confidential
MSBI Developer / Software Engineer
Environment: .net, VB.net, HTML, JavaScript, Microsoft Business Intelligence, SQL Server Integration Service, SQL Server Reporting Service, SQL Server Analysis Service, Microsoft SQL Server 2008, T-SQL, C#
Responsibilities:
- Created User Defined Functions, Triggers to store data into appropriate tables when data arrives and created indexes to the tables that have least updating to improve the query performance.
- Worked with Business Analyst and Business Users in requirements gathering phase actively cataloging and supporting various issues and providing their solution.
- Developed, monitored and deployed SSIS packages for Dynamic ETL flow to validate, extract, transform and load data into database.
- Performed Full load & Incremental load with several Data flow tasks and Control Flow Tasks using SSIS.
- Created SSIS package to Export and Import data from SQL Server to Access, Text and Excel files and Configured SQL mail agent for sending automatic mails.
- Configured Connection Manager files for SSIS packages to dynamically execute on Quality Analysis server and Production server.
- Involved in deploying, configuring and managing reports using Report Manager and Report Builder.
- Reviewed and fine-tuned stored procedures and triggers before production migration.
- Developed Parameterized, Drill-through, and Drill-down Reports to get monthly customers account details and profits using SSRS.