Azure Data Engineer Resume
5.00/5 (Submit Your Rating)
SUMMARY
- Microsoft Business Intelligence Developer with 4 years of experience seeking to obtain a position as a developer to utilize my knowledge, previous work experience, and my technical skills in Business intelligence tools and system analysis. To gain the knowledge and understanding of Business Analysis process more deeply and the requirements for projects planning.
- Experienced with receiving and monitoring data from multiple data sources, including MSSQL, SSIS, SSRS, Power BI. Profound knowledge in industry - specific data such as above mentioned.
- Experienced in database design, development, and business intelligence of Microsoft SQL Server in development, test, and production environments.
- Expertise in T-SQL, SQL Server Integration Services (SSIS), Azure Data Factory (ADF), with good knowledge on SQL Server Analysis Services (SSAS), SQL Server Reporting Services (SSRS), Power BI and etc.
- Extensive knowledge and Experience in dealing with Relational Database Management Systems including Normalization, Clustering, T-SQL, Stored Procedures, Constraints, Querying, Joins, Keys, Indexes, Data Import/Export, Triggers and Cursors and various SQL server objects like schemas, tables, User Defined Data Types, Indexes, Indexed Views, Functions, CTE (common table expression), Table Variables and Stored Procedures.
- Developed physical data models, created DDL (Data Definition Language) scripts and DML (Data Manipulation language) scripts to manipulate the SQL Database.
- Experience in data analysis SQL server database development and maintenance, data modeling that support day to day business operations and auditing of database for user transactions, login and database action and removing orphan users.
- Experience in creating ETL process, Data warehousing, Operations Data Store concepts, data marts and OLAP technologies, Including Star and Snowflake schema.
- Excellent in High Level Design of ETL DTS Packages & SSIS Packages for integrating data using OLE DB connection from heterogeneous sources like (Excel, CSV, SQL Server, MySQL, Oracle, flat file, AWS, Azure, ERP systems, DB2, Salesforce, CRM and etc.) by using multiple transformations provided by SSIS.
- Experience in implementing various SSIS features like Event Handling, Precedence Constraints, Breakpoints, Checkpoints, and Logging for Complex SSIS Packages.
- Skillful in report development using SSRS/Power BI and creating various types of reports and dashboards with drill down/through, parameterized, cascading, conditional, slice and dice, bookmark, ad-hoc and sub reports features.
- High-level experience in writing DAX in Power BI and Expert in fine tuning the reports.
- Experience with Microsoft Azure ecosystem such as: ADF V2, Azure SQL Server, Azure SQL IaaS/SaaS/PaaS, Azure SQL DW, Azure Blob, Azure Synapse, AKV Management
- Hands-on experience with Azure Data Factory V2, Data Flows, Snowflake, Azure Data Lake, Azure analysis services.
PROFESSIONAL EXPERIENCE
Azure Data Engineer
Confidential
Responsibilities:
- Attended daily scrum meetings, discussed new requested features/user-stories/tasks with Business Analysts and updated the status of tasks assigned on Agile Platform.
- As a key developer, delivered the best results to the developmental needs, accomplished successful outcomes by working with SQL, SSIS, Power BI, ADF2, SSAS, and other Azure tools.
- Assisted and supported the Project Manager in leading multi-functional project teams in implementing data conversion strategies and communicating essential information to team members.
- Implemented performance tuning on complex stored procedures, views, user defined functions and queries by creating proper indexes and optimizing the existing ones.
- Strong experience with SQL Server and T-SQL in implementing, maintaining developing Stored Procedures, Triggers, Nested Queries, Joins, Views, User Defined Functions, Indexes, User Profiles, Relational Databases Models, creating and updating tables and checking the database consistency by executing DBCC commands.
- Migrated on-premise SQL server schemas to the cloud on Azure SQL Server and maintained databases across both on-premise and cloud deployments.
- Built efficient ETL packages, using both SSIS and ADF2 pipelines for processing Fact and Dimension tables with complex transforms and SCD type 1/ type 2. Build workflows to automate data flow using Python and ADF2.
- Performed incremental data loading in order to synchronize data changes between OLTP and OLAP databases using SSIS packages, execute SQL task and merge.
- Send email notifications about ETL issues reports to development team by using Send Mail Task/Script Task/Execute SQL Task along with system stored procedure to send emails.
- Designed and developed various SSIS packages. Involved in automating SSIS Packages using SQL Server Agent Job, Windows Scheduler and third-party tools. Worked on several transformations in Data Flow including Derived-Column, Script, Slowly Changing Dimension, Lookup, Data Conversion, Conditional-Split and etc.
- Provided performance tuning within SSIS packages and SQL Stored Procs, Views, Inline and Dynamic Queries.
- Involved in building Power BI and Tableau reports/dashboards for different domains such as Finance, Accounting, Management, and other client teams.
- Actively participated in migration of on-premise SQL Server schemas to cloud on Azure SQL Server DB and Azure VM and developed and maintained databases across both on-premise and cloud deployments.
- Experienced in Cloud implementation for BI platforms using Azure SQL PAAS/SAAS/IAAS, Azure Synapse and Azure Data factory.
- Configured Azure platform for data pipelines, ADF, Azure Blob Storage and data lakes. Build workflows to automate data flow using ADF.
- Performed incremental data loading in order to synchronize data changes between OLTP and OLAP databases using SSIS packages, execute SQL task and merge.
- Used Power Query to acquire data, developed calculated columns and measures using DAX in Power BI desktop for designing rich visuals using visualizations such as Bar chart, Clustered Column Chart, Waterfall Chart, Gauge, Pie Chart, Tree map.
- Applied row level securities (RLS) in all Power BI reports by creating user roles and added users to AD Groups with the help of Office 365 and Azure Active Directory and assigned the certain groups to certain roles to provide limited access as per user organization level with the help of mapping tables.
- Performed code review for junior SQL developers to validate their code both performance wise and result wise.
- Provided support and guidance to other members of the BI team on separate projects.
BI Developer
Confidential
Responsibilities:
- Analyzes complex data sets and extracts actionable insights using various economic, financial, customer and marketing methodologies.
- Synthesizes data, insights, and consumer research to create presentations that make fact-based recommendations.
- Worked with the Marketing Analytics leadership to communicate and recommended approaches to senior leaders and anticipate the future needs of our customers.
- As a key member of BI team, delivered the best results to the developmental needs, accomplished successful outcomes by working with SQL, SSIS, SSRS and Power BI.
- Created SSRS and Power BI reports such as Resource Management Reports for HR department that shows KPI’s of different projects, number of employees worked in that project, sick leaves, PTO’s so on. Also created Expense Report for HR department that shows how their budget is being used on monthly basis on social events, training programs and different cultural enrichment projects etc.
- Hands-on experience on Azure Data Factory and Azure Data Lakes.
- Experienced in Cloud implementation for BI platforms using Azure SQL PAAS/SAAS/IAAS,Azure Data factory and Azure Synapse.
- Advanced skills leveraging Azure DevOps technologies and principles to efficiently coordinate, and accurately deliver refined process code.
- Have a strong experience in designing Data Lake Platforms on AWS(including Cost Analysis), using services such as AWS Glue, Lambda, Redshift, Athena, S3, DMS, etc.
- Created internal SSRS and Power BI reports for development team such as ETL Statuses/ETL Failures Report that shows the ETL issues that we captured at runtime about Control Flow Tasks and Data Flow Transformations when we run ETLs.
- Gathered and analyzed business requirements and translated business needs into long-term business intelligence solutions.
- Involved in creating interactive, accurate, insightful, and well- organized Power BI reports/dashboards to support businesses in their data driven strategic planning.
- Built custom and efficient stored procedures, CTE’s, functions (UDF), DML triggers, indexes, tables, views as part of the project.
- Worked as a SQL Developer, Project included developing complex SQL queries, integration and reporting and coordinating with the offshore team.
- Filtered bad data from legacy system using complex T-SQL statements, and implemented various constraints and triggers for data consistency.
- Created ER diagrams, Dimensional Modeling using MS Visio, Erwin and Toad.
- Created Views to enforce security and customized data access.
- Developed various SSIS packages (ETL) by using all Visual studio components for Integration services for example Control flow and various tasks like Data Flow/Execute SQL/Expression/File System Tasks and For Loop Container, Foreach Loop Container, Sequence Container.
- Performed ETL solutions for integrating data from multiple sources like SQL Server, Flat Files (delimited, fixed width), Excel, Raw File, Oracle 11g, DB2, SAP, XML files, and SharePoint Lists into the central OLTP database, UAT and Production environments.
- Applied various data cleansing and data transformations like Slowly Changing Dimension (SCD), Derived column, Aggregate, Sort, Multicast, Conditional Split, Union All.
- Staged data from various sources in designing and building warehouse Dims and Facts with Full & Incremental Loads and populated data in the appropriate destination tables.
- Created SQL Server jobs and scheduled them to load data during off-peak hours using SQL Server Agent.
- Provided performance tuning within SQL, SSIS, Power BI and SSRS.
- Performed troubleshooting for the project assigned personally to me and projects assigned to the other BI team members.
- Coordinate with a team of analysts to provide post analysis for casino events, promotions, and shows.
- Performs ongoing analysis of segment and offer performance, including A/B Test results.
- Balances new insight against current projects and continually seek innovation through ongoing networking and research efforts.
- Partners with Regional properties in marketing strategy meetings for collaboration.
- Identifies business requirements and collaborates with the Enterprise Reporting team in pass-off of requirements for execution and BI / IT development.
Business Intelligence Developer
Confidential
Responsibilities:
- Involved in developing systems with a high level of performance and reliability.
- Evaluating Source systems, standardizing received data formats, understanding business/data transformation rules, business structure and hierarchy relationships.
- Created constraints, defaults, rules, and triggers to maintain the referential integrity of the database.
- Involved in loading flat files, excel sheets into the OLTP database. Also, developed T-SQL stored procedures/functions/expressions, CTEs, indexed views, stage tables to process the data and populate them in the appropriate destination tables.
- Created Sub-queries and Joins for complex queries involving multiple tables from different databases. Daily support of system wide replication tasks including monitoring, alerting, and problem resolution.
- Created indexes and views, stored procedures to enhance database/application performance.
- Interacted with developers on various aspects ranging from usage of utilities to SQL performance, test data and general troubleshooting.
- Developed ETL packages to extract, transform and load into Data ware house using of SQL Server Integration Services (SSIS).
- Involved in design and creation of data mappings from sources like Flat files, DB2, Excel files, OLEDB and ODBC data sources which contains bulk data.
- Deployed SSIS packages into various Environments (Development, Test and Production) using Deployment Utility.
- Built efficient SSIS packages for processing Fact and Dimension tables with complex transforms and type 1/ type 2 changes.
- Converted old ETL packages to the new version (did optimization by applying more stored procedures instead of using control flow tasks).
- Created Incremental Load ETL packages using For Each Loops, Sequence Containers, Script Tasks, Conditional Split, Data Conversation, Derived Column, Lookup, Merge/Merge Join, Union all, etc. on BIDS 2008R2/2012.
- Solved many critical/challenge issues raised by the team about ETLs.
- Participated in formal and informal training programs to improve technical skills and knowledge of all programmers.
- Performed Data Mapping, Normalization, Batch jobs, Troubleshooting, Data migration, Data collation, Data cleansing, Entity Relationship Design (ERD) model and application-oriented design.
- Designed and implemented data mart, facts, dimensions and OLAP cubes using dimensional modeling standards in SQL Server that maintained data. Involved in the complete data warehouse development life cycle. Actively supported business users for change requests.
- Involved in designing, developing, debugging and testing of reports in SQL Server Reporting Services (SSRS). Creating reports for customized and ad-hoc Queries.
- Experience in creating Parameterized reports and Linked reports with thorough knowledge of report serving architecture (table, chart and matrix report).
- Assisted in production OLAP cubes, wrote queries to produce reports using SQL Server Analysis Services (SSAS) and Reporting service (SSRS) Editing, upgrading and maintaining ASP.NET website and IIS Server.
- Created SQL server MDS 2012 Web App that integrates with Add-in Excel and right SQL Server database.
- Strong applications development experience with back-end databases such as SQL Server, SQL MDS 2012, Oracle and MS Access using ADO/ADO.NET OLEDB and SQL client.
- Strong skills in transformation data from DB2 to SQL Server.
- Configured dimensional modeling for end users from hierarchy perspectives.
