We provide IT Staff Augmentation Services!

Azure Data Engineer Resume

5.00/5 (Submit Your Rating)

Houston, TX

SUMMARY

  • Having around 8 years of experience in System Analysis, Design, Development, Implementation and testing and support of Databases, Data Warehouse Applications on Client server technologies using Azure Data Factory, Blob, SQL DW, SQL Server & MSBI, Power BI in Supply Chain, Financial and Insurance & Oil - Energy domain.
  • Experience in working predictive analytics projects in developing large datasets in Cloud using Azure Data Factory/Blob/Data Lake/Apps and SQL DW.
  • Good Knowledge working on Azure Data Bricks.
  • Good Knowledge in working on Python Scripts.
  • Experienced in Microsoft SQL Server, SSIS, SSRS, SSAS 2005/2008R2/2015/2017 to develop database, data warehouse, ETL packages, Web Based Reports and OLAP Cubes for data slicing and dicing.
  • Having experience in designing dimensional data model.
  • Experience in working wif multiple databases DB2, Oracle, Microsoft SQL Server, and Sybase.
  • Experienced in Development phase, database testing and Production support of different applications.
  • Worked wif Business Analysts in gathering requirements and translating them to technical specifications.
  • Good hands on dealing wif Offshore Onsite teams in development, support and quality analytics.
  • Experienced in developing Staging, Operational Data Source, Data Mart Layers, snow flake schema and star schema databases to develop a successful data warehouse.
  • Having noledge on Cloud Enterprise Data Warehouse (EDW) to develop and work wif cloud database.
  • Experience in developing Relational databases, developing Normalized and De Normalized databases.
  • Experience in writing SQL scripts for views, stored procedures, user defined functions, triggers, cursors etc.
  • Experience in writing SQL queries using Joins, Sub queries, Correlated sub queries and other complex queries.
  • Expertise in Query tuning and performance improvements in cases of long running SQL Query’s by analyzing Execution plans and implementing indexes and optimizing query.
  • Extensive experience wif SSIS tool to extract data from one or more sources dat can be databases, flat files, Excel, FTP files etc. Transform source data by cleansing raw data into standardize, convert data types, and fix data using controls like Lookup, Merge, Execute SQL task, Script task, data conversion, Union all etc. to Load into one or more destinations. Those destinations can be a relational, data warehouse, and File system.
  • Experienced wif SSIS performance tuning and optimization in control flow & data flow.
  • Expertise in Error handling, logging and event handler, fixing issues of failed SSIS packages, configured checkpoints and troubleshooting, debugging the data flow by using data viewers.
  • Good hands in development and defect resolution on existing ETL processes.
  • Expertise in defining script task using Programming languages VB.Net and C#.Net.
  • Experience in developing Web enabled reports using SQL Server Reporting Services based on business requirements.
  • Expertise in creating main reports wif dash boards and providing links to access its sub reports.
  • Expert in generating on-demand and scheduled reports for business analysis or management decision using SQL Server Reporting Services 2008/2005, Crystal Reports and Excel spreadsheet.
  • Experienced wif tabular Models to SSRS reports for analysis based on different data volumes.
  • Expertise in using variables, expressions, functions for the reports and in handling Parameterized reports in SSRS.
  • Expertise in providing security to reports by creating rules and adds users to relevant rules according to their profile.
  • Experienced in developing SSAS Cubes which is used to create fast executed reports wif history of data.
  • Extensive experience in creating, maintaining, processing of cubes using SSAS.
  • Expertise in creating measures, measure groups, dimensions, KPIs, partitions and Aggregations in SSAS cube.
  • Expertise in designing Hierarchies, Attribute relationships of dimension in a cube.
  • Good hands on creating calculated columns using MDX language.
  • Expertise in creating roles on cubes to give permissions to access cubes.
  • Responsible for the creation and the maintenance of Analysis Services objects such as cubes, dimensions and MDX queries.
  • Used Power BI Power Pivot to develop data analysis prototype, for advanced visualize reports.
  • Strong noledge in working wif Power pivot, Power Query and Power view.
  • Making data visualization in a variety of ways of multiple visualizations using Power BI. Strategic expertise in design of experiments, data collection, analysis and visualization.
  • Experience in writing DAX expressions for the creation of calculations and measures in the Tabular Models.
  • Good noledge on Azure data factory for Data transfer from On-Premise servers to Azure SQL DB.
  • Passionate to build data products and data systems by using cloud technologies like Azure - IaaS, SaaS and iPaaS.
  • Very good experience in moving data to/from Azure and creating ELT/ETL artifacts to process and distill the data by using the Azure Data Factory, LogicApps and Microsoft Flows.
  • Good noledge in developing reports on IBM Cognos reporting tool.
  • Experience in developing workflows, pipelines, data sets using Azure data Factory.
  • Experience in Pulling and pushing data from different sources into Azure SQL DW using ADF version2.
  • Experience in creating pipelines for Adding SSIS ETL packages in ADF pipelines and Scheduling them
  • Expertise in writing test cases and creating test plans to do automated and manual testing for developed packages and changes in SSIS packages and SQL Scripts.
  • Experience in working wif Storage area network consultants in synchronizing master database copy wif number of slave copy’s when 1000’s of users connect the databases at a time.
  • Expertise in handling Performance improvements of jobs or packages at hardware level by coordinating wif SQL DBA, Wintel and SAN teams.
  • Experience in migrating databases from one platform to another platform using third party tools.
  • Good noledge in integrating data by defining data models from CRM applications like Salesforce, Microsoft Dynamics 365 and load data into databases.
  • Expertise in Writing scripts to execute batch jobs in Job Information Language to execute in Autosys.
  • Expertise in Writing batch scripts to execute jobs On IBM TWS consoles and responsible to schedule jobs on consoles.
  • Extensive experience in interacting wif users, requirement gathering and converting the business requirements to technical requirements and design them as per the business need.

TECHNICAL SKILLS:

Databases: SQL Server 2000/2005/2008/2008R2/2012, Tera Data, Oracle PL/SQL, IBM DB2/UDB8.x/7.x/5.x,Big data Hive QL & Pig Latin, MS Access.

ETL: Microsoft DTS, SQL Server Integration Services.

Reporting Tool: SQL Server Reporting Services, Cransoft Data Garage, Power BI.

OLAP: SQL Server Analysis Services

Operating Systems: Windows Enterprise 2003/2000, Windows Server 2008,2008 R2, Windows Server 2012.

Applications: Erwin 3.5/4.1/7, Visual Studio 6.0/.NET/2005,2008/2010/2012

Languages: C, C++, SQL, T-SQL, PL-SQL, Visual C#, Visual Basic, ASP.NET,JAVA, R Language.

Administering Database Engine: Security, Managing SQL Servers, Managing Large Databases, Linked Server, High Availability, Importing Exporting Bulk Data, Backing up Restoring, Deploying Application

PROFESSIONAL EXPERIENCE

Confidential, Houston, TX

Azure Data Engineer

Responsibilities:

  • Working as Data Engineer for Upstream Reliability Operations Analytics team under geologists, data architects and data scientists where my roles is to create a large data warehouse environment, Feature Set tables, pulling and pushing data from different sources like SAP HANA, Ariba, Azure SQL, Azure SQL DW using Azure Data Factory/Blob/Data Lake/Logic Apps, SQL DW and SSIS.
  • Study and analysis of the existing systems and involved in planning and designing data models to acquire data to/from Operational Data Source (ODS) on cloud by using Azure SQL Server, Azure SQL data warehouse, Azure data factory/Blob/Logic Apps, SQL Server Integration Services.
  • Closely working wif Data Scientists and Data Analysts to make available of data they required.
  • Creating Feature Set tables wif more than 200 columns to load the data which will be used by business based on the requirements.
  • Lift and shift SSIS ETL packages from on-premises into cloud using VS 2015, ADF, SQL DW.
  • Creating Pipelines in ADF to move and transform data, execute SSIS packages, Stored Scripts and create custom script.
  • Calling SAP Ariba Services to load data into SQL DW using ADF and Logic Apps.
  • Loading data from Salesforce and SAP HANA tables into SQL DW.
  • Developing EL & ETL packages using SSIS, Azure Data Factory to extract & load from various Sources.
  • Developing Linked services, Data Sets, Pipelines to establish connections, collect required data and cleansing processing the data.
  • Developing complex queries to pull data according to business logics on SQL DW.
  • Developing SQL queries, stored procedures, views, functions, packages, testing, exception handlers, tables and objects types.
  • Optimize and fine tuning the existing SQL queries to enhance the performance of the applications by analyzing execution plans and implementing indexes.
  • Creating Storage environments/runtime engines in Azure.
  • Experience in controlling the source code in VSTS and Deploying SSIS packages.
  • Migrating existing database servers from existing data center to a new data center, replication and migration of databases between various environments etc.
  • Experience in Azure Data Bricks for hosting the Python and SQL scripts to hold large data sets.
  • Working wif COSMOS DB to write and replicate the data globally.
  • Configuring Azure Data Lake store to for large data analytics workloads.
  • Developing U-SQL queries to retrieve and handle data resides in Azure data Lake Store.
  • Creating Dimensional modeling for SSAS cubes using Tabular model.
  • Developing DAX queries by connecting to SSAS tabular models and created live query connection for advanced visualization and report tabular model.
  • Developing reports and dashboards in Power BI using PowerBIStack ofPowerPivot,PowerView, andPowerMap.
  • Developing reports Using Power BI Desktop and Publish on to Power BI Services.

Confidential, Miami, FL

BI Consultant

Responsibilities:

  • Working wif Finance, Planning, Sales, Supply Chain and Warehouse Management teams on the client side for data analysis and involved in requirements gathering.
  • Study and analysis of the existing systems and involved in planning and designing data models to acquire data from different sources into SQL Server.
  • Created Dataflow diagrams using VISIO to aid the developers and the testers in understanding the business process flows for coding and testing of the applications.
  • Designing Data Marts and Data Warehouses to store data for each department from various sources.
  • Developing relational data bases and create Star/Snowflake schema dimensional and data warehouse modeling.
  • Developing ETL packages using SSIS to extract & load from UNIBASE system input files into SQL Server staging area.
  • Developing ETL packages to perform every day incremental transactions to update and load data into Data Mart layers.
  • Creating T-SQL code for cleansing and to manipulate data for the business needs.
  • Developing SQL queries to fetch data from Data Warehouse into OBIEE reports.
  • Performing Data profiling and Unit testing of developed packages and T-SQL code to ensure the application functionality is working as per the business needs.
  • Analyzing OBIEE reports at regular intervals to monitor the system performance and suggest the required code fixes for the maintenance of the applications.
  • Creating and supporting users to create pivot reports using advanced tools such as Power Pivot in Excel.
  • Creating jobs scheduler to execute code and packages in nightly cycle for on time delivery of data to clients.
  • Creating reports and dashboards in Power BI using PowerBIStack ofPowerPivot,PowerView, andPowerMap.
  • Developing reports Using Power BI Desktop and Publish on to Power BI Services.
  • Connecting SSAS tabular models and created live query connection for advanced visualization and report tabular model.
  • Created the Architecture to load the Data using Azure Data Factory in Commercial Cloud, to the data warehouse in Cloud.
  • Developed the pipelines to bring data from disparate data source, which included SQL server databases, Azure SQL, Azure Analytics store into Azure SQL DW.
  • Developed the scripts to create the tables in Azure Data warehouse.
  • Developed the stored procedures to load the data from the staging tables in the Azure data warehouse to the EDW.
  • Performed performance tuning for the loading of data using ADF, by checking the DWU consumed for the load of the data.
  • Providing data from Azure SQL DW using ADF to Machine Learning Webservices for predictive analytics.
  • Customizing data sources using Query Editor to cleanse and manipulates data in columns.
  • Creating calculated columns using DAX functions to perform business logic in the reports.
  • Created various visualizations like waterfall, funnel, matrix visualization, scatter plots, combo charts, gauges, cards and KPI.
  • Developing dashboards by connecting to On Premises data models in Power bi Desktop based on measure and dimensions.
  • Publish on Power BI services and schedule automated refresh of reports and create and share dashboards based on reports inpower bi desktop.
  • Created gateways to pull data from on premise data source into power bi cloud services.
  • Creating user profiles and security groups to access power bi reports.

Confidential, PA

Sr BI Developer

Responsibilities:

  • Participated in discussions wif business users, DB2 and MSBI and all other teams of the project in making strategies dat would ensure all the business requirements reflect in the project development.
  • Participated in designing ETL(SSIS) Architecture of the project to get data from open hub tables to develop a successful data warehouse of star and snowflake schema database which is used as open source to develop SSRS reports.
  • Established Oledb connections from SQL Server Integration Services to Source DB2 database.
  • Developed data models to integrate data from different source systems including cloud data base systems, ERP and CRM systems.
  • Developed Staging database to extract day to day load from open hub tables DB2 to SQL server using SSIS based on truncate and load method using Data Flow task, Oledb Source, Oledb destinations and SQL tasks.
  • Developed Open Data Source Database Layer which will maintain same table names, columns names &same data as same as Source SAP BW data warehouse using SCD methods.
  • Developed SSIS packages to define Data Mart layer as snowflake and star flake data warehouse schema using ODS database and created fact and dimension tables and defined relationships.
  • Extensively used SSIS transformations such as Lookup, Derived column, Data conversion, Aggregate, Conditional split, SQL task, Merge etc.
  • Writing SQL programming to designing the datasets through Views and Store Procedures for Dimensions and Fact tables.
  • Developed complex T-SQL Code to update and insert large sets of data in various tables.
  • Written Clustered and Non Clustered Indexes on tables.
  • Involved in creating multiple parameterized stored procedures which were used by the SSIS SQL task to process the data.
  • Developed SSRS reports for users to do analysis.
  • Wif SSRS Created drill through reports
  • Developed reports using SSRS which includes main reports and sub reports.
  • Created SSRS Parameterized reports, Cross-Tab reports, Drill down reports.
  • Creating roles and profiles to users in accessing SSRS reports.
  • Created Jobs to do report snapshots.
  • Processed data between SSIS and MS Dynamics CRM using third party tools like Kingsway soft SSIS integration tool kit for Microsoft dynamics CRM.
  • Developed SSAS Cubes for Profit and Loss, General Ledger Balance, Variance Analysis, Stock Balances, Turnover Analysis used for reporting.
  • Designed different hierarchies on dimensions, measures and measure groups in SSAS cubes.
  • Designed in Partitioning Data of SSAS cubes.
  • Creating roles on each cube to access SSAS cube.
  • Designed calculated columns which used for measures using MDX language.
  • Used Power BI Power Pivot to develop data analysis prototype, and used Power View and Power Map to visualize reports.
  • Defined data sets wif joins and sub-queries for complex queries involving multiple tables in Power BI.
  • Designed and developed Power BI dashboards, Reports and published it on Power BI sites.
  • Created DAX calculated columns in power pivot worksheets to extract, import and join data dat coming from different sources.
  • Developed Power BI reports and dashboards from multiple data sources using data blending.
  • Creating Gateways in power bi to connect data from on prem and cloud sources like Amazon Red Shift, Microsoft Azure data factory etc.
  • Scheduled jobs for creating snapshot of Power BI Reports and Dashboards and troubleshooting on datasets for Power BI sites.
  • Used Microsoft Power BI Power Query to extract data from external sources and modify data to by calculated columns as required in Excel, and created SSIS packages to load excel sheets into database.
  • Restricted access to users by creating security roles to access reports in Power BI.
  • Developed Disaster Recovery System.
  • Experience in migrating database from Sybase to SQL server using MSSSMA.
  • Associated wif DBA, Windows Server and Storage Area Network teams to manage DB Server, SSAS Server and data storage mirroring.
  • Hands on experience working wif Dynamics 365 ERP and Salesforce CRM.
  • Creating Daily Batch Jobs and scheduling in IBM TWS for execution.
  • Creating Adhoc Batch Jobs using JIL scripts and executes in Auto Sys.

Environment: SQL Server 2012, IBM DB2, SSIS 2012, SSRS 2012, Excel 2010,PowerBI.

Confidential, CT

SQL Server BI Developer

Responsibilities:

  • Developed SSIS packages to load data from flat files to Staging database.
  • Developed SSIS ETL packages to load data from staging to ODS layer and then to Data mart layer using SSIS transformations.
  • Scheduled the job to do execute all ETL packages to load data from one source to another source task periodically.
  • Developed various ETL Packages using SSIS which upserts data from staging table to database tables.
  • Used various Transformations in Dataflow, Control Flow components.
  • Defined Event Handlers and Error Handling in SSIS packages.
  • Expertise in tuning SSIS packages to improve its performance in executing.
  • Wrote complex T-SQL statements using joins, sub queries and correlated sub queries. Involved in creation of data modeling techniques.
  • Developed User defined functions, stored procedures, views on SQL server.
  • Developed reports using SSRS which includes main and sub reports.
  • Created SSRS Parameterized reports, Cross-Tab reports, Drill down reports.
  • Creating roles and profiles to users in accessing SSRS reports.
  • Created Jobs to do report snapshots.
  • Created and Managed OLAP Cubes using SSAS and created different KPIs to perform analysis based on business requirements.
  • Worked wif SSAS cubes using multiple dimensions, perspectives, hierarchies, measures groups to analyze marketing efforts and prospective customers.
  • Done performance tuning of the queries, run Unix scripts and responsible to move code between different Environments.
  • Maintained Warehouse Management System in tracking of stock balance, shipment details and tracking delivery in supply chain system.
  • Provided support for data issues and given appropriate solutions.
  • Migrated Warehouse Management application data base from Sybase to SQL server.
  • Responsible for capacity planning, monitoring Disk I/O, CPU and memory.
  • Maintained operators, categories, alerts, notifications, jobs, job steps and schedules.
  • Hands on experience working on Cognos reporting tool.
  • Implemented event handlers and error handling in SSIS packages and notified process results to various user communities.

Environment: SSIS 2008 R2, SSRS 2008R2, SSAS 2008 R2, SQL Server 2008R2, UNIX, MS Office 2010, MDX.

Confidential, CT

SQL Server BI Developer

Responsibilities:

  • Responsible for data loading and process from source system to SOCS data mart.
  • Worked on data issues which the values are not matched according to user comparisons.
  • Handled the data issues in the SOCS Cube.
  • Migrated application from SQL Server 2000 to Sql Server 2005
  • Handling the data errors in the flat files which are the source files to SOCS.
  • Active part in maintenance of data cubes for OLAP.
  • Involved in system testing

Environment: SQL Server 2005, SSIS 2005, SSRS 2005, SSAS 2005, Excel 2007.

Confidential, CT

Back Office Associate & SQL Server Developer

Responsibilities:

  • Developed DTS packages from SQL Legendary tasks on SQL Server Management Studio to load the data from flat files and Source tables into SQL databases
  • Creating tables, reports and groups in Cransoft Data Garage.
  • Scheduling reports to refresh and delivering to users using Cransoft Data Dialysis
  • Working wif Cransoft Interfaces to create work flows for table refresh
  • Working wif Cransoft teams on interfaces issues and any issues wif Cransoft tools
  • Implemented event handlers and error handling in DTS packages and notified process results to various user communities.

Environment: Cransoft Data Dialysis and Data Garage, SQL Server 2005.

We'd love your feedback!