We provide IT Staff Augmentation Services!

Principal Bi / Cloud Data Engineer Resume

4.00/5 (Submit Your Rating)

SUMMARY

  • 12+ years of experience as Business Solutions BI Lead, Principal Cloud Data Engineer, Senior SQL/BI Engineer, and Developer in Production, Development and Staging Environments in Banking and Financial services, Health Care, Insurance and Retail industries.
  • Strong communication and management skills with excellent role playing capabilities.
  • A well - organized, goal-oriented, highly motivated and effective team leader/member.
  • Hands on experience with Azure Cloud Services using Azure Data Factory, Azure Logic Apps, Databricks, PySpark, Azure SQL Database, Azure Synapse Analytics, Azure Data Lake Storage (ADLS) Gen2, Blob Storage and Azure Analysis Services.
  • Experience in ADF pipelines using Linked Services, Integration Runtimes, Datasets, Pipeline to Extract, Load and Transform (ELT) data from disparate sources like Azure SQL Database, Blob storage, Azure Synapse Analytics (formerly SQL DW).
  • Utilized Azure Data Factory, Azure Functions and Azure Stream Analytics to perform the data orchestration and transformation.
  • Experience with ADF pipelines automation via Azure Logic Apps and by setting up the different types of triggers like Schedule, Tumbling window and Event.
  • Experience with Azure IaaS, PaaS, SaaS and DBaaS services.
  • Experience working with structured and unstructured data in large-scale of global data warehousing and analytics projects.
  • Extensive experience with On-premises SQL Server 2016/2012/2008 R2 and BI stack of SQL Server Integration Services, SQL Server Reporting Services, SQL Server Analysis Services and Power BI.
  • Experience in creating database, tables, indexes, complex queries, stored procedures, views, triggers, user defined functions, temp tables, CTE, derived tables using MS SQL Server 2016/2012/2008 R2/2008.
  • Experience in configuring SSIS packages using package Logging, Breakpoints, Checkpoints and Event handler to debug and fix the errors and deployment with Project and Package models.
  • Good understanding of Normalization / De-normalization and database design methodology.
  • Good knowledge of Data Marts, Data Warehousing, Data Modeling like Dimensional Data Modeling with Star Schema and Snowflake Schema along with solid understanding of Fact and Dimensions.
  • Ability to work in-groups as well as independently with minimal supervision.
  • Excellent analytical, troubleshooting, and problem solving skills.
  • Excellent verbal, written and presentation skills.

TECHNICAL SKILLS

Database: Azure SQL Database, SQL Server, Access, Oracle, Teradata

Database Tools: SSMS, Query Analyzer, BCP, SQL Agent, SQLTrace, SQL Server Profiler, Performance Monitor, Server Configuration Utility, Toad Data Point

Reporting Tools: Power BI, Tableau, SQL Reporting Services ( 2016/2012/2008 R2/2008/2005), Report Builder, MicroStrategy, Crystal Reports

IDE & BI Tools: SQL Server Data Tools (SSDT), Visual Studio, SSMS, Azure Data Studio, DAX Studio, Jupyter Notebooks, BIDS

Version Control: GitHub, Azure DevOps Git, Bitbucket, TFS, Visual SourceSafe (VSS), VisualSVN

Data Modeling Tool: Microsoft Visio, DB Designer, Erwin, Data Source View (DSV)

Programming: T-SQL, Python, PowerShell, VB.Net, C#, XML, DAX, PySpark, SAQL

Operating Systems: Windows Server 2012, Windows 10, Unix, Linux, MS DOS, Mac OS X

Cloud: Azure, Snowflake, Amazon Web Services (AWS)

PROFESSIONAL EXPERIENCE

Principal BI / Cloud Data Engineer

Confidential

Responsibilities:

  • Lead planning, gathering and documentation of business requirements. This involve interacting with business, product owner and development team.
  • Key liaison between business stakeholders and production teams.
  • Provide leadership and responsible for all aspects of the program development cycle from project definition through system implementation.
  • Key subject matter expert on systems and provide technical direction to resolve problems.
  • Lead the effort with scrum masters to work, deliver the stories across teams and coordinate on bi-weekly sprints of an Agile Scrum environment.
  • Designed the serverless data ingestion pipelines both static and dynamic by using various activities, data flows, parameters, variables and expressions in Azure Data Factory.
  • Implemented Dynamic Data Masking in Azure SQL database and Azure Synapse Analytics with different masking functions and data types using the Azure portal and T-SQL commands.
  • Extracted data from disparate sources like Oracle, Teradata, Hadoop, Text/CSV file, Blob storage and On-premise SQL Server via Windows File Share, SFTP and On-premise and Azure Cloud Databases using Azure Data Factory and SSIS 2016 .
  • Implemented an incremental data load by using slowly changing dimension Type 1 and Type 2 in ADF and SSIS or using Merge statement and Temporal Table in T-SQL.
  • Implemented the Azure, Azure-SSIS and Self-Hosted Integration Runtimes (IR) to access cloud and on-premises data stores and services.
  • Lift and Shift migration of the existing on-premises SSIS packages to Azure cloud.
  • Implemented success and failure notifications using Azure Logic Apps in ADF .
  • Designed the workflows for Sentiment Analysis using Text Analytics Resource and Azure Logic Apps Action .
  • Implemented Live Data Streaming Flow using Azure Stream Analytics with Stream Analytics job, data inputs, query (SAQL) and data outputs to Power BI for Data Visualizations.
  • Leveraged Azure Databricks to migrate Data from existing source systems to the trusted and curated layers in Snowflake using PySpark.
  • Designed and developed an automation of end to end data pipeline with metadata, data quality check and audit to the architecture.
  • Designed the ETL framework for file ingestion automation with Error Handling, Logging, Auditing and e-mail Notification.
  • Designed, built and tested end to end data pipeline including data ingestion, data integration and data curation.
  • Designed, built and support the framework of SFTP to ingest, integration and provision data.
  • Implemented complex financial logic into the Data Warehouse Central (DWC).
  • Used Erwin Data Modeler to design the facts and dimensions of the Data Warehouse.
  • Created Power BI Reports, Dashboards and Visualizations for Sales and Finance using Power BI Desktop by fetching data from various sources like from AAS Model, JSON, SQL Server, Text/CSV files.
  • Experience working with dataset, data model, Publish Power BI Desktop reports, Scorecard, KPIs, Power BI Pro features, workspaces, security, Gateway setup, etc.
  • Experience working with DAX on creating Calculated Columns, Measures, Calculated Tables and DAX functions like Aggregation, Filter, Time Intelligence, Data & Time, Logical, Statistical.

Environment: s: SQL Server 2016 Enterprise Edition, Oracle, Teradata, Hadoop, DW, Data Lake, JIRA, Power BI, AAS, Agile Methodology, Scrum, Azure DevOps, Azure DM Gateway, Azure Data Factory, Azure Blob Storage, Azure Data Lake Storage (ADLS) Gen2, Azure Stream Analytics, Azure Databricks, Python, PySpark, Snowflake Cloud.

Business Solutions BI Lead

Confidential

Responsibilities:

  • Liaise with business stakeholders and IT systems administrators to develop an effective system designs, processes and best possible solutions.
  • Lead external integration architectural discussions and implementations that outlines solutions to achieve business objectives.
  • Develop technical architectures, designs, and processes to extract, cleanse, integrate, organize and present data from a variety of sources and formats for analysis.
  • Work directly with business stakeholders and business analysts, so, that business vision and the requirements addressed correctly.
  • Set standards for system enhancements, definition of user requirements, software acceptance criteria and end user technical support.
  • Work closely with IT engineering and technical teams to ensure successful rollout of the solution.
  • Assist in creation of data requirements and data model design as necessary and appropriate.
  • Perform project level design, debug and performance analysis.
  • Effectively communicate design concepts to both technical and non-technical stakeholders.
  • Experience working in an agile / scrum development environment.
  • Interacted with Business owners, Subject matter experts (SME) and Business Analysts & users to understand business processes, document project requirements and translate them into functional and technical specifications for OLTP application and BI SSRS reports.
  • Developed, Designed and Maintaining clear, consistent and repeatable design processes.
  • Extracted data from various sources like MS SQL Server, .CSV file, Excel file, Text file and XML file from client servers and through SFTP using SSIS packages .
  • Experience in creating SSIS packages using different type’s task, with Error Handling, Log event by doing logging and worked on package configuration to run package on different server.
  • Experience in enhancing and deploying the SSIS packages from DEV to QA to UAT to PROD by using Manifest file and run using DTExec.
  • Applied various data transformations like Merge, Aggregate, Sort, Multicasting, Conditional Split, and SCD (Slowly Changing Dimension) and Derived column in SSIS package design.
  • Implemented failure alerts using send email task in SSIS .
  • ETL implementation using SQL Server Integration Services (SSIS), applying some business logic and data cleaning in staging server to maintain child and parent relationship and data integrity.
  • Designed data model of EDW (logical and physical model) using star schema and snowflake schema.
  • Experience in administrating the created reports and assigning the permission to the valid users for executing the reports on Test and Production servers.
  • Configured the report viewing security for various users at various levels using Report Manager.
  • Created ad-hoc queries for end-users and assisting them to create their own queries/reports in Microsoft Report Builder 3.0.
  • Building an executive level single Dashboard for tracking high-level performance metrics as well as KPI’s using Power BI and SQL Server Reporting Services (SSRS) 2008 R2.
  • Generated Reports using Global Variables , Expressions and Functions for the reports using SSRS 2008 R2/2008.
  • Generated Sub-Reports, Drill down and Drill through reports, Group Reports, Reports having totals and Sub-totals and Parameterized reports using SSRS.
  • Created reports to retrieve data using Stored Procedures that accept parameters.
  • Writing complex SQL Queries, Stored Procedures, Triggers, Views, Cursors and User Defined Functions to implement the business logic.
  • Implemented Constraints on tables for maintaining Data Integrity.
  • Optimized queries by looking at Execution Plan for better tuning of the database.
  • Created Clustered and Non-Clustered Indexes for Query Optimization.

Environment: s: SQL Server 2012/2008 R2 Enterprise Edition, Relational Databases, Windows Server 2008 R2 Standard Edition, Team Foundation Server (TFS), JIRA, Balsamiq, Scrum, Agile Methodology, AWS, Redshift, S3.

Sr. SQL/BI Developer

Confidential

Responsibilities:

  • Worked directly with Business owners, Business users and Business analyst to gather the project requirements.
  • Developed high quality SSRS solutions designs with SharePoint integrated mode.
  • Experience in administrating the created reports and assigning the permission to the valid users for executing the reports on Test and Production servers.
  • Configured the report viewing security for various users at various levels using Report Manager.
  • Building an executive level single Dashboard for tracking high-level performance metrics as well as KPI’s using SQL Server Reporting Services (SSRS) 2008 R2.
  • Designed SSIS packages to validate, extract, transform and load data to warehouse and data marts.
  • Implemented the data validations in SSIS packages using BIDS for data accuracy.
  • Built efficient SSIS packages for processing Fact and Dimension tables with complex transforms and Involved in extracting the data using SSIS from OLTP to OLAP.
  • Created and Designed Data Source and Data Source Views using SSAS 2008/2008 R2.
  • Wrote T-SQL queries with the help of Stored Procedures, Functions, Triggers, Cursors, Views, Indexes, Temp Tables and User Defined Functions.
  • Created CTE, Joins and Sub-Queries for complex queries involving multiple tables.
  • Used SQL Profiler for monitoring and troubleshooting performance issues in Ad hoc SQL code and SP.
  • Performed daily tasks including backup and restore by using MS SQL Server 2008 tools like SQL Server Management Studio, SQL Server Agent, and Database Engine Tuning Advisor.
  • Used DBCC commands to troubleshoot issues related to database consistency.
  • Troubleshoot data issues, validate result sets, recommend and implemented the process improvements.

Environment: s: SQL Server 2008 R2/2005 Enterprise Edition, DW, Relational databases, Windows Server 2008 Standard Edition, Visual Studio SourceSafe (VSS), PmPoint, QNXT.

Sr. SQL/BI Developer

Confidential

Responsibilities:

  • Worked with Business analyst, Data architect, Business owners and Business users to understand business processes, document project requirements and translate them into functional and technical specifications for BI SSRS reports.
  • Responsible for developing, designing and managing SSRS projects using SSRS 2008/2008 R2 in BIDS.
  • Worked with Tabular reports, Matrix reports, Gauges and Chart reports, Parameterized reports, Sub reports, Ad-hoc reports, Drill down reports, Drill through reports as well as Interactive reports according to business requirements in time restricted environment using SSRS 2008/2008 R2.
  • Experience in designing Cascaded Parameterized Reports, Reports with Indicators, Sparkline Reports using SSRS 2008/2008 R2.
  • Experience with developing reports using multiple Tablix, Matrix, Chart and List constructions in a singular report using Report Builder 3.0 and Report Designer.
  • Experience with all aspects of SSRS development and management including report design, data sources, datasets, parameters, variables, filters, functions, calculations & conditional formatting, security, snapshots, cache refresh plans and subscriptions.
  • Experience in administrating the created reports and assigning the permission to the valid users for executing the reports on Test and Production servers.
  • Developing, designing and deploying reports on SSRS on SQL Server 2008 and SQL Server 2008 R2.
  • Sound Experience and understanding of SSAS, OLAP cube, Data mining and EDW Architecture of Fact and Dimension tables.
  • Experience in designing Tabular, Matrix, Drill-down Reports and Parameterized Reports using OLAP cube in SSRS 2008/2008 R2.
  • Worked on OLAP Data warehouse, Model, Design, and Implementation.
  • Experience in Designing and Building the Dimensions and cubes with star schema and snowflake schema using SQL Server Analysis Services (SSAS).
  • Configured the report viewing security for various users at various levels using Report Manager.
  • Created CTE, Joins and Sub-Queries for complex queries involving multiple tables.
  • Created T-SQL queries to do analysis and provided ad-hoc reports or datasets based on business requirements.
  • Applied various data transformations like Merge, Aggregate, Sort, Multicasting, Conditional Split, and SCD (Slowly Changing Dimension) and Derived column.
  • Identified and troubleshoot the data and/or error issues in T-SQL and SSRS, validate result sets (Unit Testing), recommend and implement the process improvements.
  • Mentoring Database designing knowledge of RDBMS modeling and Dimensional modeling of Enterprise Data Warehouse (EDW) to junior developers.
  • Experience in optimizing report performance through query analysis in SQL Server 2008 R2/2008.
  • Used SQL Profiler for monitoring and troubleshooting performance issues in T-SQL code.
  • Wrote T-SQL statements for retrieval of data and Involved in performance tuning of T-SQL queries and Stored Procedures.
  • Designed logical and physical data models and defined primary key, foreign key using Data Source View (DSV) tool.
  • Performed SQL Server Reporting Services (SSRS) reports code review for the report performance and to validate user level security.
  • Strong working knowledge in Reporting Services Architecture, Report Designer, Report Builder, Report Manager, Report Server and Publishing a Report.
  • Assess incoming reporting requests for feasibility and provide estimate of development time.
  • Demonstrated ability to work in a fast-paced environment with minimal supervision.
  • Provided documentation for all kinds of reports and EDW dimensional modeling.

Environment: s: SQL Server 2008/2008 R2 Enterprise Edition, EDW, Relational databases, SQL BI Suite (SSIS, SSRS, SSAS), Enterprise manager, VB.Net, XML, Visio 2007, Windows Server 2008 Standard Edition.

We'd love your feedback!