Key Components for an Azure Synapse Link for Dataverse

Azure Synapse Link Features

• Azure Synapse Link for Dataverse provides continuous replication of Power Platform entities to Azure Data Lake Storage Data exposed by Azure Synapse Analytics Serverless Pool.

• Requires Azure Data Lake and Azure Synapse Analytics Workspace Dataverse configured to integrate with Azure resources through Power Apps Portal

• Selected Dataverse entities synchronised to containers in Azure Data Lake into CSV files

• Azure Synapse Analytics Serverless Pool defines External tables to query data from Data Lake csv files

Azure Synapse Link for Dataverse Architecture

The Azure Data Platform can be integrated with many services to bring data together from many disparate data sources and from both relatively static data sources and continually changing data sources.

Applications such as Dynamics 365 can stream changes to data, and new data, to Dataverse, which can then be picked up by Azure Synapse Link for Dataverse to move the changes and new data into an Azure Synapse Analytics Serverless Pool. From the Serverless Pool data can be picked up directly from BI and analytics tools or can be moved into an Azure Synapse Analytics Dedicated Pool for a more permanent and sructured location forming the basis of a BI repository.

A Synapse Serveless Pool presents itself as a structured relational database, but there is actually no data stored within the database tables. The tables are external tables that simply redirect to CSV files that have been placed in an Azure Data Lake by Azure Synapse Link.

Moving Azure Synapse Link Data to a Synapse Dedicated Pool

Using a Serverless Pool resource as a direct source for BI solutions can be problematic as source data can become unavailable for querying while it is being updated/synchronised, and it will not be performant when dealing with large volumes of data.

• Querying Dataverse data directly though Serverless pool will be low latency, but may not be performant at scale

• Copying data to Dedicated Pool gives access to the advance storage and performance functions of Azure Synapse

• Azure Data Factory orchestrates the extraction of data from the Azure Synapse Link Data lake and load into Data Warehouse

• Transformation processes can be implemented in Transact SQL procedures 

Azure Data Factory can be implemented to move Azure Synapse Link data from a Synapse Serverless Pool to a Synapse Dedicated Pool. The Synapse Dedicated SQL Pool provides your more traditional Data Warehouse platform, with structured tables holding data, which can be transformed along the way to make it fit for purpose in delivering an end to end BI solution. 

Catering for Different Reporting Needs

Azure Synapse Analytics can be combined with other data sources through Azure Data Factory pipelines and a Azure Dedicated SQL pool to cater for all reporting requirements:

• Power BI reports connected directly to Serverless Pool tables

• Power BI reports connected to Dedicated Pool tables

• Power BI reports connected directly to Dataverse entities

Building an Azure Synapse Link for Dataverse Solution - Where do you start?

Contact PTR to discuss your options. One of our consultants will be happy to have a chat with you about your requirements and possible solutions that may suit your needs. You will also find more information for reference on the following pages on our website about Power BI solutions, Business Intelligence Solutions, Data Strategy.

Whatever your Data Source challenge our Data Analytics & Azure Consultancy team are here to help you. Call our Sales Director, Keith Doward on 0118 979 4000 or email him at keith.doward@ptr.co.uk for further information.