SQLBits 2023
Azure Synapse Link for Dataverse Implementation
The aim of this session is to highlight the process of implementing Azure Synapse Link for Dataverse and to discuss the reality of working with the data as it is incrementally updated in Azure.
Following the deprecation of the Data Export Service, Microsoft has introduced a service called Azure Synapse Link for Dataverse to enable customers to bring their data from the Dataverse in near-real time into Azure Data Lake Storage Gen2 and Azure Synapse Analytics.
The aim of this session is to highlight the process of implementing Synapse Link and to discuss the reality of working with the data as it is incrementally updated in Azure. I will also talk through the known limitations that myself and the customers that I am working with have experienced when introducing the link into their environments.
Specifically this session will cover:
• Demo of Azure Synapse Link for Dataverse with data landing in both ADLS and Azure Synapse Analytics
○ Advanced configuration options when setting up the link
○ Incremental refresh
○ Structure of files in ADLS
○ Logical lake database in Azure Synapse Analytics
• Practical use cases of this solution
• Known issues/limitations - things you should know before implementing
The aim of this session is to highlight the process of implementing Synapse Link and to discuss the reality of working with the data as it is incrementally updated in Azure. I will also talk through the known limitations that myself and the customers that I am working with have experienced when introducing the link into their environments.
Specifically this session will cover:
• Demo of Azure Synapse Link for Dataverse with data landing in both ADLS and Azure Synapse Analytics
○ Advanced configuration options when setting up the link
○ Incremental refresh
○ Structure of files in ADLS
○ Logical lake database in Azure Synapse Analytics
• Practical use cases of this solution
• Known issues/limitations - things you should know before implementing