SQLBits 2023
No more data quality surprises in your Databricks, Synapse or Power BI solutions!
In this demo-rich session you will learn how you can implement a framework for data quality validation and monitoring, spanning your end-to-end data platform including Power BI!
Do you know your data? And do you already actively monitor for deviations from those expectations? Being in control of your data quality is essential for any solution, whether it's running in Azure Databricks, Azure Synapse Analytics or Power BI. In this demo-rich session you will learn how you can implement a framework for data validation and monitoring, spanning your end-to-end data platform including Power BI! We'll leverage an open-source library called great-expectations to quickly get up-and-running. With the demonstrations, practical tips and example scripts, you will be able to implement this framework in your own data platform and solutions. Become in control of the data quality of your solutions!