Ben Watt
datalineo.com/news-and-blog
Data Platform MVP and Managing Director of Datalineo.
SQLBits 2024
Power BI dataflows: building your own refresh orchestration
Dataflow orchestration can be tricky if you want to execute based on dependency order. We help you solve that.
In this session we look at how to build your own process to orchestrate Power BI dataflow refreshes, allowing for dependencies to be maintained.
Using the built-in scheduler for each individual dataflow you are limited to time-of-day refreshes, meaning downstream refreshes are often left to hope-for-the-best timing conditions. We have solved that and all the necessary code is shared with you.
We leverage the Power BI REST APIs, where the workloads are triggered by Python (or your favourite language) in Azure Functions. Finally our processes are managed via configurable Power Automate flows.
Using the built-in scheduler for each individual dataflow you are limited to time-of-day refreshes, meaning downstream refreshes are often left to hope-for-the-best timing conditions. We have solved that and all the necessary code is shared with you.
We leverage the Power BI REST APIs, where the workloads are triggered by Python (or your favourite language) in Azure Functions. Finally our processes are managed via configurable Power Automate flows.