Building a Modern Data Platform Using a Test Driven Approach

In data engineering, testing our pipelines and data flows is all too often a difficult, manual and time consuming process. In this session we will look at how we can use Azure DevOps and Azure Dev Test Labs to auto-magically build out a whole data platform environment in minutes, including ADLS, Data Factory, Databricks and Key Vault. We'll then use that foundation to see how we can build both development environments, and setup automated testing using DevOps that adds real value to the Modern Data Platform.