Databricks Asset Bundles: Putting the Engineering into Data Engineering

This talk will discuss the challenges of deploying Databricks workflows and pipelines, and the benefits of adopting an software engineering approach to this process with Databricks Asset Bundles.

We will cover a worked example of developing and deploying an end-to-end project with Azure Databricks and GitHub actions. The GitHub repo will be publicly available for attendees to refer to after the session.

Although some experience of Databricks is assumed, no prior knowledge of Databricks Asset Bundles or its predecessors is required, and the principles explained should be applicable to a range of platforms.

Understanding of Databricks Asset Bundles Practical use of GitHub actions Adapting Software Engineering techniques to Data Engineering