Whats up DAB - Optimising your Databricks Releases using Databricks asset bundles
Proposed session for SQLBits 2026TL; DR
Are Databricks deployments driving you Looney? Are you running into a brick wall with multiple developers overwriting each others code? Is creating CICD pipelines for Databricks making you shout "You're dethpicable!" at your screen? This could be the session for you!
Databricks Asset Bundles could be the solution you are looking for. This session aims to show you the dos and don'ts of Databricks DABs. Covered topics will include how to structure your Asset Bundles into multiple resources files for easier maintainability, making use of variables and variable replacement to deploy your dab to multiple targets AND how best to use development mode to enable developers to deploy in harmony.
That's NOT all folks! We will cover how to deploy dabs locally from the CLI, how to use deployment pipelines and when to use each one.
The intended audience for this session is Data Engineers or DevOps Engineers or anyone looking to deploy Databricks code and other resources (Jobs, Pipelines, Compute etc.) using CICD.
This session will assume some familiarity with Databricks and basic CLI commands but aims to be accessible to all.
Session Details
Are Databricks deployments driving you Looney? Are you running into a brick wall with multiple developers overwriting each others code? Is creating CICD pipelines for Databricks making you shout "You're dethpicable!" at your screen? This could be the session for you!
Databricks Asset Bundles could be the solution you are looking for. This session aims to show you the dos and don'ts of Databricks DABs. Covered topics will include how to structure your Asset Bundles into multiple resources files for easier maintainability, making use of variables and variable replacement to deploy your dab to multiple targets AND how best to use development mode to enable developers to deploy in harmony.
That's NOT all folks! We will cover how to deploy dabs locally from the CLI, how to use deployment pipelines and when to use each one.
The intended audience for this session is Data Engineers or DevOps Engineers or anyone looking to deploy Databricks code and other resources (Jobs, Pipelines, Compute etc.) using CICD.
This session will assume some familiarity with Databricks and basic CLI commands but aims to be accessible to all.
Databricks Asset Bundles could be the solution you are looking for. This session aims to show you the dos and don'ts of Databricks DABs. Covered topics will include how to structure your Asset Bundles into multiple resources files for easier maintainability, making use of variables and variable replacement to deploy your dab to multiple targets AND how best to use development mode to enable developers to deploy in harmony.
That's NOT all folks! We will cover how to deploy dabs locally from the CLI, how to use deployment pipelines and when to use each one.
The intended audience for this session is Data Engineers or DevOps Engineers or anyone looking to deploy Databricks code and other resources (Jobs, Pipelines, Compute etc.) using CICD.
This session will assume some familiarity with Databricks and basic CLI commands but aims to be accessible to all.
3 things you'll get out of this session
How to structure Databricks Asset Bundles
How to use variables and variable replacement to deploy into different targets
Understanding the benefits of Development mode and how to use it effectively