SQLBits 2023
Spark Execution Plans for Databricks
Introduction into Spark Execution Plans for Databricks for optimizing code and execution.
Databricks is a powerful data analytics tool for data science and data engineering, but understanding how code is executed on cluster can be daunting.
Using Spark execution plans allows you to understand the execution process and flow, this is great for optimizing queries and identifying bottlenecks.
This session will introduce you to Spark execution plans, the execution flows and how to interrogate the different plans.
By the end of this session, you will have everything you need to start optimizing your queries.
Using Spark execution plans allows you to understand the execution process and flow, this is great for optimizing queries and identifying bottlenecks.
This session will introduce you to Spark execution plans, the execution flows and how to interrogate the different plans.
By the end of this session, you will have everything you need to start optimizing your queries.