Optimizing Your Delta Lake: Beyond the Defaults
Proposed session for SQLBits 2026TL; DR
Delta Tables provide amazing out of the box features such as ACID Compliance and Time Travel to your datalake but there's a world of optimization beyond the default settings.
This session is designed to take your Delta Lake to the next level. We'll start with a brief introduction to Delta Tables and dive into advanced optimization techniques.
Session Details
Delta Tables provide amazing out of the box features such as ACID Compliance and Time Travel to your datalake but there's a world of optimization beyond the default settings.
This session is designed to take your Delta Lake to the next level. We'll start with a brief introduction to Delta Tables and quickly dive into advanced optimization techniques.
Learn how to reduce storage costs, supercharge query performance, and govern your Delta Lake with precision.
We'll explore topics such as Delta Transaction Log retention, deletion vectors, liquid clustering, change data capture, and generated columns. Ever wondered, "What the heck is a bloom filter?" We've got you covered.
Join me to unlock the full potential of your Delta Lake and make informed decisions that go beyond just leaving things at their defaults.
This session is designed to take your Delta Lake to the next level. We'll start with a brief introduction to Delta Tables and quickly dive into advanced optimization techniques.
Learn how to reduce storage costs, supercharge query performance, and govern your Delta Lake with precision.
We'll explore topics such as Delta Transaction Log retention, deletion vectors, liquid clustering, change data capture, and generated columns. Ever wondered, "What the heck is a bloom filter?" We've got you covered.
Join me to unlock the full potential of your Delta Lake and make informed decisions that go beyond just leaving things at their defaults.
3 things you'll get out of this session
Better Understand the Delta Table Format
Advanced Configuration for Delta Tables
How to make appropriate design choices for delta lakes
Speakers
Scott Bell's other proposed sessions for 2026
AI Security in Practice: How to run Threat Modeling Workshops - 2026
Danger in Delegation: When “Helpful” Becomes Harmful - 2026
AI for Developers, Not End Users: Master Agentic BI Development Workflows - 2026
AI for Developers, Not End Users: Master Agentic BI Development Workflows - 2026
AI for Developers, Not End Users: Master Agentic BI Development Workflows - 2026
Building Context, Not Vibes Pratical AI Augmented Data Engineering - 2026
Building Context, Not Vibes Pratical AI Augmented Data Engineering - 2026
Building Context, Not Vibes Pratical AI Augmented Data Engineering (Part 2) - 2026
Scott Bell's previous sessions
Navigating Data Governance in the Age of Generative AI
In the rapidly evolving world of data analytics, the emergence of Large Language Models (LLMs) has sparked a debate: Are LLMs signaling the end of traditional data analytics? This session delves into the heart of this question, exploring the fundamental workings of LLMs and their transformative impact on the analytics landscape. Attendees will gain insights into the advantages and potential pitfalls of integrating LLMs into their data strategies. We'll discuss the innovative use cases LLMs unlock and emphasize the paramount importance of governance and lineage in harnessing their full potential. Whether you're intrigued by the brilliance of LLMs or wary of their implications, this session will equip you with a balanced perspective to navigate the future of data analytics.
Cosmos 101
Find out everything you need to know to get started with Azure Cosmos DB in 20 minutes or less.
Is HTAP the future?
Hybrid Transactional Analytical Processing solve the age old problem of integrating operational processes with analytical capabilities within a single system. Find out what they're and how they deliver value