Modern AI with SQL Server on Ubuntu: Containers, Vector Search & Beyond

Proposed session for SQLBits 2026

TL; DR

Discover how to run SQL Server 2025 on Ubuntu 24.04 for modern AI workloads. In this hands-on session, we’ll deploy SQL Server and OLLAMA models as containers, then demonstrate vector and hybrid search capabilities. Learn why Ubuntu is the top choice for Kubernetes-based deployments and how to integrate SQL Server into your Linux-based AI ecosystem.

Session Details

SQL Server on Ubuntu is seeing massive adoption over a million downloads per month, with customers increasingly choosing Ubuntu for Kubernetes-based deployments.

In this hands-on session, we’ll show you how to deploy a local OLLAMA model as a container alongside SQL Server 2025 as a container on Ubuntu 24.04. You’ll learn how to perform vector search and hybrid search using the latest SQL Server capabilities, enabling powerful AI-driven scenarios on Linux. By the end, you’ll have practical skills to run modern AI workloads with SQL Server on Ubuntu in containerized environments for development and production scenarios.

3 things you'll get out of this session

Deploy SQL Server 2025 and OLLAMA containers on Ubuntu 24.04 for AI-driven scenarios. Learn vector and hybrid search techniques using SQL Server’s latest capabilities. Understand why Ubuntu is the preferred platform for Kubernetes-based SQL deployments.