22-25 April 2026

Designing & Delivering Data Products: From Mesh Principles to Data Fabric Automation

Regular 50 minute session for SQLBits 2026

TL; DR

Learn how to define and deliver governed data products using cloud‑native tools. Combine data mesh principles with data fabric automation for operational and analytical data, ensuring scalability, compliance, and reliability.

Session Details

Modern data teams are asked to ship reliable, reusable data products not just pipelines across both operational and analytical domains. In this session we will explore how to define, build, and govern data products using cloud‑native patterns. Blending data mesh principles (domain ownership, product thinking, federated computational governance) with data fabric concepts (active metadata, automation, and intelligent integration).

We’ll walk through a pragmatic blueprint for productizing data. How to establish clear product contracts for schemas and lineage to make operational and analytical flows first‑class citizens when building event streaming, CDC, Lakehouse and warehouse solutions. Embedding data governance by design so teams move fast without breaking compliance, enriched with business metadata.

Expect actionable patterns and architecture examples. Whether you’re an architect defining domains and standards or an engineer delivering pipelines and notebooks, you’ll leave with a reusable checklist and reference architecture to accelerate your data product portfolio at scale, with Microsoft data platform friendly examples throughout.

3 things you'll get out of this session

• Define and implement data product contracts including schemas, lineage, and governance guardrails for operational and analytical domains.
• Apply data mesh principles and data fabric automation to enable domain ownership, active metadata, and federated computational governance at scale.
• Design cloud‑native architectures that embed policy‑as‑code, data quality gates, and observability for secure, compliant, and reliable data products.

Speakers

Paul Andrew

mrpaulandrew.com

Paul Andrew's previous sessions

An Evolution of Data Architectures - Lambda, Kappa, Delta, Mesh & Fabric
How has advancements in highly scalable cloud technology influenced the design principals we apply when building data platform solutions?
 
Building an Azure Data Analytics Platform End-to-End
Based on real world experience let’s think about just how far the breadth of our knowledge now needs to reach when starting from nothing and building a complete Microsoft Azure Data Analytics solution.
 
Creating a Metadata Driven Orchestration Framework Using Azure Data Integration Pipelines
We'll explore delivering this framework within an enterprise and consider an architect’s perspective on a wider platform of ingestion/transformation workloads with multiple batches and execution stages.
 
ETL in Azure Made Easy with Data Factory Data Flows
What happens when you combine a cloud orchestration service with a Spark cluster?! The answer is a feature rich, graphical, scalable data flow environment to rival any ETL tech we’ve previously had available in Azure.
 
Using Azure DevOps for Azure Data Factory
DevOps as a concept does not always translate to the technology when implemented. In this session we'll explore that problem when working with Azure Data Factory and what the different cloud only CI/CD options are.
 
Complex Azure Orchestration w Dynamic Data Factory Pipelines
If you have already mastered the basics of Azure Data Factory (ADF) and are now looking to advance your knowledge of the tool this is the session for you.
 
Building an End to End IoT Solution Using Pi Sensors & Azure
Demonstrating an end to end IoT solution providing real-time sensor data from a Raspberry Pi into an Azure IoT Hub, through Stream Analytics, then with outputs to Power BI and SQL DB. Learn how to build this simplified IoT solution from scratch.