SQLBits 2024
DataOps: How to Deliver Data Faster and Better with Microsoft Cloud
Explore the practical methods of implementing a DataOps-driven modern data platform in the Microsoft Cloud, mastering the art of delivering high-quality data products.
DataOps is "DevOps for data". It helps data teams improve the quality, speed, and security of data delivery, using cloud-based tools and practices. DataOps is essential for real-world data solutions in production. In this session, you will learn how to use DataOps to build and manage a modern data platform in the Microsoft Cloud, with technologies like Azure Synapse Analytics and Microsoft Fabric. You will also learn how to use various services and technologies to enhance your data platform, covering topics such as:
- Build & release management: automate and streamline your data pipelines and deployments.
- Versioning: track and manage changes to your data and code.
- Validation: ensure the accuracy and consistency of your data.
- Testing: verify the functionality and performance of your data applications.
- Monitoring, observability and alerting: measure, troubleshoot and escalate your data operations and outcomes.
- Developer experience: enable collaboration and productivity among your data team members.
- Infrastructure deployment: provision and configure your data resources and environments.
- Security and governance: protect and control your data assets and access.
Join us to discover the tools, techniques, and processes we use to provide secure, reliable, cost-effective data solutions in the Cloud.
- Build & release management: automate and streamline your data pipelines and deployments.
- Versioning: track and manage changes to your data and code.
- Validation: ensure the accuracy and consistency of your data.
- Testing: verify the functionality and performance of your data applications.
- Monitoring, observability and alerting: measure, troubleshoot and escalate your data operations and outcomes.
- Developer experience: enable collaboration and productivity among your data team members.
- Infrastructure deployment: provision and configure your data resources and environments.
- Security and governance: protect and control your data assets and access.
Join us to discover the tools, techniques, and processes we use to provide secure, reliable, cost-effective data solutions in the Cloud.
Speakers
Barry Smart's other proposed sessions for 2026
No-Compromise Data Apps: Why Streamlit is the Missing Piece in Your Analytics Stack - 2026
Spark Unplugged: How In-Process Analytics Is Making Distributed Computing An Expensive Investment - 2026
Barry Smart's previous sessions
DataOps: How to Deliver Data Faster and Better with Microsoft Cloud
Explore the practical methods of implementing a DataOps-driven modern data platform in the Microsoft Cloud, mastering the art of delivering high-quality data products.
Microsoft Fabric and Data Mesh - a perfect fit?
Unlock the full potential of Microsoft Fabric by establishing domain-orientated ownership and federated computational governance to deliver high impact data products in your organisation.
Turbo charge your Data Science workflow with Microsoft Fabric
Microsoft Fabric brings a range of powerful capabilities into one SaaS platform, empowering "full stack" data scientists to achieve more. Learn how new tools such as MLflow, Semantic Link can be leveraged to transform the way that we develop machine learning models.
How to create a high performance data team: lessons learned from the field
Barry will describe the key factors in establishing a high performance data and analytics team within an organisation.
Ed Freeman
endjin.com/who-we-are/our-people/ed-freeman
Ed Freeman's previous sessions
DataOps: How to Deliver Data Faster and Better with Microsoft Cloud
Explore the practical methods of implementing a DataOps-driven modern data platform in the Microsoft Cloud, mastering the art of delivering high-quality data products.
How To Actually Make Decisions When Architecting a Data Platform
Are you drowning in a sea of architectural options for your new data platform? Are there people in your organisation with strong opinions on which tools should be used, and for what? Are you unsure how to prove/evidence your gut feeling as to how things should be built? Well - this session's for you! If you're in charge of architecting a new data platform, it can be difficult to make concrete decisions that pushes you closer to your end goal - building a successful solution. This session will introduce a tried-and-tested suite of strategies and tools that will help you efficiently navigate the unforgiving task of architecting a modern data platform. We'll take a look at artifacts such as ADRs (Architectural Decision Records), NFR (Non-functional requirements) documents, and discuss strategies inspired from the Agile methodology (such as failing fast) that can help you in your endeavour.