Ask the Expert - Group B (Fri - 10:10 to 11:00)

An Evolution of Data Architectures - Lambda, Kappa, Delta, Mesh & Fabric

How has advancements in highly scalable cloud technology influenced the design principals we apply when building data platform solutions?

Building an Azure Data Analytics Platform End-to-End

Based on real world experience let’s think about just how far the breadth of our knowledge now needs to reach when starting from nothing and building a complete Microsoft Azure Data Analytics solution.

Creating a Metadata Driven Orchestration Framework Using Azure Data Integration Pipelines

We'll explore delivering this framework within an enterprise and consider an architect’s perspective on a wider platform of ingestion/transformation workloads with multiple batches and execution stages.

ETL in Azure Made Easy with Data Factory Data Flows

What happens when you combine a cloud orchestration service with a Spark cluster?! The answer is a feature rich, graphical, scalable data flow environment to rival any ETL tech we’ve previously had available in Azure.

Using Azure DevOps for Azure Data Factory

DevOps as a concept does not always translate to the technology when implemented. In this session we'll explore that problem when working with Azure Data Factory and what the different cloud only CI/CD options are.

Complex Azure Orchestration w Dynamic Data Factory Pipelines

If you have already mastered the basics of Azure Data Factory (ADF) and are now looking to advance your knowledge of the tool this is the session for you.

Building an End to End IoT Solution Using Pi Sensors & Azure

Demonstrating an end to end IoT solution providing real-time sensor data from a Raspberry Pi into an Azure IoT Hub, through Stream Analytics, then with outputs to Power BI and SQL DB. Learn how to build this simplified IoT solution from scratch.

Better ETL with Managed Airflow in ADF

Building complex data workflows using Azure Data Factory can get a little clunky, especially as you orchestration needs get more complex. Recently another option become available, Managed Airflow in ADF. Managed Airflow brings Apace Airflow to Azure as a PaaS service. In this session we discover what Airflow is, why we might want to use it for ETL orchestration, and see how it works with lots of demos.

Introduction to Databricks Delta Live Tables

Delta Live Tables is a new framework available in Databricks that aims to accelerate building data pipelines by providing out of the box scheduling, dependency resolution, data validation and logging. We'll cover the basics, and then get into the demo's to show how we can: - Setup a notebook to hold our code and queries - Ingest quickly and easily into bronze tables using Auto Loader - Create views and tables on top of the ingested data using SQL and/or python to build our silver and gold layers - Create a pipeline to run the notebook - See how we can run the pipeline as either a batch job, or as a continuous job for low latency updates - Use APPLY CHANGES INTO to upsert changed data into a live table - Apply data validation rules to our live table definition queries, and get detailed logging info on how many records caused problems on each execution. By the end of the session you should have a good view of whether this can help you build our your next data project faster, and make it more reliable.

Slowly Changing Dimensions made Easy with Durable Keys

In this session we look at a simple way to implement Kimball durable keys on a SCD2 dimension. This provides an easy, performant, way to support reporting on data using historical and current hierarchies.

SQL Server Encryption for the Layman

With GDPR and the number of data breaches we see in the news, encrypting sensitive data is incredibly important. In this talk we start with the basics of encryption, moving on to look at the ways we can encrypt data in SQL Server and Azure SQL DB.

Streamlining Power BI with PowerShell

Power BI is a vital tool for data analytics, but managing workspaces, access, and data sets manually can be time-consuming and error-prone. This session explores how PowerShell automation simplifies and streamlines these tasks.

Saying no is OK

In the high-demand IT field, professionals often struggle with overcommitment and work-life balance. This presentation, "Saying No is OK," offers practical insights and strategies for IT professionals to assertively manage their workload and protect their well-being. Learn the art of saying no, how to prioritize, and maintain professionalism while achieving a healthier work-life balance. Join us for a transformative session that will empower you to succeed while setting necessary boundaries.

Unveiling the magic of CI/CD for SQL Server using GitHub Actions

In this expert session we unveil the magic of CI/CD for SQL Server updates using GitHub Actions.

Github and Azure DevOps Duet - SQLBits edition

A tale about how a development team and an operations team must bond together and figure out how to use GitHub and Azure DevOps together for Data Platform deployments.

Battle tested project planning with Azure Devops boards

Azure boards within Azure DevOps give you the capability to organise your project and analyse the it’s progress. Do you want your manager to stop bugging you about your project’s progress, come to this session?

Start to See With tSQLt

Unit testing with databases is fairly new and is not yet embraced within database development. We'll learn how we can implement setup a database project, implement basic unit testing with tSQLt

Solving the dev DB problem with Docker and dbaclone

Shared dev databases have a disastrous effect on quality and throughput. However, moving to self-service dev/test databases is hard due to storage and data privacy concerns. The solution? Docker and dbaclone.

The future of accessibility - lessons from research

Accessibility often looks at standards and minimums, but what underpins those guidelines? What other guidelines are out there and what advice can they give? What's the latest understanding from research and what can we learn?

Making Dungeons and Dragons Accessible

Can we make the complex Dungeons and Dragons character sheet accessible using Power BI and low-code solutions? Lots of demos and banter between these speakers

Data Quality Revolution : The Fabric-OpenAI Approach

In this session, we'll walk you through practical techniques for handling various data issues, such as formatting problems, conversion, and more. Whether you're a seasoned data professional or just starting your data journey, this session will equip you with the skills and knowledge needed to turn chaotic datasets into valuable insights. Don't miss this opportunity to master the art of data cleaning with Fabric and Open AI.