SQLBits 2024

Scanning the skies above SQLBits - Realtime streaming of flight data with Microsoft Fabric

Using the real-time analytics capabilities of Microsoft Fabric we'll stream aircraft transponder data via a Raspberry PI and antenna into Microsoft Fabric. Through an end-to-end demo, we'll use Eventstream and KQL database to ingest the current locations of 100s of aircraft as they fly above the SQLBits venue. We'll then display and analyse these aircraft in Power BI, and use KQL DB's powerful spatial functions to determine the which parts of the area experience the most amount of air traffic.
We will use the real-time analytics capabilities of Microsoft Fabric to ingest data about aircraft captured using a Raspberry PI and an antenna from the aircraft's own transmissions as they fly above the SQLBits venue.

Built live in the session, we'll use Eventstream to stream the data into KQL Database before visualising the locations of 100s of aircraft in range with a Power BI report displayed using the Icon Map custom visual, enabling us to show the flight tracks and the aircraft's direction of travel. We'll be able to analyse flight numbers, types of planes and which operators are currently flying, and even landing at Farnborough airport next door!

Then extending the solution using KQL's powerful spatial analysis functions we'll be able to explore the busiest areas of sky analysing hundreds of millions of rows of flight tracks in seconds.

Microsoft MVP James Dales has used flight data for many years to demonstrate the capabilities of his Icon Map Power BI visual. However, with Microsoft Fabric we have the opportunity to create the end-to-end solution all within the Microsoft Fabric ecosystem and in near real-time!