SQLBits 2024

Low flying planes and Realtime Data Analytics

Using Microsoft Fabric Real Time Analytics to analyze 30 TB Data of aviation data in real time in Power BI. We will show how this can be acheived.
You know what the problem is these days? Some planes approaching the airport are always too low and bother the people that live near the airport by their noise. What if there only would be a technology with which we could analyze in real time which planes are too low? Because world wide aviation produces a massive amount of data this technology should be able to analyze Terrabytes of Data in the blink of an eye. Real Time Analytics in Microsoft Fabric to the rescue! Real-time Analytics in Fabric leverages top grossing Azure services like Event hub, Azure Stream Analytics and Azure Data Explorer that have been fused together into an integrated experience with Eventstream and KQL Database. This session will go behind into the KQL language and some of its unique capabilities of analyzing and joining billions of records.
Devang Shah, Fabric CAT PM at Microsoft who is focussing on Azure Data Explorer (Kusto) and long time Data Platform MVP Frank Geisler will demonstrate the capabilities of ADX in Fabric with a massive demo: As per FlightAware, there are about 9000-10000 flights in air at any given point in time. Certain countries mandate that aircraft must fly above 2500 feet in residential zones. Wondering what flights and altitude levels have go to do with Real-time Analytics in Fabric. In this session, you will see how billions of data points are stream ingested into Real-time Analytics, analysed at scale using advanced geospatial and timeseries analysis queries and then visualizing it all in Power BI in near real-time. With this setup, we are preparing a dashboard for port authorities of a town that can monitor the flights that are violating the noise control altitude that has been put in place by the city.