Monitoring Apache Spark on Azure Databricks

Once your Apache Spark applications are deployed to production you need a way to monitor job success and performance. You can get started easily with the monitoring tools that Databricks offers by default, but this isn't always enough. In this session you will learn how to monitor Spark using the open source UI, the added Databricks features that help most, and custom logging using Log Analytics.