Luke Moloney

Are you look for an introduction to Airflow? Are you wanting to use Airflow in Fabric? This is the session for you. In this session we will run through what airflow is, how it works and how it works in Fabric.

If you are looking to build applications on-top-of and in Fabric - then this is the session for you. This session outlines keys to build applications with Fabric, the trade-offs and complexities.

Part 1 explores lessons from large Fabric data engineering deployments and how to optimize your platform. It focuses on Delta tables in Fabric, tuning options, how they work, and their impact on workloads, using demos to show real-world trade-offs.

Part 2: Optimizing Spark in large-scale Fabric deployments. Learn to maximize execution efficiency through Spark Job Definitions, Livy API, and Native Execution Engine. Demo-centric session showcasing real-world trade-offs and optimization strategies.

Based on Luke’s experience in working with large-scale Fabric deployments - especially within the Financial Services Industry, this session goes through some the key design questions and considerations that will be faced during large scale Fabric adoptions in Enterprise environments. Some of the areas that will be covered include: Workspace, capacity and tenant design Managing user roles, skills and operational requirements Balancing technical flexibility, whilst reducing technical sprawl Establishing good practices from the beginning. How to monitor, log and manage your environment Regardless of whether you are planning a Fabric deployment with 1000s of users, or a couple of users - this session provides practical lessons and tips you can adopt.