22-25 April 2026
Video unavailable
SQLBits 2016

Dumping data into Azure Data Lake with Data Factory

An introduction with worked examples of the new Data Lake storage platform in Azure.
This session is all about putting big data to work. To do that we need to be clear on objectives and to transform a proof of concept into a reliable, resilient and repeatable production process.  To make that work we'll show you how to hook up Data Lake to a variety of sources using Data Factory using Visual Studio so that we also get source control.  The trick with all of this is to use the scalability of the cloud to minimise the costs involved by turning on and off the services we need.  Inevitably things will go wrong with our demo and that is part of the plan as we want to show you how to diagnose problems and fix them.