Data lakes have been around for years yet there is still much hype and hyperbole surrounding their use. This session covers basic design patterns and architectural principles to make sure you are using your data lake and underlying technologies effectively. We will cover topics like best practices for data ingestion and recommendations on file formats as well as designing effective zones and folder hierarchies to prevent the dreaded "data swamp". We’ll also discuss how to consume and process data from a data lake as well as the often overlooked areas of data governance and security. This session goes beyond corny puns and broken metaphors and instead provides real-world guidance gleaned from dozens of successful data lake implementations in Azure.

Presented by Jason Horner at SQLBits XX