I'm a data engineer and Microsoft Data Platform MVP. I specialise in building and automating analytics platforms using Microsoft technologies from the SQL Server stack to the Azure cloud. I’m a fervent advocate of DataOps, with a technical focus on bringing automation to both analytics development and operations. An active member of the data community and keen knowledge-sharer, I'm a volunteer, organiser, speaker, blogger, open-source contributor and author – my book Azure Data Factory by Example was published by Apress in June 2021. I hold a PhD in Computer Science and participate enthusiastically in choral singing, craft ale and cocktails, most successfully in that order.


In this session we'll look at ETL metadata, use it to drive process execution, and see benefits quickly emerge. I'll show how a metadata-first approach reduces complexity, enhances resilience and allows ETL processing to become self-organising.