Paul Andrew
mrpaulandrew.com
Microsoft Data Platform MVP. 10+ years’ experience working with the complete on premises SQL Server stack. Now working as a principal consultant and solution architect dealing with data platform deliveries in Azure.
SQLBits 2024
An Evolution of Data Architectures - Lambda, Kappa, Delta, Mesh & Fabric
How has advancements in highly scalable cloud technology influenced the design principals we apply when building data platform solutions?
How has advancements in highly scalable cloud technology influenced the design principles we apply when building data platform solutions? Are we designing for just speed and batch layers or do we what more from our platforms, and who says these patterns must be delivered exclusively?
Let’s disrupt the theory and consider the practical application of all things Microsoft now has to offer, where concepts and patterns meet technology. Can we now utilise cloud technology to build architectures that cater for lambda, kappa, and Delta Lake concepts in a complete stack of services? And should we be considering a solution that offers all these principals in a nirvana of data insight perfection? How does Data Fabric as a concept fit with Microsoft Fabric as a product?
In this session we’ll explore the answer to all these questions and more in a thought provoking, argument generating look at the challenges every data platform engineer/architect faces.
Let’s disrupt the theory and consider the practical application of all things Microsoft now has to offer, where concepts and patterns meet technology. Can we now utilise cloud technology to build architectures that cater for lambda, kappa, and Delta Lake concepts in a complete stack of services? And should we be considering a solution that offers all these principals in a nirvana of data insight perfection? How does Data Fabric as a concept fit with Microsoft Fabric as a product?
In this session we’ll explore the answer to all these questions and more in a thought provoking, argument generating look at the challenges every data platform engineer/architect faces.