SQLBits 2022

Migrate traditional DW transformations to Spark/Scala

Join me to learn how to migrate a traditional DW transformation process to Spark/Scala based platform and reuse existed experience
Nowadays, Spark is becoming more and more popular framework for building transformations either big data or traditional DW world. The difference is DW transformations is much more complex than big data specific. Also, moving from SQL-based world to Scala needs an additional efforts from developers. In this session, I will show you how to reuse existed DW experience and programming technics to implement a transformation application in Spark using Scala language. This topic will include: DW objects translation to Spark/Scala, code structuring, piping transformation, templating, unit testing

Feedback link: https://sqlb.it/?7357