Blogger, speaker, #sqlfamily member. Microsoft Data Platform MVP. Data passionate, Data Engineer and Architect. Over 20 years of programming and experience with SQL Server databases (since 2000 version) he confirmed by certificates MCITP, MCP, MCTS, MCSA, MCSE Data Platform & Data management & analytics. He worked both as a developer and administrator of big databases designing systems from the scratch. Recently focused on Data Platform in Azure as a certified (Azure Dev-Ops Engineer Expert, Azure Developer Associate) Data Engineer and Azure Architect. Passionate about optimization of database systems, an advocate of code transparency, open-source projects and automation, DevOps and PowerShell fan. Since 2015 he has been living and working in the UK. Currently professionally associated with Avanade, an international consulting company. For many years tied with Data Community Poland (former PLSSUG), between 2012-2018 acted as a Member of the Audit Committee. He worked a couple of years as a volunteer and now as a co-organizer and speaker of the biggest SQL Server conference in Poland (SQLDay). An originator of the "Ask SQL Family" podcast and founder of SQLPlayer blog. Privately happy husband and father of two wonderful girls.


We will review this new feature of ADFv2, do deep dive to understand the mentioned techniques, compare them to SSIS and/or T-SQL and learn how modelled data flow runs Scala behind the scenes.
The session is for everyone who knows the data warehousing concept and wants to broad theirs horizons with modern capabilities of processing the data at scale.
I will show a few challenges while deploying Azure Data Factory and solution for them.