The Agenda
Agenda HomeSQLBits 2024 runs from Tuesday 19th – Saturday 23rd March.
Architecture & Infrastructure
Lakehouse in a day
Description
Are you looking into the Lakehouse architecture and want to know where to start? Want to get hands-on experience with all the different Azure components you can use to achieve this?
Well then, we have a treat for you!
During this full day training session, you will build a new green field Lakehouse under the support of experts in the field!
We will start of the day with a general introduction to the Lakehouse concept and give a brief overview of all the components that you can use.
After that it is up to you to decide what you want to build and how you are going to build it based on the requirements you received!
During the exercises we will be having some OLTP sources you will need to import in a dynamic and incremental way, guided by the best practices the coaches provide you. This will tackle the bronze layer and all the things you need to know about it.
After getting that data in your bronze layer, you will build out the silver layer based on a few real requirements! During this part, you will learn how to incrementally load data to your silver layer and make sure your cleansing is done right and in an effective and dynamic way!
Of course, there is no Lakehouse without a gold layer which serves the business needs of your company. Together with us, we will build out a robust gold layer focused on performance & business needs!
If you do not know where to start, don’t worry, during this day we will also be providing you with loads of sample scripts based on the best practices seen at most customers!
The technologies that will be used during this training day are Azure Synapse Analytics, Azure Databricks, Delta Lake, Power BI, Serverless SQL Pools, Azure Data Lake, Spark Notebooks, Synapse Integrate Pipelines & Azure Data Factory!
Well then, we have a treat for you!
During this full day training session, you will build a new green field Lakehouse under the support of experts in the field!
We will start of the day with a general introduction to the Lakehouse concept and give a brief overview of all the components that you can use.
After that it is up to you to decide what you want to build and how you are going to build it based on the requirements you received!
During the exercises we will be having some OLTP sources you will need to import in a dynamic and incremental way, guided by the best practices the coaches provide you. This will tackle the bronze layer and all the things you need to know about it.
After getting that data in your bronze layer, you will build out the silver layer based on a few real requirements! During this part, you will learn how to incrementally load data to your silver layer and make sure your cleansing is done right and in an effective and dynamic way!
Of course, there is no Lakehouse without a gold layer which serves the business needs of your company. Together with us, we will build out a robust gold layer focused on performance & business needs!
If you do not know where to start, don’t worry, during this day we will also be providing you with loads of sample scripts based on the best practices seen at most customers!
The technologies that will be used during this training day are Azure Synapse Analytics, Azure Databricks, Delta Lake, Power BI, Serverless SQL Pools, Azure Data Lake, Spark Notebooks, Synapse Integrate Pipelines & Azure Data Factory!
Learning Objectives
They will learn to actually build a Lakehouse using all the best practices guided by experts in the field. They will have a working example of a Lakehouse to play with and loads of sample scripts provided by the team.
Previous Experience
The delegates should have worked with Azure before and know how to create resources. Prior knowledge in SQL/SPARK is beneficial.
Tech Covered
Azure, Synapse Analytics, Power BI, Spark, Data Lake, Developing, Managing, Optimising, Data Bricks, Architecture & Infrastructure, Big Data & Data Engineering, Data Loading Patterns & Techniques