If you like writing SQL and need a cheap data platform in Azure, this session is for you. This session will describe the architecture for a metadata driven, minimalistic Azure data platform using Synapse Analytics (serverless SQL) and data lake. You will get to know when this works well, and when it does not.
The video is not available to view online.
Have you ever found yourself at the start of an Azure data engineering project, unsure about what tool to choose? Speak no more! In this session we will discuss three often used data engineering tools on Azure: - Azure Data Factory - Azure Databricks - Azure Synapse Analytics
The video is not available to view online.
The aim of this session is to highlight the process of implementing Azure Synapse Link for Dataverse and to discuss the reality of working with the data as it is incrementally updated in Azure.
The video is not available to view online.
In this session, seasoned data engineer and youtube grumbler Simon Whiteley takes us on a journey through the current industry trends and buzzwords, carving through the hype to get at the underlying ideals.
The video is not available to view online.
The building a Data Lakehouse with Azure Databricks session is a dynamic presentation that benefits an array of Data professionals - data engineers, data architects, data analysts - by covering practices and techniques used to move, shape, orchestrate, and organize data that is made available for analytical solutions that build business insights.
The video is not available to view online.
This session session aims to give you that context. We'll look at how spark-based engines work and how we can use them within Synapse Analytics. We'll dig into Delta, the underlying file format that enables the Lakehouse, and take a tour of how the Synapse compute engines interact with it. Finally, we'll draw out our whole Lakehouse architecture
The video is not available to view online.
Based on real world experience let’s think about just how far the breadth of our knowledge now needs to reach when starting from nothing and building a complete Microsoft Azure Data Analytics solution.
The video is not available to view online.
Modern software engineering and management for ETL, so data analysts and engineers can spend less time on tooling and focus on getting value from data.
The video is not available to view online.
In this session, we will see how to use Delta Live Tables to build fast, reliable, scalable, and declarative ETL pipelines on Azure Databricks platform.
The video is not available to view online.
Managing cloud cost is no longer a "management approves the budget" type of thing. Cloud Engineers need to architecht their solutions in such a way that cost can be kept under control. This is not a one time thing. Monitoring, automatic downsizing, re-factoring are all parts of the yearly tasks of any cloud team. We'll discuss theory, techniques, best practices and lessons learned.
The video is not available to view online.
We're not supposed to use production in dev right! But generating proper test data is not easy, get's even harder when you need quite a lot of it. I generate Terabytes of it, and without much trouble. Let me show you how!
The video is not available to view online.
Cloud migration projects are often massive projects with sprawling scopes. Don't you want some help sorting through this enormous pile of work? Join an experienced cloud migration consultant for a targeted walkthrough of their cloud migration success checklist so you can make sure your project gets off to a good start and reaches a successful completion.
The video is not available to view online.
Combining data from multiple sources can be performed using a number of different tools including Azure Synapse Integration/Azure Data Factory, Spark and Power BI Data Flows. We will explore which tool or combination of tools to select to best match your data environment.
The video is not available to view online.
One of the new applications within Microsoft Purview Governance Portal are Access Policies. Access policies in Microsoft Purview allow you to manage access to different data systems across your entire data estate. The big advantage of these policies is that you do not have to apply RBAC roles and you have an overview of all applied policies. Are you a data consumer? Then the self-service access policy is an easy way to request access to data while browsing or searching for data. Are you a data producer? Then access policies helps you to easily create and publish access to data sources In this session, I will explain and show you how to create and publish policies and how to set up a self-service access workflow.
The video is not available to view online.
So you’re the data person in your company and you need to look to the sky. Maybe you've been wanting to do it for a while, maybe it's a mandate coming from the top. What are the steps you need to think about? Where do you even start? What are the risks? How can you begin to wrap your head around all the different things you have to coordinate? Companies don't just need the IDEA that they should move to cloud, but a guide on how-to-do it. This session will not only give you that guide to get you going, but a foundation to take to your bosses to show just how awesome you really are.
The video is not available to view online.
In this demo-rich session you will learn how you can implement a framework for data quality validation and monitoring, spanning your end-to-end data platform including Power BI!
The video is not available to view online.
SQLBits' has brought members of the Azure Synapse Program Group to Wales to ask YOUR questions. Bring your questions for: Dedicated SQL Pools, Serverless SQL Pools, Spark Pools, Pipelines, Kusto and everything else Synapse related.
The video is not available to view online.
If you're getting started with an implementation using Infrastructure as Code, one of the first things to figure out is which tool to use. In this session will dive into the details of the differences of Bicep and Terraform to help you choose the best option for your scenario. We will begin the session by going through the similarities of Bicep and Terraform, but will then jump straight into the differences of these two tools. We will cover how state is handled, how configuration is scoped and how making changes is evaluated. Then we will go through how existing resources are handled and using preview features. At the end of this session you will be able to choose which tool is the best option for your implementation!
The video is not available to view online.
In this demo filled session, learn how to view lineage data from Databricks Unity Catalog in Microsoft Purview.
The video is not available to view online.
Azure Functions are great for a wide range of scenarios, including working with data on a transactional or event-driven basis. In this session, we'll look at how you can interact with Azure SQL, Cosmos DB, Event Hubs, and more so you can see how you can take a lightweight but code-first approach to building APIs, integrations, ETL, and maintenance routines.
The video is not available to view online.
<<1234>>