Lots of ADF, lots of data, lots of automation and lots of lessons learned. Backups aren't as useful as they look, dedicated pools have several "interesting" features in the small print, ADF is not always your friend and how to mitigate the sometimes deadly embrace of throughput vs concurrency trade off.
The video is not available to view online.
If you like writing SQL and need a cheap data platform in Azure, this session is for you. This session will describe the architecture for a metadata driven, minimalistic Azure data platform using Synapse Analytics (serverless SQL) and data lake. You will get to know when this works well, and when it does not.
The video is not available to view online.
After this session, you will be able to conceptualize and implement different Power BI refresh scheduling patterns in ADF/Synapse. You’ll learn what limitations in Power BI you can overcome with an “external” orchestration tool as well as the different building blocks available. Finally, we will go through an example implementation as well as a step-by-step demo of how you can set this up yourself.
The video is not available to view online.
Have you ever found yourself at the start of an Azure data engineering project, unsure about what tool to choose? Speak no more! In this session we will discuss three often used data engineering tools on Azure: - Azure Data Factory - Azure Databricks - Azure Synapse Analytics
The video is not available to view online.
The aim of this session is to highlight the process of implementing Azure Synapse Link for Dataverse and to discuss the reality of working with the data as it is incrementally updated in Azure.
The video is not available to view online.
In this session, seasoned data engineer and youtube grumbler Simon Whiteley takes us on a journey through the current industry trends and buzzwords, carving through the hype to get at the underlying ideals.
The video is not available to view online.
This session session aims to give you that context. We'll look at how spark-based engines work and how we can use them within Synapse Analytics. We'll dig into Delta, the underlying file format that enables the Lakehouse, and take a tour of how the Synapse compute engines interact with it. Finally, we'll draw out our whole Lakehouse architecture
The video is not available to view online.
Based on real world experience let’s think about just how far the breadth of our knowledge now needs to reach when starting from nothing and building a complete Microsoft Azure Data Analytics solution.
The video is not available to view online.
Join us to learn why data governance is increasing in popularity and what you need to know about what data governance really is.
The video is not available to view online.
In this session I'll guide you from through a secure reference architecture with Data Factory, Databricks, Data Lake, and Azure Synapse, working together as a secure, fully productionised platform. Each has their own idiosyncrasies, but this session will teach you the options available and the pitfalls to avoid.
The video is not available to view online.
Explore the changes that have been made to Azure Synapse Analytics and how this has changed it’s use over time. We will review how these feature additions have impacted the methods used for transforming, storing, and querying data so that you can evaluate whether it would be a good fit for your data environment.
The video is not available to view online.
Combining data from multiple sources can be performed using a number of different tools including Azure Synapse Integration/Azure Data Factory, Spark and Power BI Data Flows. We will explore which tool or combination of tools to select to best match your data environment.
The video is not available to view online.
Let's take a look at Synapse Link - it's capabilities and restrictions! Synapse Link is Microsoft's new solution to push your OLTP data in near-real time to Azure Synapse for analytical purposes.
The video is not available to view online.
In this demo-rich session you will learn how you can implement a framework for data quality validation and monitoring, spanning your end-to-end data platform including Power BI!
The video is not available to view online.
In this session we will cover how to architect an end-to-end enterpise analytics platform so that we utilize the best of both worlds. The extremely versatile ETL capabilities of Synapse and the powerful data modelling in Power BI.
The video is not available to view online.
SQLBits' has brought members of the Azure Synapse Program Group to Wales to ask YOUR questions. Bring your questions for: Dedicated SQL Pools, Serverless SQL Pools, Spark Pools, Pipelines, Kusto and everything else Synapse related.
The video is not available to view online.
In this session, you will get to learn how to enrich your data in spark tables with models created using Automated ML in Azure Synapse Analytics. We will be looking at a demo where we will create regression and classification models using Automated ML and how to use these models for prediction in Azure Synapse Analytics.
The video is not available to view online.
Are you planning a migrating of your data platform to Azure Synapse Analytics? Is it currently based on Azure Databricks, Azure Data Factory, and Azure Data Lake Storage? Make sure to grab these 10 tips! We'll talk about Spark compatibilities, orchestration pitfalls and solution deployment differences.
This session will walk you through three different ways to set up an affordable Azure based Data Warehouse solution. Covering pros and cons with each of the architectures.
Overview to some of the more popular Azure Data Engineering services used to analyze data
I will show a few challenges while deploying Azure Data Factory and solution for them.
Welcome to Azure DevOps trio, a tale about how a development team and an operations team have to bond together and start using Azure DevOps for Data Platform deployments.
The video is not available to view online.
Introductory view into Azure Synapse Analytics
A intro session showing the whys, how's and what's for building a Data Lakehouse in Azure Synapse Analytics
We'll explore delivering this framework within an enterprise and consider an architect’s perspective on a wider platform of ingestion/transformation workloads with multiple batches and execution stages.
This data governance session guides you through the organization processes, policies and roles that are required for a successful data governance adoption. In addition to demos showing the possibilities of Azure Purview (the MS data governance service), we will share about experiences from our data governance workshops and adoption projects with our customers.
I'll explain the current popular data architectures: Data Lakehouse, Data Mesh, and Data Fabric
Session covering table distributions, partitioning , RSC and materialised views.
DW Automation and Design Best Practices
Reality Check on Microsofts Enterprise Scale Analytics Framework
A tale about how a development team and an operations team must bond together and figure out how to use GitHub and Azure DevOps together for Data Platform deployments.
Tips and tricks for getting the best performance out of Spark SQL on Synapse Analytics while keeping costs under control.
A look at the features and uses of Synapse Analytics Data Explorer Pools
The video is not available to view online.
Hybrid Transactional Analytical Processing solve the age old problem of integrating operational processes with analytical capabilities within a single system. Find out what they're and how they deliver value
Learn how to easily build your lake database without having to start with a blank canvas on Azure Synapse.
What happens when you mix one rapidly-changing startup, one data analyst, one data engineer, and one hypothesis that Azure Synapse Analytics could be the right tool of choice?
There is a lot of content available on Synapse for Data Engineering, but what about Machine Learning? In this session we will look at how to integrate a SparkML model in Synapse.
Get to grips with data loading in Synapse.
The video is not available to view online.
A data warehouse is a method for providing a single source of truth, but there may be issues on relying on just one model as it does not meet the needs of all users or all types of data. In this session we will explore how to build a data environment which provides flexibility to different groups of users and examples of how to implement different types of technology to provide a broader set of solutions using Azure Synapse, Data lakes and Power BI.
The video is not available to view online.
Curious what Azure Synapse Analytics brings to the table? Bring your scuba gear, as we take a dive and explore everything it has to offer!
Everything you need to know for impelenting a Lakehouse in the enterprise
Building a dashboard using Serverless SQL Pools in a performant way
Get your data lake into shape with the recently announced Database Templates for Synapse Analytics.
The video is not available to view online.
In this session we'll talk about what Mapping Data Flows can do, what it can't do and how far you can take them in building a data platform framework.
The video is not available to view online.
Synapse Analytics Serverless SQL Pools and Pipelines are the dream team when it comes to managing big data in Azure Data Lake, this session will take you through the process!
How has advancements in highly scalable cloud technology influenced the design principals we apply when building data platform solutions?
The video is not available to view online.
The fundamentals of building a lakehouse with Synapse
In this session Alberto compares different models with a star schema, showing the technical details why a star schema is quite always the best choice.
Azure Synapse Analytics combines the power of Data Lakes with Data Warehouses, empowering the organizations to build Big Data, Advanced Analytics and Business Intelligence in one single platform.
AI and data is at the center of the digital feedback loops. We have invested in a comprehensive portfolio of AI tools, infrastructure and services. Come to this session to get an update of Azure AI with demos.
<<12>>