Oliver Engels
Oliver Engels is CEO of oh22data AG, a Microsoft Gold Partner in Germany specializing in Analytics and Cloud Technology. He is a Microsoft Data Platform MVP and a Microsoft pTSP for Data and AI
SQLBits 2024
Data Testing with HEDDA.IO
Explore the pivotal role of data testing in ensuring accuracy, completeness, and reliability in data engineering. Learn how HEDDA.IO, a versatile data quality tool, seamlessly integrates into diverse environments such as Azure Data Factory, Azure Databricks, Azure Synapse, Microsoft Fabric, and custom applications. This session provides practical insights into HEDDA.IO's application within a lake house concept or event-driven architecture. Through informative discussions and hands-on demonstrations, discover how HEDDA.IO enhances data testing processes, empowering data engineers to rectify errors and anomalies, ensuring robust and reliable data for downstream analytics and decision-making.
Data testing is a crucial aspect of data engineering tasks and projects, involving the validation and verification of data to ensure its accuracy, completeness, and reliability. It encompasses various processes, such as checking for data consistency, precision of transformations, and adherence to schema specifications. By conducting comprehensive data testing, data engineers can identify and rectify errors, anomalies, or discrepancies, ensuring that the processed data meets the intended quality standards and is reliable for downstream analytics and decision-making.
This process becomes even more pivotal with the introduction of versatile solutions like HEDDA.IO. As a comprehensive data quality tool, HEDDA.IO seamlessly integrates into diverse environments, from Azure Data Factory to Azure Databricks, Azure Synapse, and Microsoft Fabric, and can also extend custom applications.
This talk aims to delve into the practical aspects of using HEDDA.IO in various platforms, illustrating its role in a lake house concept or in an event driven architecture.
Through insightful information and practical demonstrations, we will show how HEDDA.IO enhances data testing processes, contributing to the overall robustness and reliability of data engineering tasks and projects.
This process becomes even more pivotal with the introduction of versatile solutions like HEDDA.IO. As a comprehensive data quality tool, HEDDA.IO seamlessly integrates into diverse environments, from Azure Data Factory to Azure Databricks, Azure Synapse, and Microsoft Fabric, and can also extend custom applications.
This talk aims to delve into the practical aspects of using HEDDA.IO in various platforms, illustrating its role in a lake house concept or in an event driven architecture.
Through insightful information and practical demonstrations, we will show how HEDDA.IO enhances data testing processes, contributing to the overall robustness and reliability of data engineering tasks and projects.
