Dustin Vannoy
Dustin Vannoy is a Data Engineering Consultant with 15 years experience solving business problems with analytics and big data solutions. He is passionate about all aspects of data engineering, especially building data platforms and streaming data pipelines. He currently focuses on building data lakes and data pipelines in Azure with Apache Spark, Kafka, Python, and Scala. Dustin is a technical leader in San Diego and the co-founder of Data Engineering San Diego group. He encourages others to grow their data skills by making tutorials and speaking, particularly around Southern California and Baja California.
Dustin Vannoy's Sessions
Add AI to your ETL: Cognitive Services + Apache SparkSQLBits 2022
This session describes why the AI capabilities of Cognitive Services are useful in taking data enrichment to the next level and how to use Cognitive Services in your Spark data pipelines.
Azure Data Engineer Skills for SuccessSQLBits 2022
Data Engineer is an exciting and rewarding role. This session will describe a data engineer's responsibilities and give an overview of the skills needed to be an Azure Data Engineer.
Monitoring Apache Spark on Azure DatabricksSQLBits 2022
You can get started easily with the monitoring tools that Databricks offers by default, but this isn't always enough. In this session you will learn how to monitor Spark using the open source UI, the added Databricks features that help most, and custom logging using Log Analytics.