Tori Tompkins

Evaluating LLMs is essential for ensuring they perform accurately and align with safety standards. This talk explores two frameworks for LLM Evaluation: RAGAS and MLFlow. We’ll explore practical applications of these frameworks, including a live demo that walks through setting up an evaluation pipeline, monitoring results, and refining metrics.

Deploying machine learning models still remains one of data science's largest challenge, but MLOps is your answer. We'll explore how Databricks can be an end-to-end MLOps tool and the one-stop solution to this problem. Session includes practical demos on: Mlflow, Feature Store, Real-Time Serving Endpoints and Model Monitoring.

In the fast-growing world of data, there's no one-size-fits-all skill set for data professionals. Join us as we define roles, explore essential skillsets, and share our personal journeys, revealing how these roles collaborate in daily operations and shape typical data projects.

In this session, we will cut through the marketing buzzwords to share experiences, tips, and tricks on how to be successful with Data Science and Analytics in the real world. Tune in to hear the team share real-world experience and get takeaways from industry insiders on real projects with impact. We will also discuss the ethics and fairness of Data Science and Analytics projects and how we can be more inclusive from a technology, people, and process standpoint.