Reading Group (+🧋): JUDGEMENTBENCH: Comparing Rubric and Preference Evaluation for Quality Assessment

Join the Snorkel AI Reading Group, a recurring forum to explore the latest frontier developments in AI while building meaningful connections within the community. In this afternoon session, Russell Yang , an AI Engineering Fellow at Stanford Law School, will cover his recent paper: JudgmentBench: Comparing Rubric and Preference Evaluation for Quality Assessment . Agenda: 3pm - doors open 3:30pm - talk begins 🧋🧋🧋 Boba tea and other refreshments will be provided ! 🧋🧋🧋 Among other things, you'll learn: What JudgmentBench is: 30 real-world legal tasks paired with 1,539 rubric scores and 1,530 pairwise preference judgments, all collected from practicing attorneys (including at major U.S. law firms). Why it's the first public dataset in a…