Reading Group (+🧋): Agents' Last Exam

Join the Snorkel AI Reading Group, a recurring forum to explore the latest frontier developments in AI while building meaningful connections within the community. In this afternoon session, Yiyou Sun and Xinyang Han , Postdoctoral Researchers at UC Berkeley, will cover their recent paper: Agents' Last Exam . Agenda: 4 pm - doors open 4:30 pm - talk begins 🧋🧋🧋 Boba tea and other refreshments will be provided ! 🧋🧋🧋 Among other things, you'll learn: ALE is a benchmark designed to evaluate AI agents on long-horizon, economically valuable, real-world tasks with verifiable outcomes—developed in collaboration with 250+ industry experts and covering 1,000+ tasks across 55 subfields in 13 industry clusters. Widely-used benchmarks lack sustained performance measurement on real, economically valuable workflows, creating a systematic gap between benchmark success and meaningful deployment across professional domains. ALE grounds task coverage in O*NET / SOC 2018, the U.S. federal occupational taxonomy, ensuring systematic, reproducible coverage of non-physical job categories at scale. The…