arxiv
PublishedNovember 4, 2026 at 5:00 AM
Gated Against One Model, Open to the Next: Option-Only Solvability in Legal Multiple-Choice Benchmarks
Publisher summary· verbatim
arXiv:2608.15428v2 Announce Type: replace Abstract: Multiple-choice benchmarks are graded on whether a model picks the right option, not on whether it needed the question. Measuring that gap takes care: a model answering A to most items scores above chance wherever the key sits at A, and reads as re
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivFrom Fragmentation to Fusion: A Survey and Roadmap for Omnimodal Embeddings12harxivFidelity Collapses with Table Size, Not Turn Count: Delivery Architecture in a Deployed Tool-Using Agent12harxivFrom Lookups to Lessons: Turning Retrieved Knowledge into Parametric Memory12harxivSteering Readerly Dynamics: Trajectory-Guided Story Generation with Large Language Models12hThe Bubble Brief
MON · WED · FRIRead AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗