arxiv
PublishedNovember 4, 2026 at 5:00 AM
When Answer Evaluation Misleads Confidence Selection: Fact-Grounded Form Grading for Open-Ended QA
Publisher summary· verbatim
arXiv:2608.25654v2 Announce Type: replace Abstract: Many benchmarks now prefer open-ended questions for testing LLM and NLP methods. We find that the choice of a calibration rule can flip when only the correctness labels change: on 141 pilot answers, rules chosen with exact-match labels look 0.239 B
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivFrom Fragmentation to Fusion: A Survey and Roadmap for Omnimodal Embeddings12harxivFidelity Collapses with Table Size, Not Turn Count: Delivery Architecture in a Deployed Tool-Using Agent12harxivFrom Lookups to Lessons: Turning Retrieved Knowledge into Parametric Memory12harxivSteering Readerly Dynamics: Trajectory-Guided Story Generation with Large Language Models12hThe Bubble Brief
MON · WED · FRIRead AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗