arxiv
PublishedNovember 9, 2026 at 5:00 AM
Prompt Lottery in LLM-as-a-Judge: Measuring and Mitigating Sensitivity to Syntactic Rephrasing
Publisher summary· verbatim
arXiv:2610.38076v2 Announce Type: replace Abstract: LLM-as-a-Judge has become a standard for evaluating large language models, yet most approaches implicitly assume that a single judge prompt functions as a stable evaluation instrument. Prior work has primarily explored deliberate prompt modificatio
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivPhantom Consensus: Measuring Social Reasoning in Multi-Agent LLM Decision-Making12harxivROSE: Risk-Aware Orthogonal Subspace Navigation for Lifelong Knowledge Editing in Multimodal Large Language Models12harxivMeasuring and Mitigating the Distributional Gap Between Real and Simulated User Behaviors12harxivFindLink: Learning to Assess Scientific Connections from Source-Grounded Premises12hThe Bubble Brief
MON · WED · FRIRead AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗