arxiv
PublishedSeptember 15, 2026 at 4:00 AM
Turkish MMLU Pro: Traceable Option Augmentation and Its Validity Limits in Turkish Multiple-Choice Evaluation
Publisher summary· verbatim
arXiv:2609.15467v1 Announce Type: cross Abstract: Adding answer options can lower multiple-choice scores without improving assessment validity. Turkish MMLU Pro examines this distinction using 12,000 Turkish-source questions across 58 sections. Each question retains its stem, five original options a
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivAutomatic Sentence Completion Using Bengali Audio Speech with a Transformer-Based Early Speech Recognition System2harxivWhat Should We Remove? Evaluating the Reliability and Costs of RLVR Data Decontamination2harxivFGSS-BO: Feedback-Guided Hypothesis Management for LLM-Based Bayesian Optimization2harxivLLM-Based Weak Annotation for Cybersecurity Tweet Classification: A Teacher-Student Framework2hThe Bubble Brief
MON · WED · FRIRead AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗