arxiv
PublishedJuly 16, 2026 at 4:00 AM
Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory
Publisher summary· verbatim
arXiv:2603.25112v2 Announce Type: replace Abstract: Standard evaluation of LLM confidence relies on calibration metrics (ECE, Brier score) that conflate how much a model knows (Type-1 accuracy) with how well its confidence signal tracks that knowledge (Type-2 metacognitive sensitivity). We apply Sig
Stay posted· Newsletter
A 5-min weekly brief — top movers, price watch, story of the week.
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivDemocratizing Agent Deployment Safety: A Structural Monitoring Approach18harxivHarnessing LLMs for Reliable Academic Supervision: A Comparative Study18harxivAccelerating A/B-Tests with Counterfactual Estimation: Reducing Variance through Policy Overlap18harxivTIDE: Trustworthy and Interpretable Battery Degradation Estimation with Contextual Learning and Symbolic Distillation18hThe Bubble Brief
WEEKLYRead AI insights every Tuesday — top movers, new releases, story of the week.
Originally published on arxiv ↗