arxiv
PublishedJuly 2, 2026 at 4:00 AM
—neutral
Logit-Contribution Scoring Identifies Non-Literal Retrieval Heads
Publisher summary· verbatim
arXiv:2607.01002v1 Announce Type: cross Abstract: In long-context use, large language models frequently synthesize answers from the meaning of a relevant context span rather than literally copy-pasting them. Identifying which attention heads perform this synthesis matters for interpreting long-conte
Stay posted· Newsletter
A 5-min weekly brief — top movers, price watch, story of the week.
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivLearning to Discretize: Diffusion-Based Adaptive Mesh with Spectral Guidance10harxivToward Trustworthy Autonomous Science: A Two-Year Community Roadmap10harxivReflectWorld-MM: An Entity-Oriented Multimodal Memory System for Open-Ended Video Streams10harxivKeep Policy Gradient in Charge: Sibling-Guided Credit Distillation for Long-Horizon Tool-Use Agents10hThe Bubble Brief
WEEKLYRead AI insights every Tuesday — top movers, new releases, story of the week.
Originally published on arxiv ↗