arxiv
PublishedNovember 2, 2026 at 5:00 AM
Quantifying Concentration Phenomena of Mean-Field Transformers in the Low-Temperature Regime
Publisher summary· verbatim
arXiv:2605.10931v2 Announce Type: replace-cross Abstract: Transformers with self-attention modules as their core components have become an integral architecture in modern large language and foundation models. In this paper, we study the evolution of tokens in deep encoder-only transformers at infere
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivEnhancing Sentiment Classification on Small Datasets through Data Augmentation and Transfer Learning8harxivDAPS: Dependency-Aware Premise Selection for LLM Theorem Proving8harxivCodeLift: Your Test Suite Is Secretly a Dense SWE Curriculum8harxivCumulative Marginal Matching for One-Step Diffusion8hThe Bubble Brief
MON · WED · FRIRead AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗