arxiv
PublishedApril 24, 2026 at 4:00 AM
—neutral
How Much Is One Recurrence Worth? Iso-Depth Scaling Laws for Looped Language Models
Publisher summary· verbatim
arXiv:2604.21106v1 Announce Type: cross Abstract: We measure how much one extra recurrence is worth to a looped (depth-recurrent) language model, in equivalent unique parameters. From an iso-depth sweep of 116 pretraining runs across recurrence counts $r \in \{1, 2, 4, 8\}$ spanning ${\sim}50\times$
Discussion
No replies yet. Be first.
Originally published on arxiv ↗