arxiv
PublishedSeptember 11, 2026 at 4:00 AM
—neutral
Looped GPT-BERT: Trading Parameters for Computation in Small Language Modeling
Publisher summary· verbatim
arXiv:2609.09691v1 Announce Type: cross Abstract: When training data are limited, increasing parameter count is not the only way to improve language-model performance. A small parameter set, when repeatedly applied, can also deliver comparable performance. We study Looped GPT-BERT in the BabyLM 2026
Stay posted· Newsletter
A 5-min weekly brief — top movers, price watch, story of the week.
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivBringing Value Models Back: Generative Critics for Value Modeling in LLM Reinforcement Learning8harxivSubagents vs Agent Skills: Executing Reusable Knowledge for Long-Horizon Agentic Tasks8harxivDistribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts8harxivIn RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning8hThe Bubble Brief
WEEKLYRead AI insights every Tuesday — top movers, new releases, story of the week.
Originally published on arxiv ↗