arxiv
PublishedSeptember 12, 2026 at 4:00 AM
—neutral
Output Embedding Centering for Stable LLM Pretraining
Publisher summary· verbatim
arXiv:2601.02031v3 Announce Type: replace-cross Abstract: Pretraining of large language models is not only expensive but also prone to certain training instabilities. A specific instability that often occurs at the end of training is output logit divergence. The most widely used mitigation strategie
Stay posted· Newsletter
A 5-min weekly brief — top movers, price watch, story of the week.
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivTeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents3harxivNatural Language Access to Domain-Specific Metadata: A Reusable Framework for LLM Query Generation3harxivSPECTRA: Band-Routed Embedding and Stage-Wise LoRA for Cross-Sensor Fine-Tuning of Geospatial Foundation Models3harxivTowards a Deterministic Math Solver for Clinical Language Models3hThe Bubble Brief
WEEKLYRead AI insights every Tuesday — top movers, new releases, story of the week.
Originally published on arxiv ↗