arxiv
PublishedJuly 29, 2026 at 4:00 AM
▲bullish
Seesaw: Accelerating Training by Balancing Learning Rate and Batch Size Scheduling
Publisher summary· verbatim
arXiv:2510.14717v2 Announce Type: replace Abstract: Increasing the batch size during training -- a ''batch ramp'' -- is a promising strategy to accelerate large language model pretraining. While for SGD, doubling the batch size can be equivalent to halving the learning rate, the optimal strategy for
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
The Bubble Brief
MON · WED · FRIRead optimization insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗