arxiv
PublishedJuly 3, 2026 at 4:00 AM
—neutral
How to Allocate Your Tokens? Scaling Laws with Training Steps and Batch Size
Publisher summary· verbatim
arXiv:2607.01487v1 Announce Type: new Abstract: We propose a scaling law that takes into account model size and training data while explicitly splitting the latter into training steps and batch size (called three-term law). Fitting the proposed law on a large set of training runs, we find that it co
Stay posted· Newsletter
A 5-min weekly brief — top movers, price watch, story of the week.
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivTransformer-Based Inverse Microrheology for Experimental Mechanics at Ultra-High Strain Rates16harxivDeployment Risk Assessment Using Diff-Aware Features: A Case Study at Prime Video16harxivSolarChain-Eval: A Physics-Constrained Benchmark for Trustworthy Economic Agents in Decentralized Energy Markets16harxivForget Narrowly, Retain Broadly: Unlearning as an Asymmetric Generalization Problem16hThe Bubble Brief
WEEKLYRead AI insights every Tuesday — top movers, new releases, story of the week.
Originally published on arxiv ↗