Anon: Extrapolating Adaptivity Beyond SGD and Adam
arXiv:2605.02317v3 Announce Type: replace Abstract: Adaptive optimizers such as Adam and non-adaptive methods like SGD exhibit distinct generalization capabilities across different architectures. Prior tunable optimizers attempt to bridge this gap by strictly interpolating between SGD and Adam, effe