arxiv
PublishedMay 21, 2026 at 4:00 AM
▲bullish
From SGD to Muon: Adaptive Optimization via Schatten-p Norms
Publisher summary· verbatim
arXiv:2605.19781v1 Announce Type: new Abstract: Modern optimizers, like Muon, impose matrix-wise geometry constraints on their updates. These matrix-wise constraints can be unified under Linear Minimization Oracle (LMO) theory. However, all current methods impose fixed LMO geometries for the update
Stay posted· Newsletter
A 5-min weekly brief — top movers, price watch, story of the week.
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivBeyond a Single Direction: Chain-of-Thought Disrupts Simple Steering of Refusal4harxivRobustSpeechFlow: Learning Robust Text-to-Speech Trajectories via Augmentation-based Contrastive Flow Matching4harxivVarRate: Training-Free Variable-Rate KV Cache Compression for Long-Context LLMs4harxivAdaptive Multi-Step Lookahead Decoding for Diffusion Language Models4hThe Bubble Brief
WEEKLYRead optimization insights every Tuesday — top movers, new releases, story of the week.
Originally published on arxiv ↗