arxiv
PublishedSeptember 30, 2026 at 4:00 AM
SMat-Attention: Structured Long-Context Sequence Modeling
Publisher summary· verbatim
arXiv:2609.36062v1 Announce Type: new Abstract: Long-context sequence models face a fundamental tradeoff: softmax attention uses flexible token-level interactions at quadratic cost, whereas linear attention obtains linear-time training and constant-time decoding by compressing history into a fixed-s
Stay posted· Newsletter
A 5-min weekly brief — top movers, price watch, story of the week.
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivRight Words, Wrong Moment: A Clinician-Grounded Analysis of Distress in 19,930 Conversations between Young People and ChatGPT59marxivSAGE: A Statistical Acceptance Gate for Self-Evolving Agents59marxivPowerZooJax: A JAX-based Power System Benchmark for Reinforcement Learning59marxivGeoWind2Plan: Mission-Time 3D Urban Wind Prediction for Energy-Efficient UAV Planning59mThe Bubble Brief
WEEKLYRead AI insights every Tuesday — top movers, new releases, story of the week.
Originally published on arxiv ↗