arxiv
PublishedOctober 9, 2026 at 4:00 AM
LoRi: Low-Rank Distillation for Implicit Reasoning
Publisher summary· verbatim
arXiv:2606.05315v2 Announce Type: replace-cross Abstract: Implicit chain-of-thought (iCoT) methods aim to internalize reasoning in large language models, but often underperform explicit CoT prompting. We empirically find that hidden-state reasoning trajectories exhibit low-rank structure. Motivated
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivShould SLMs be in the Driver's Seat? A Study of Local Models as Interpreters in Cloud-Written Agent Programs6harxivHarness^2: Recursive Agent Harnessing for an Open World6harxivANASSA: From High-Level Framework to Low-Level Architecture for Spatial Agentic AI6harxivMeasuring the Inference Energy Efficiency of Open-Weight LLMs across Benchmarks, Reasoning Modes, and Hardware6hThe Bubble Brief
MON · WED · FRIRead AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗