arxiv
PublishedOctober 31, 2026 at 4:00 AM
Raincheck: Deferred Multimodal Prefill for Efficient Multi-Turn MLLM Inference
Publisher summary· verbatim
arXiv:2610.39562v1 Announce Type: cross Abstract: Multi-turn conversations with multimodal large language models (MLLMs) reuse input context, but long multimodal inputs increase time to first token (TTFT). Query-aware hard pruning reduces prefill tokens but permanently excludes information that late
Stay posted· Newsletter
Three short emails a week: Monday, Wednesday and Friday. Top movers, new models and the most-referenced story.
Your email is used only to send The Bubble Brief. Privacy policy
Discussion
No replies yet. Be first.
Related coverage
More from ARXIV
arxivFrom Local Recovery to Unified Generation: Discovering Triple Set in Knowledge Graphs via Observation-Anchored Latent Diffusion12harxivBridgeRouter: Gain-Aware Instance Routing over Cross-Modal Bridge Portfolios12harxivDecompGym: Benchmarking LLM Agents on Designing Decomposition Algorithms12harxivInner-Learning: From Hand-Coded Beliefs to Declarative Knowledge in Trick-Taking Games12hThe Bubble Brief
MON · WED · FRIRead AI insights every Monday, Wednesday and Friday — top movers, new models, story of the week.
Your email is used only to send The Bubble Brief. Privacy policy
Originally published on arxiv ↗