arxivSep 15
How Lossless Is Lossless Speculative Decoding? The Role of Numerical Precision in Orthrus
arXiv:2609.15504v1 Announce Type: cross Abstract: Orthrus is a hybrid autoregressive-diffusion architecture that accelerates autoregressive language-model inference by generating multiple tokens in parallel while using a frozen autoregressive backbone. Its central claim is that an intra-model consen