Model Detail
Step-5-Preview-BF16
—Step-5-Preview-BF16 is an AI model with 302.2B parameters released by stepfun-ai. Distributed under a other license.
Step-5-Preview-BF16 ships with 302.2B parameters. Total weight footprint is approximately 604.3 GB, which is the relevant figure when planning local-inference VRAM. Distribution is governed by the other license — review the exact terms before commercial deployment.
Step-5-Preview-BF16 is best fit for general-purpose AI workloads. Treat this as a starting matrix rather than a benchmark verdict — the right deployment usually depends on the specific evaluation suite that mirrors your workload.
KETCHUP: K-Step Return Estimation for Sequential Knowledge Distillation
arXiv:2504.19024v2 Announce Type: replace Abstract: We propose a novel k-step return estimation method (called KETCHUP) for Reinforcement Learning(RL)-based knowledge distillation (KD) in text generation tasks. Our idea is to induce a K-step return by using the Bellman Optimality Equation for multip
Gradient Descent on Logistic Regression: Do Large Step-Sizes Work with Data on the Sphere?
arXiv:2507.11228v2 Announce Type: replace Abstract: Gradient descent on logistic regression has many fascinating properties not fully captured by classical analyses. For linearly separable data, the iterates converge in direction to the maximum-margin separator regardless of how large the step size
Specter: Fast MoE Inference via Quantization-Enabled Multi-Step Speculative Offloading
arXiv:2511.14102v2 Announce Type: replace Abstract: Mixture-of-experts (MoE) models often exceed a single accelerator's memory capacity. Offloading experts to host memory creates a severe PCIe I/O bottleneck because data-dependent routing keeps transfers on the critical path. We present Specter, an
DStill: Trajectory Consistency Distillation for Accelerated One-Step Drafting in Block Diffusion Speculative Decoding
arXiv:2610.27379v1 Announce Type: new Abstract: Block-diffusion speculative decoding accelerates large language model inference by drafting multiple tokens in parallel. However, one-step drafting in discrete diffusion is limited by token factorization error: each token is predicted from the same mas
Constant Step Sizes for Muon-Type Spectral Optimizers on Strongly Convex Quadratics
arXiv:2610.27747v1 Announce Type: new Abstract: Muon and related optimizers update a weight matrix with a spectrally transformed gradient. In this work, we study such spectral optimizers with a constant step size on strongly convex matrix quadratics, which isolate the effect of the update from the c
RealtimeWAM: One-Step Asynchronous World Action Models
arXiv:2610.06617v2 Announce Type: replace-cross Abstract: World Action Models (WAMs) incorporate visual representations from video generation backbones to guide action prediction. Recent efficient WAMs adopt Mixture-of-Transformers (MoT) architectures and compute video representations once for reuse
