Model Detail

rune-26b-a4b-GGUF is a large language model with 26B parameters released by surogate. The model is registered under the text-classification pipeline tag on Hugging Face, distributed under the permissive apache-2.0 license.

rune-26b-a4b-GGUF ships with 26B parameters, distributed as a quantized weight variant for lower-VRAM inference. Total weight footprint is approximately 25.8 GB, which is the relevant figure when planning local-inference VRAM. The apache-2.0 license is permissive, allowing commercial deployment and derivative work without per-seat fees, though attribution requirements still apply.

rune-26b-a4b-GGUF is best fit for general-purpose chat and instruction-following workloads. Treat this as a starting matrix rather than a benchmark verdict — the right deployment usually depends on the specific evaluation suite that mirrors your workload.