Model Detail

Bonsai-8B-gguf is a large language model with 8B parameters released by prism-ml. The model is registered under the text-generation pipeline tag on Hugging Face, distributed under the permissive apache-2.0 license.

Bonsai-8B-gguf ships with 8B parameters, distributed as a quantized weight variant for lower-VRAM inference. The apache-2.0 license is permissive, allowing commercial deployment and derivative work without per-seat fees, though attribution requirements still apply.

Bonsai-8B-gguf is best fit for general-purpose chat and instruction-following workloads. Treat this as a starting matrix rather than a benchmark verdict — the right deployment usually depends on the specific evaluation suite that mirrors your workload.