Model Detail
Bonsai-27B-mlx-1bit
—Bonsai-27B-mlx-1bit is a large language model with 27B parameters released by prism-ml. The model is registered under the text-generation pipeline tag on Hugging Face, distributed under the permissive apache-2.0 license.
Bonsai-27B-mlx-1bit ships with 27B parameters. Total weight footprint is approximately 1.7 GB, which is the relevant figure when planning local-inference VRAM. The apache-2.0 license is permissive, allowing commercial deployment and derivative work without per-seat fees, though attribution requirements still apply.
Bonsai-27B-mlx-1bit is best fit for general-purpose chat and instruction-following workloads. Treat this as a starting matrix rather than a benchmark verdict — the right deployment usually depends on the specific evaluation suite that mirrors your workload.