Model Detail
Mellum2-12B-A2.5B-Thinking-GGUF-Q8_0
—Mellum2-12B-A2.5B-Thinking-GGUF-Q8_0 is a large language model with 12B parameters released by JetBrains. The model is registered under the text-generation pipeline tag on Hugging Face, distributed under the permissive apache-2.0 license.
Mellum2-12B-A2.5B-Thinking-GGUF-Q8_0 ships with 12B parameters, distributed as a quantized weight variant for lower-VRAM inference. The apache-2.0 license is permissive, allowing commercial deployment and derivative work without per-seat fees, though attribution requirements still apply.
Mellum2-12B-A2.5B-Thinking-GGUF-Q8_0 is best fit for general-purpose chat and instruction-following workloads. Treat this as a starting matrix rather than a benchmark verdict — the right deployment usually depends on the specific evaluation suite that mirrors your workload.
Introducing Mellum2: A 12B Mixture-of-Experts Model by JetBrains
Mellum2 Technical Report
arXiv:2605.31268v1 Announce Type: new Abstract: We present Mellum 2, an open-weight 12B-parameter Mixture-of-Experts (MoE) language model with 2.5B active parameters per token. Mellum 2 is a general-purpose language model specialized in software engineering, spanning code generation and editing, deb
