Model Detail

sarvam-105b-gguf is a large language model with 105B parameters released by sarvamai. The model is registered under the text-generation pipeline tag on Hugging Face.

sarvam-105b-gguf ships with 105B parameters, distributed as a quantized weight variant for lower-VRAM inference.

sarvam-105b-gguf is best fit for general-purpose chat and instruction-following workloads. Treat this as a starting matrix rather than a benchmark verdict — the right deployment usually depends on the specific evaluation suite that mirrors your workload.