Model Detail
gemma-3-12b-it-GGUF
—gemma-3-12b-it-GGUF is a multimodal model with 12B parameters released by unsloth. The model is registered under the image-text-to-text pipeline tag on Hugging Face, and supports text+image->text inputs.
gemma-3-12b-it-GGUF is priced at $0.04/M input tokens and $0.13/M output tokens. Operationally the model offers a 131K-token context window, which matters when sizing it for prompt-heavy or latency-sensitive workloads. At this input rate the model sits in the commodity tier and is suitable for high-volume workloads where per-call cost dominates the decision.
gemma-3-12b-it-GGUF ships with 12B parameters, distributed as a quantized weight variant for lower-VRAM inference. The published knowledge cutoff is 2024-08-31, so newer events will not be reflected in zero-shot answers without retrieval.
gemma-3-12b-it-GGUF is best fit for mixed text-and-image reasoning tasks such as document understanding, and high-volume batch jobs where per-call cost dominates the budget. Treat this as a starting matrix rather than a benchmark verdict — the right deployment usually depends on the specific evaluation suite that mirrors your workload.
Trivial Prompt Reframing Bypasses Safety Guardrails in Google\'s MedGemma-4B
arXiv:2607.09804v1 Announce Type: cross Abstract: Open-weight medical language models are increasingly used as the base of patient-facing and clinician-support applications. Their model cards prohibit specific behaviors -- recommending exact drug dosages, issuing definitive diagnoses, prescribing tr
Hugging Face and Cerebras bring Gemma 4 to real-time voice AI
DistilledGemma: Balanced Efficiency-Accuracy for Person-Place Relation Extraction from Multilingual Historical Articles
arXiv:2606.29130v1 Announce Type: new Abstract: We present DistilledGemma, an efficient and accurate system for the HIPE-2026 shared task on person-place relation extraction from multilingual historical newspaper articles in English, German, and French. Our approach adopts a three-stage knowledge di
How Transparent is DiffusionGemma?
arXiv:2606.20560v1 Announce Type: cross Abstract: LLM reasoning transparency is a critical affordance for understanding model decisions, mitigating misuse and misalignment, and debugging surprising model behaviors. However, DiffusionGemma performs a larger fraction of its computation in a continuous
Neither Parallel Nor Sequential: How DiffusionGemma Actually Commits Tokens
arXiv:2606.14620v1 Announce Type: new Abstract: Open diffusion language models are marketed as parallel, non-autoregressive decoders, yet the order in which a shipped checkpoint actually commits its tokens is almost never measured. We instrument DiffusionGemma 26B, a masked discrete-diffusion mixtur
Fine-Tuning and Serving Gemma 4 31B on Google Cloud TPU: A Technical Comparison with GPU Baselines
arXiv:2605.25645v2 Announce Type: replace-cross Abstract: We present the first end-to-end demonstration of fine-tuning and serving Google's Gemma 4 31B model on TPU hardware, providing an empirical comparison of TPU and GPU platforms for large language model adaptation. Using LoRA on a Google TPU v5
