22%
AA Intelligence Index v4.1
Models / Google
Gemma · Released 2026-06-07
Google's smaller Gemma 4 reasoning variant, evaluated by Artificial Analysis on 7 Jun. Treat it as a compact open-weights reasoning candidate until the local benchmark ledger has sourced rows.
Small open-weights reasoning model for local experiments, classroom demos, and routing tests before paying for frontier APIs.
51average across 4 tested families
Where Gemma 4 12B (Reasoning) places on each public benchmark source that publishes a row. Rank counts every model with a latest row in the same test — not a universal quality score.
| Benchmark | Family | Rank | Score | Source | Date |
|---|---|---|---|---|---|
| AA output speed | Performance | #19/ 69 | Artificial Analysis | 2026-07-21 | |
| τ³-Bench Banking | Agentic | #19/ 64 | 36 | Artificial Analysis | 2026-07-21 |
| IFBench | Reasoning | #23/ 57 | 74 | Artificial Analysis | 2026-07-21 |
| AA time to first token | Performance | #36/ 69 | Artificial Analysis | 2026-07-21 | |
| AA-LCR | Long context | #52/ 64 | 55 | Artificial Analysis | 2026-07-21 |
| Humanity's Last Exam | Reasoning | #52/ 65 | 15 | Artificial Analysis | 2026-07-21 |
| SciCode | Coding | #53/ 65 | 38 | Artificial Analysis | 2026-07-21 |
| Artificial Analysis Intelligence Index | Reasoning | #54/ 67 | 22 | Artificial Analysis | 2026-07-21 |
| GPQA Diamond | Reasoning | #57/ 69 | 75 | Artificial Analysis | 2026-07-21 |
| Terminal-Bench | Agentic | #61/ 69 | 18 | Artificial Analysis | 2026-07-21 |
The three highest-scoring carded models in each capability family. Where Gemma 4 12B (Reasoning) shows up, it's highlighted.
Benchmark rows added to the public ledger for Gemma 4 12B (Reasoning) in the last 120 days. Older rows live in the full table below.
| Benchmark | Family | Score | Source | Days ago |
|---|---|---|---|---|
| AA-LCR | Long context | 55.33% | Artificial Analysis | 2 |
| AA output speed | Performance | 129 t/s | Artificial Analysis | 2 |
| AA time to first token | Performance | 1.46s | Artificial Analysis | 2 |
| Artificial Analysis Intelligence Index | Reasoning | 22% | Artificial Analysis | 2 |
| GPQA Diamond | Reasoning | 75.3% | Artificial Analysis | 2 |
| Humanity's Last Exam | Reasoning | 14.8% | Artificial Analysis | 2 |
| IFBench | Reasoning | 73.54% | Artificial Analysis | 2 |
| SciCode | Coding | 38.2% | Artificial Analysis | 2 |
| τ³-Bench Banking | Agentic | 36.26% | Artificial Analysis | 2 |
| Terminal-Bench | Agentic | 18.18% | Artificial Analysis | 2 |
A high composite that hides a weak family is a trap. These bars surface the families where this model hasn't been publicly tested, and where it leads.
Hover or tab any dot for name, score, and input price.
Every catalog benchmark for Gemma 4 12B (Reasoning). Scores link to the original source; gaps mean no public row exists yet.
10 of 32 catalog benchmarks have a sourced row for Gemma 4 12B (Reasoning).
22%
AA Intelligence Index v4.1
75.3%
GPQA Diamond (AA run)
14.8%
HLE (AA run)
73.54%
IFBench (AA run)
38.2%
SciCode (AA run)
18.18%
Terminal-Bench Hard (AA run)
36.26%
τ²-Bench Banking (AA run; maps to τ³ explainer)
55.33%
AA-LCR (AA run)
129 t/s
Median output tokens/s (1k prompt, default provider)
1.46s
Median time to first token (1k prompt, default provider)