29.4%
AA Intelligence Index v4.1
Models / Google
Gemma · Released 2026-03-01
Google's March 2026 open-weights Gemma 4 instruct model. SAGE 55% on Vals (#2). Small enough to self-host on a single GPU cluster.
Self-hosted Google open weights for privacy-sensitive workflows that can't call cloud APIs.
59average across 4 tested families
Where Gemma 4 31B IT places on each public benchmark source that publishes a row. Rank counts every model with a latest row in the same test — not a universal quality score.
| Benchmark | Family | Rank | Score | Source | Date |
|---|---|---|---|---|---|
| IFBench | Reasoning | #18/ 57 | 76 | Artificial Analysis | 2026-07-21 |
| GPQA Diamond | Reasoning | #40/ 69 | 86 | Artificial Analysis | 2026-07-21 |
| Humanity's Last Exam | Reasoning | #44/ 65 | 23 | Artificial Analysis | 2026-07-21 |
| AA-LCR | Long context | #45/ 64 | 62 | Artificial Analysis | 2026-07-21 |
| SciCode | Coding | #45/ 65 | 43 | Artificial Analysis | 2026-07-21 |
| AA time to first token | Performance | #46/ 69 | Artificial Analysis | 2026-07-21 | |
| τ³-Bench Banking | Agentic | #47/ 64 | 15 | Artificial Analysis | 2026-07-21 |
| Terminal-Bench | Agentic | #49/ 69 | 43 | Artificial Analysis | 2026-07-21 |
| Artificial Analysis Intelligence Index | Reasoning | #50/ 67 | 29 | Artificial Analysis | 2026-07-21 |
| AA output speed | Performance | #58/ 69 | Artificial Analysis | 2026-07-21 |
The three highest-scoring carded models in each capability family. Where Gemma 4 31B IT shows up, it's highlighted.
Benchmark rows added to the public ledger for Gemma 4 31B IT in the last 120 days. Older rows live in the full table below.
| Benchmark | Family | Score | Source | Days ago |
|---|---|---|---|---|
| AA-LCR | Long context | 62% | Artificial Analysis | 2 |
| AA output speed | Performance | 36 t/s | Artificial Analysis | 2 |
| AA time to first token | Performance | 0.98s | Artificial Analysis | 2 |
| Artificial Analysis Intelligence Index | Reasoning | 29.4% | Artificial Analysis | 2 |
| GPQA Diamond | Reasoning | 85.7% | Artificial Analysis | 2 |
| Humanity's Last Exam | Reasoning | 22.7% | Artificial Analysis | 2 |
| IFBench | Reasoning | 75.58% | Artificial Analysis | 2 |
| SciCode | Coding | 43.4% | Artificial Analysis | 2 |
| τ³-Bench Banking | Agentic | 15.05% | Artificial Analysis | 2 |
| Terminal-Bench | Agentic | 43.45% | Artificial Analysis | 2 |
A high composite that hides a weak family is a trap. These bars surface the families where this model hasn't been publicly tested, and where it leads.
Hover or tab any dot for name, score, and input price.
Every catalog benchmark for Gemma 4 31B IT. Scores link to the original source; gaps mean no public row exists yet.
10 of 32 catalog benchmarks have a sourced row for Gemma 4 31B IT.
29.4%
AA Intelligence Index v4.1
85.7%
GPQA Diamond (AA run)
22.7%
HLE (AA run)
75.58%
IFBench (AA run)
43.4%
SciCode (AA run)
43.45%
Terminal-Bench v2.1 (AA run)
15.05%
τ³-Bench Banking (AA run)
62%
AA-LCR (AA run)
36 t/s
Median output tokens/s (1k prompt, default provider)
0.98s
Median time to first token (1k prompt, default provider)