VerdictPal
Join

Models / Google

Gemini 1.5 Ultra (2024)

Gemini 1.5 · Released 2024-02-15

2024 Gemini 1.5 Ultra. MMLU 90.0% (CoT@32) on the public ledger. MMMU 59.4%. Pre-Gemini-2 flagship.

Legacy Ultra tier for multimodal and knowledge benchmarks — superseded by Gemini 3.x.

Composite90
Context1M
Input / 1M—
Output / 1M—
Knowledge cutoff2023-11-01
Statuslightweight
Gemini
Not enough families covered yet.Add more benchmark rows for Gemini 1.5 Ultra (2024) to see the radar.
Benchmark placements

Where Gemini 1.5 Ultra (2024) places on each public benchmark source that publishes a row. Rank counts every model with a latest row in the same test — not a universal quality score.

BenchmarkFamilyRankScoreSourceDate
MMLUKnowledge#6/ 2290Gemini technical report2023-12-06
Family context

The three highest-scoring carded models in each capability family. Where Gemini 1.5 Ultra (2024) shows up, it's highlighted.

KnowledgeGemini 1.5 Ultra (2024) · 90
  1. 1
    GPT 5.5
    91
  2. 2
    Claude Opus 4.8
    91
  3. 3
    Claude Sonnet 4.6
    91
Long context
  1. 1
    Kimi K3
    75
  2. 2
    GPT-5.1
    75
  3. 3
    GPT-5.6 Sol
    74
Family coverage

A high composite that hides a weak family is a trap. These bars surface the families where this model hasn't been publicly tested, and where it leads.

Knowledge90
Price vs. performance
0255075100$0.10$0.30$1$3$10$30input USD / 1M tokens · log scale →← intelligence

Hover or tab any dot for name, score, and input price.

AnthropicOpenAIMistralAlibabaDeepSeekGoogleMoonshotMiniMaxxAIMetaZhipuXiaomiMeituanCohere

Full benchmark ledger

Every catalog benchmark for Gemini 1.5 Ultra (2024). Scores link to the original source; gaps mean no public row exists yet.

1 sourced rows

1 of 32 catalog benchmarks have a sourced row for Gemini 1.5 Ultra (2024).

Knowledge

Sources