VerdictPal
Join

Models / Google

Gemini 1.5 Ultra (2024)

Gemini 1.5 · Released 2024-02-15

2024 Gemini 1.5 Ultra. MMLU 90.0% (CoT@32) on the public ledger. MMMU 59.4%. Pre-Gemini-2 flagship.

Legacy Ultra tier for multimodal and knowledge benchmarks — superseded by Gemini 3.x.

Composite90
Context1M
Input / 1M—
Output / 1M—
Knowledge cutoff2023-11-01
Statuslightweight
Gemini
Not enough families covered yet.Add more benchmark rows for Gemini 1.5 Ultra (2024) to see the family profile.
Benchmark placements

Where Gemini 1.5 Ultra (2024) places on each public benchmark source that publishes a row. Rank counts every model with a latest row in the same test — not a universal quality score.

BenchmarkFamilyRankScoreSourceDate
MMLUKnowledge#6/ 2290Gemini technical report2023-12-06
Family context

The three highest-scoring models with pages in each capability family. Where Gemini 1.5 Ultra (2024) shows up, it's highlighted.

KnowledgeGemini 1.5 Ultra (2024) · 90
  1. 1
    GPT 5.5
    91
  2. 2
    Claude Opus 4.8
    91
  3. 3
    Claude Sonnet 4.6
    91
Family coverage

A high composite that hides a weak family is a trap. These bars surface the families where this model hasn't been publicly tested, and where it leads.

Knowledge90
Price vs. performance
0255075100$0.10$0.30$1$3$10$30input USD / 1M tokens · log scale →← intelligence

Hover any dot for name, score, and input price. Keyboard: tab through the top twelve, or use the ranking below.

AnthropicOpenAIMistralAlibabaDeepSeekGoogleMoonshotMetaMiniMaxxAIZhipuXiaomiOtherMeituanCohereNVIDIA

Full benchmark ledger

Every catalog benchmark for Gemini 1.5 Ultra (2024). Scores link to the original source; gaps mean no public row exists yet.

1 sourced rows

1 of 37 catalog benchmarks have a sourced row for Gemini 1.5 Ultra (2024).

Knowledge

Sources