VerdictPal
Join

Models / Google

Gemini 1.5 Pro (2024-06)

Gemini 1.5 · Released 2024-06-01

June 2024 Gemini 1.5 Pro checkpoint. HELM safety 88.7% on the public ledger. Long-context predecessor to Gemini 2/3.

Historical Google Pro baseline for HELM and MMLU comparisons — not a current API default.

Composite89
Context2M
Input / 1M—
Output / 1M—
Knowledge cutoff2024-04-01
Statuslightweight
Gemini
Not enough families covered yet.Add more benchmark rows for Gemini 1.5 Pro (2024-06) to see the radar.
Benchmark placements

Where Gemini 1.5 Pro (2024-06) places on each public benchmark source that publishes a row. Rank counts every model with a latest row in the same test — not a universal quality score.

BenchmarkFamilyRankScoreSourceDate
HELM SafetySafety#7/ 989Stanford HELM leaderboard2024-08-15
Family context

The three highest-scoring carded models in each capability family. Where Gemini 1.5 Pro (2024-06) shows up, it's highlighted.

Long context
  1. 1
    Kimi K3
    75
  2. 2
    GPT-5.1
    75
  3. 3
    GPT-5.6 Sol
    74
SafetyGemini 1.5 Pro (2024-06) · 89
  1. 1
    Claude Opus 4 (2024-07)
    92
  2. 2
    Claude Opus 4.8
    92
  3. 3
    GPT 5.5
    91
Family coverage

A high composite that hides a weak family is a trap. These bars surface the families where this model hasn't been publicly tested, and where it leads.

Safety89
Price vs. performance
0255075100$0.10$0.30$1$3$10$30input USD / 1M tokens · log scale →← intelligence

Hover or tab any dot for name, score, and input price.

AnthropicOpenAIMistralAlibabaDeepSeekGoogleMoonshotMiniMaxxAIMetaZhipuXiaomiMeituanCohere

Full benchmark ledger

Every catalog benchmark for Gemini 1.5 Pro (2024-06). Scores link to the original source; gaps mean no public row exists yet.

1 sourced rows

1 of 32 catalog benchmarks have a sourced row for Gemini 1.5 Pro (2024-06).

Safety

Sources