VerdictPal
Join
VerdictPal · editorial desk · updated 16 Oct 2026VerdictPal
The Lab

Benchmarks we run ourselves.

Vendor scores are marketing-adjacent. The Lab is where the desk runs its own tests — on the failure modes that actually burn students and researchers — and publishes the method, prompts, and raw examples so you can repeat the run.

Honest by default

A Lab benchmark ships a score only after human grading and sign-off. Until then you see the protocol and run progress — not a padded leaderboard.

Citation Fidelity v0.1: 156/156 captures complete. Human grading and sign-off still required before scores ship —

Citation Fidelity (VerdictPal Lab)

DraftProtocol v0.112 questions
Full protocol →

When an answer-engine cites a source, does the source actually say what the answer claims? We grade real research questions on whether every cited claim is supported by the linked page — the failure mode students get burned by most.

Captures complete — grading pending

All capture slots are filled. Score rows appear only after independent human grading and desk-lead sign-off. No padded leaderboard until then.

What it won't tell you

  • Answer quality or fluency — a beautifully written answer with a fabricated citation fails here on purpose.
  • Coverage — we test whether what is cited is true, not whether the model found every relevant source.
  • It is a small, hand-graded set — treat early numbers as directional, not definitive.
Method
Frozen protocol v0.1 (2026-07-06). Twelve questions (Q01–Q12): three policy brief, three product comparison, three academic-adjacent, three local/current. Each engine gets the same prompt and default settings; two reviewers grade every cited claim independently (supported / unsupported / broken-link); disagreements are resolved on the record. Full runbook: docs/lab/citation-fidelity-v0.1.md.

How scoring works: /methodology

← All benchmarks