Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
81 76 87 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 2 predictions resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
65 45 83
All types combined: 80 (likely 75 to 85, high confidence), from 84 claims: 78 factual claims, 6 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Demis Hassabis's claims
42 claims
“Performs better than 3.1 Pro on coding & agentic tasks”
Demis Hassabis, Google DeepMind CEO, on X 20 May 2026 Post by @demishassabis on X, 2026-05-20 (X)
Gemini 3.5 Flash performs better than Gemini 3.1 Pro on coding and agentic tasks.
Mostly true True in substance, wrong in a detail.
The second judge would not resolve this claim; the verdict shown is the first judge's.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judge as of 2026-05-20 using Google/DeepMind's published benchmark tables (model card or launch post) and independent leaderboards. True: on the coding benchmarks (e.g. SWE-bench Verified, LiveCodeBench, Terminal-Bench) and agentic benchmarks (e.g. tau-bench, tool-use/agent evaluations) reported at launch, Gemini 3.5 Flash scores higher than Gemini 3.1 Pro on all or nearly all of them. Mostly true: it leads on clearly most of them, trailing slightly on one or two. Mixed: it leads on roughly half. Mostly false: it leads on only a few, or only in Google's own chosen benchmarks while independent evaluations show it behind. False: it scores at or below 3.1 Pro on most coding and agentic benchmarks, or no Gemini 3.5 Flash model was released and evaluated.
Evidence
- Gemini 3.5: frontier intelligence with action Google (blog.google) · 19 May 2026 Own record
“It’s our strongest agentic and coding model yet, outperforming Gemini 3.1 Pro on challenging coding and agentic benchmarks like Terminal-Bench 2.1 (76.2%), GDPval-AA (1656 Elo) and MCP Atlas (83.6%), and leading in multimodal understanding (84.2% on CharXiv Reasoning).”
- I/O 2026: Welcome to the agentic Gemini era Google (blog.google) · 19 May 2026 Own record
“When compared to 3.1 Pro, 3.5 Flash is better across almost all benchmarks. It’s made huge progress in coding — and look at the extraordinary jump in GDPVal.”
- Gemini 3.5 Flash: LayerLens Evaluation Data Reveals Where Google's Fastest Model Actually Wins LayerLens · 21 May 2026
“The Pro model still wins on Big Bench Hard by 4.33 points and LiveCodeBench by 3.34 points, which makes a real difference for teams with hard reasoning and coding requirements.”
Reasoning
Google's launch post (E1) says Gemini 3.5 Flash outperforms Gemini 3.1 Pro on coding and agentic benchmarks, naming Terminal-Bench 2.1, GDPval-AA and MCP Atlas. Sundar Pichai's I/O post (E2) says it is better than 3.1 Pro on almost all benchmarks. LayerLens's independent evaluation (E3) finds that 3.1 Pro still leads on LiveCodeBench by 3.34 points, so 3.5 Flash does not lead on every coding benchmark. Together, the evidence shows 3.5 Flash ahead on most of the reported coding and agentic benchmarks and slightly behind on at least one.
Cite this claim
Demis Hassabis, “Gemini 3.5 Flash performs better than Gemini 3.1 Pro on coding and agentic tasks.” (said 20 May 2026). Verdict: mostly true. Reliability API, claim c_165a390330c8, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_165a390330c8
Claims without a verdict
Is a verdict here wrong, or do you speak for Demis Hassabis? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.