Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 69 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
56 42 70 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 4 promises resolved, 5 needed for a score.
All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Dario Amodei's claims
4 claims
| Verdict | Kind | Said | Claim | Topic |
|---|---|---|---|---|
| Mostly false | Prediction | 23 Sep 2026 | Amodei said that "we" believe AI for biology is on an exponential trend similar to the one he described for AI in mathematics. Prediction · 23 Sep 2026 | AI capabilities |
| Mostly false | Factual | 23 Sep 2026 | Anthropic demonstrated that humans can work with AI to perform experiments and validate key results within a few weeks. Factual · 23 Sep 2026 | Science and research methods |
| Mostly false | Factual | 10 Mar 2025 | Dario Amodei thought one or two years before March 2025 that data limits were a very plausible blocker to AI progress. Factual · 10 Mar 2025 | AI compute, hardware and data |
| Mostly false | Prediction | 11 Nov 2024 | Amodei said that, after progress from 3% to 50% on SWE-bench in 10 months, state-of-the-art models would probably be at about 90% in another year, while adding that he did not know and it might be less. Prediction · 11 Nov 2024 | AI capabilities |
“in 10 months we’ve gone from 3% to 50% on this task. And I think in another year we’ll probably be at 90%.”
Dario Amodei, Anthropic CEO, interviewee 11 November 2024 Transcript for Dario Amodei: Anthropic CEO on Claude, AGI & the Future of AI & Humanity (Lex Fridman Podcast)
Amodei said that, after progress from 3% to 50% on SWE-bench in 10 months, state-of-the-art models would probably be at about 90% in another year, while adding that he did not know and it might be less.
Mostly false False in substance, right in a detail.
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
The benchmark is SWE-bench Verified, the variant on which state-of-the-art scores were about 50% in November 2024. The test is the best publicly reported score from a state-of-the-art model or agent system by the end of November 2025. 'About 90%' is a rough figure. True: the best reported score is 87% or higher. Mostly true: 84% to under 87%. Mostly false: 75% to under 84% (real progress, but short of the predicted level). False: below 75%. A score first reached after November 2025 does not count towards the claim.
Evidence
- Claude Opus 4.5 vs Sonnet 4.5: Pricing Revolution & Performance Comparison | Anthropic Vertu · 25 November 2025
“Opus 4.5 achieved 80.9% on SWE-bench Verified, outperforming Sonnet 4.5's 77.2% and Opus 4.1's 74.5%.”
- Introducing Claude Sonnet 4.5 Anthropic · 29 September 2025 Own record
“This results in a score of 82.0% for Sonnet 4.5.”
- SWE-bench Verified | AI Wiki AI Wiki · 18 March 2026
“The public state-of-the-art then rose to 49% by October 2024, past 80% in November 2025,”
Reasoning
E1, an independent source dated 2025-11-25, reports that Claude Opus 4.5 scored 80.9% on SWE-bench Verified. E3, another independent source, says the public state of the art went past 80% in November 2025. Anthropic's own announcement (E2), which is not independent of the subject, gives a score of 82.0% for Sonnet 4.5, though the quoted passage does not name the benchmark variant. All of these best reported scores by the end of November 2025 fall between 75% and 84%. That is real progress from about 50%, but short of the predicted ~90%, so it falls in the mostly-false band.
Cite this claim
Dario Amodei, “Amodei said that, after progress from 3% to 50% on SWE-bench in 10 months, state-of-the-art models would probably be at about 90% in another year, while adding that he did not know and it might be less.” (said 11 November 2024). Verdict: mostly false. Reliability API, claim c_3ee9cbce30d1, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_3ee9cbce30d1
Claims without a verdict
- Unresolvable 157
- Not yet due 40
- Own records only 43
- Not researched 134
- Not checkable 864
Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.