Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 69 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
56 42 70 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 4 promises resolved, 5 needed for a score.
All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Dario Amodei's claims
2 claims
| Verdict | Kind | Said | Claim | Topic |
|---|---|---|---|---|
| Mostly false | Prediction | 23 Sep 2026 | Amodei said that "we" believe AI for biology is on an exponential trend similar to the one he described for AI in mathematics. Prediction · 23 Sep 2026 | AI capabilities |
| Mostly false | Prediction | 11 Nov 2024 | Amodei said that, after progress from 3% to 50% on SWE-bench in 10 months, state-of-the-art models would probably be at about 90% in another year, while adding that he did not know and it might be less. Prediction · 11 Nov 2024 | AI capabilities |
“We believe AI for biology is on a similar exponential trend.”
Dario Amodei, Anthropic CEO, on X 23 September 2026 Post by @DarioAmodei on X, 2026-09-23 (X)
Amodei said that "we" believe AI for biology is on an exponential trend similar to the one he described for AI in mathematics.
Mostly false False in substance, right in a detail.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judge the substance of the stated belief as of 2026-09-23: is AI capability on biology tasks improving on an exponential (compounding, roughly constant-doubling) trend comparable to the one Amodei described for AI in mathematics? Speaker hedging ('we believe') is noted, but the test is the trend itself. TRUE: benchmark time series, capability-tracking studies or expert assessments from around the statement date show AI performance on biology tasks (for example protein/structure prediction, biology QA or lab-protocol benchmarks, autonomous research tasks) rising at a compounding rate broadly comparable to the cited math trend. MOSTLY TRUE: the evidence shows clear compounding improvement in biology, but at a noticeably slower or less clean rate than math, or across only some major biology task families. MIXED: the evidence is split, with exponential-looking progress on some biology measures and flat or linear progress on others in roughly equal weight. MOSTLY FALSE: biology AI is improving, but the evidence shows no exponential trend comparable to math, or the claim rests on a narrow benchmark presented as the whole field, or no data establishes such a trend. FALSE: the evidence shows biology AI capability stalling or improving only marginally over the relevant period.
Evidence
- Overall trends SecureBio
“Capabilities are rising over time, in both general biology and the biosecurity-relevant areas tested.”
- Overall trends SecureBio
“Companies that have added chemical, biological, radiological, and nuclear (CBRN) safeguards have published models that deliberately decline to answer many biology questions, pulling their scores below the upward trend.”
- Frontier AI Trends Report by The AI Security Institute (AISI) UK AI Security Institute
“At the beginning of 2024, for the first time, models performed better than experts (biology PhDs) on our open-ended biology questions. Since then, we have observed continuous improvements on these question sets.”
- Introducing GeneBench-Pro OpenAI · 30 June 2026
“That is a sharp increase from when we began building the original GeneBench; at that time, our best frontier model, GPT‑5, scored below 5%.”
Reasoning
The evidence shows biology AI capability rising. SecureBio reports capabilities rising over time in general biology and biosecurity-relevant areas (E1), the UK AI Security Institute reports continuous improvement since models passed biology PhD experts in early 2024 (E3), and OpenAI reports a sharp rise on GeneBench-Pro (E4). However, none of these sources gives a doubling time or an exponential fit for biology. E4 compares a single benchmark result against one earlier figure, and E2 notes that refusals under CBRN safeguards pull some models' scores below the upward trend. The criteria say mostly false when biology AI is improving but no data establishes an exponential trend comparable to the one cited for math, and that is what this evidence shows.
Cite this claim
Dario Amodei, “Amodei said that "we" believe AI for biology is on an exponential trend similar to the one he described for AI in mathematics.” (said 23 September 2026). Verdict: mostly false. Reliability API, claim c_6e5260655f16, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_6e5260655f16
Claims without a verdict
- Unresolvable 157
- Not yet due 40
- Own records only 43
- Not researched 134
- Not checkable 864
Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.