ClaimsPeople

Dario Amodei

Dario Amodei is co-founder and CEO of Anthropic and a former VP of Research at OpenAI, where he led work on GPT-2 and GPT-3.

1,335 claims collected, 337 researched, 97 resolved. Report of 4 November 2026, method 0.1.0+c876030c.

Scores by kind of claim

Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.

  • Factual claims

    Statements about the present or the past, checked against the record: did they hold up?

    76 69 82

    High confidence, 76 factual claims resolved. From 14 documents, 2015 to 2026; 19 documents sampled from 30 candidates found.

    Not scored: 51 unresolvable, 42 checkable only against their own records.

  • Predictions

    Statements about events outside the person's control, checked once they fell due: did they come true?

    56 42 70

    Medium confidence, 17 predictions resolved. From 8 documents, 2015 to 2026; 19 documents sampled from 30 candidates found.

    Not scored: 103 unresolvable, 1 checkable only against their own records. 39 more fall due later.

    Does not yet allow for how likely each prediction was when made.

  • Promises

    Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?

    Insufficient record: 4 promises resolved, 5 needed for a score.

    Not scored: 3 unresolvable, 1 not yet due.

All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.

Dario Amodei's claims

12 claims

12 claims, sorted by newest said. Choose a claim to read it in full.
VerdictKindSaidClaimTopic
Mixed Factual 23 Sep 2026 AI performance in new intellectual domains has repeatedly gone from weak to superhuman within a few years. Factual · 23 Sep 2026 AI capabilities
Mixed Factual 15 Aug 2026 The "Pacing the Frontier" letter, in Anthropic's preferred implementation, envisions modulating the pace of the best models without constraining those catching up. Factual · 15 Aug 2026 AI policy and governance
Mixed Factual 15 Aug 2026 Around February 2026, most of the AI industry was pushing for federal preemption of all state AI regulation, with no apparent federal approach. Factual · 15 Aug 2026 AI policy and governance
Mixed Factual 10 Mar 2025 Amodei's group measured AI scaling trends when models cost $1,000 or $10,000 to train. Factual · 10 Mar 2025 AI capabilities
Mixed Factual 28 Feb 2025 Many other companies' reasoning models on the market are trained primarily on math and competition coding. Factual · 28 Feb 2025 AI capabilities
Mixed Factual 18 Feb 2025 People outside the AI field are often surprised and alarmed to learn that AI creators do not understand how their AI systems work. Factual · 18 Feb 2025 Philosophy, ethics and society
Mixed Factual 12 Apr 2024 我们和其他一些研究者发现,模型里有时会有某些特定的神经元和统计指标(这些通常不出现在它的外部反应中),这些指标能够指示模型是在撒谎还是在说真话。 Factual · 12 Apr 2024 AI safety and alignment
Mixed Factual 13 Oct 2022 DeepSeek was not substantially more resource-constrained than US AI companies, and export controls were not the main factor causing its innovation. Factual · 13 Oct 2022 AI policy and governance
Mixed Factual 21 Jul 2017 For almost a decade before 2017, self-driving cars have existed that are 99.9% safe. Factual · 21 Jul 2017 AI capabilities
Mixed Factual 17 Aug 2015 Poorly implemented services are currently a major driver of cynicism about government. Factual · 17 Aug 2015 AI policy and governance
Mixed Factual 17 Aug 2015 Human economic planners made the decisions that led to several East Asian economies' late-20th-century growth by pulling a few key levers such as export-led industrial policy, not by directly controlling whole economies. Factual · 17 Aug 2015 Economics and markets
Mixed Factual 17 Aug 2015 Smallpox was fully eliminated in the 1970s, and polio and guinea worm are nearly eradicated with fewer than 100 cases per year. Factual · 17 Aug 2015 Biosecurity
Back to the list

Dario Amodei

Open its page

Factual Philosophy, ethics and society

“People outside the field are often surprised and alarmed to learn that we do not understand how our own AI creations work.”

Dario Amodei, writing on his own site 18 February 2025 The Urgency of Interpretability (darioamodei.com)

People outside the AI field are often surprised and alarmed to learn that AI creators do not understand how their AI systems work.

Mixed Partly true and partly false in roughly equal measure.

The second judge would not resolve this claim; the verdict shown is the first judge's.

What would count as true or false

Judge as of 2025-02-18. The claim has two parts: (a) AI developers do not understand how their systems work (in the sense of mechanistic interpretability); (b) people outside the field are often surprised and alarmed to learn this. True: expert sources agree that the inner workings of frontier models are largely not understood, and surveys, polling or reporting show that laypeople commonly hold the opposite belief or react with surprise or concern on learning it. Mostly true: (a) is well supported and (b) is backed by anecdote or commentary rather than systematic data. Mixed: (a) is supported but evidence on (b) is weak or points both ways. Mostly false: (a) is overstated (e.g. substantial understanding exists), or evidence shows that most of the public already knows and is not surprised. False: evidence shows developers do understand how their models work and the public reaction claimed does not occur.

Evidence

  1. Anthropic CEO wants to open the black box of AI models by 2027 | TechCrunch TechCrunch · 24 April 2025
    “Despite the rapid performance improvements of the tech industry’s AI models, we still have relatively little idea how these systems arrive at decisions.”
  2. Anthropic CEO wants to open the black box of AI models by 2027 | TechCrunch TechCrunch · 24 April 2025
    “For example, OpenAI recently launched new reasoning AI models, o3 and o4-mini, that perform better on some tasks, but also hallucinate more than its other models. The company doesn’t know why it’s happening.”
  3. Anthropic CEO wants to open the black box of AI models by 2027 | TechCrunch TechCrunch · 24 April 2025
    “Anthropic is one of the pioneering companies in mechanistic interpretability, a field that aims to open the black box of AI models and understand why they make the decisions they do.”

Reasoning

An independent TechCrunch report says the industry still has "relatively little idea" how AI systems reach decisions, and that OpenAI does not know why its newer reasoning models hallucinate more [E1, E2]. It also describes mechanistic interpretability as a field still trying to open the black box [E3]. This supports part (a), and nothing in the evidence suggests the inner workings of these models are well understood. No item addresses part (b), whether people outside the field are often surprised or alarmed: there are no surveys, polls or reports of public reactions. Under the criteria, (a) supported with weak evidence on (b) resolves as mixed.

Cite this claim

Dario Amodei, “People outside the AI field are often surprised and alarmed to learn that AI creators do not understand how their AI systems work.” (said 18 February 2025). Verdict: mixed. Reliability API, claim c_4731f2dbb807, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_4731f2dbb807

Claims without a verdict

Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.