ClaimsPeople

Dario Amodei

Dario Amodei is co-founder and CEO of Anthropic and a former VP of Research at OpenAI, where he led work on GPT-2 and GPT-3.

1,335 claims collected, 337 researched, 97 resolved. Report of 4 November 2026, method 0.1.0+c876030c.

Scores by kind of claim

Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.

  • Factual claims

    Statements about the present or the past, checked against the record: did they hold up?

    76 69 82

    High confidence, 76 factual claims resolved. From 14 documents, 2015 to 2026; 19 documents sampled from 30 candidates found.

    Not scored: 51 unresolvable, 42 checkable only against their own records.

  • Predictions

    Statements about events outside the person's control, checked once they fell due: did they come true?

    56 42 70

    Medium confidence, 17 predictions resolved. From 8 documents, 2015 to 2026; 19 documents sampled from 30 candidates found.

    Not scored: 103 unresolvable, 1 checkable only against their own records. 39 more fall due later.

    Does not yet allow for how likely each prediction was when made.

  • Promises

    Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?

    Insufficient record: 4 promises resolved, 5 needed for a score.

    Not scored: 3 unresolvable, 1 not yet due.

All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.

Dario Amodei's claims

28 claims

28 claims, sorted by newest said. Choose a claim to read it in full.
VerdictKindSaidClaimTopic
Resolved true Factual 12 Sep 2026 Dario Amodei has published a new essay, "We Must Pace the Frontier", arguing the AI industry should slow down, with a three-part plan. Factual · 12 Sep 2026 Their own work or organisation
Resolved true Factual 10 Jun 2026 On 2026-06-10 Dario Amodei published a new essay titled Policy on the AI Exponential. Factual · 10 Jun 2026 Their own work or organisation
Resolved true Promise 28 Feb 2026 If Anthropic receives formal government action on the designation, it will review it and challenge it in court. Promise · 28 Feb 2026 AI policy and governance
Resolved true Factual 28 Feb 2026 It is not illegal for the government to buy data collected by private firms and analyze it in mass with AI. Factual · 28 Feb 2026 AI policy and governance
Resolved true Factual 28 Feb 2026 Anthropic was threatened with a supply chain designation and Defense Production Act action by the government, and publicly disagreed in response. Factual · 28 Feb 2026 AI policy and governance
Resolved true Prediction 10 Mar 2025 US export controls may have the effect of stimulating China's chip development. Prediction · 10 Mar 2025 AI policy and governance
Delivered on time Promise 28 Feb 2025 Anthropic will launch web search for Claude very soon. Promise · 28 Feb 2025 Their own work or organisation
Resolved true Factual 28 Feb 2025 Anthropic assessed that Claude 3.7 Sonnet is not yet at a stage giving a real and meaningful end-to-end increase in dangerous threat capability. Factual · 28 Feb 2025 AI safety and alignment
Resolved true Factual 28 Feb 2025 Amodei's earlier 10 to 25% figure referred to the chance of civilization getting substantially derailed. Factual · 28 Feb 2025 AI safety and alignment
Resolved true Factual 28 Feb 2025 Anthropic trained Claude 3.7 to focus more on real-world tasks, as distinct from competition coding. Factual · 28 Feb 2025 AI capabilities
Resolved true Prediction 28 Feb 2025 By the end of 2025, AI will do very serious things in coding. Prediction · 28 Feb 2025 AI capabilities
Resolved true Factual 28 Feb 2025 Anthropic's approach to reasoning models in Sonnet 3.7 emphasized different things from competitors' reasoning models. Factual · 28 Feb 2025 AI capabilities
Resolved true Factual 18 Feb 2025 Anthropic created "Golden Gate Claude", a version of one of its models with the Golden Gate Bridge feature artificially amplified, making it obsessed with the bridge. Factual · 18 Feb 2025 AI safety and alignment
Resolved true Factual 11 Nov 2024 Anthropic's Responsible Scaling Policy uses an if-then structure: if models pass a certain capability, Anthropic imposes a set of safety and security requirements. Factual · 11 Nov 2024 AI safety and alignment
Resolved true Prediction 11 Nov 2024 Dario Amodei said he would not be surprised at all if Anthropic's models hit ASL-3 in 2025. Prediction · 11 Nov 2024 AI safety and alignment
Resolved true Factual 11 Nov 2024 On some computer-use benchmarks, previous models succeeded about 6% of the time and Anthropic's new model succeeds 14 or 22% of the time. Factual · 11 Nov 2024 AI capabilities
Resolved true Factual 11 Nov 2024 Anthropic's updated Claude Sonnet 3.5 scores about 50% on SWE-bench. Factual · 11 Nov 2024 AI capabilities
Resolved true Factual 11 Nov 2024 Anthropic has almost a thousand employees, and its risk policy is meant to make sure they understand that taking these risks seriously is one of the company's highest priorities, if not the highest. Factual · 11 Nov 2024 Their own work or organisation
Resolved true Factual 11 Nov 2024 DeepMind's AlphaGo Zero required no example data from humans. Factual · 11 Nov 2024 AI capabilities
Resolved true Factual 12 Apr 2024 The Star Trek series depicts a highly developed universe in which humans live longer and have expanded into space. Factual · 12 Apr 2024 Other
Resolved true Factual 12 Apr 2024 Anthropic's models are currently at AI Safety Level ASL-2. Factual · 12 Apr 2024 Their own work or organisation
Resolved true Prediction 8 Aug 2023 In a year or two (from 2023), AI model consciousness might become a very real concern. Prediction · 8 Aug 2023 Philosophy, ethics and society
Resolved true Factual 8 Aug 2023 Amodei said Anthropic "kind of" already does reinforcement learning, through RLHF. Factual · 8 Aug 2023 AI capabilities
Resolved true Factual 13 Oct 2022 The current rate of algorithmic curve shift is maybe about 4x per year. Factual · 13 Oct 2022 AI compute, hardware and data
Resolved true Factual 13 Oct 2022 Amodei said he thinks a fair statement is that DeepSeek produced a model close in performance to US models 7-10 months older, at a good deal less cost but not near the ratios people have suggested. Factual · 13 Oct 2022 Economics and markets
Resolved true Factual 21 Jul 2017 OpenAI and DeepMind both have a focus on safety and both have safety teams. Factual · 21 Jul 2017 AI safety and alignment
Resolved true Factual 21 Jul 2017 Dario Amodei's PhD was not in machine learning. Factual · 21 Jul 2017 Their own work or organisation
Resolved true Factual 21 Jul 2017 OpenAI is a nonprofit AI research lab. Factual · 21 Jul 2017 Their own work or organisation
Back to the list

Dario Amodei

Open its page

Factual AI capabilities

“the latest model we released, Sonnet 3.5, the new or updated version, it gets something like 50% on SWE-bench.”

Dario Amodei, Anthropic CEO, interviewee 11 November 2024 Transcript for Dario Amodei: Anthropic CEO on Claude, AGI & the Future of AI & Humanity (Lex Fridman Podcast)

Anthropic's updated Claude Sonnet 3.5 scores about 50% on SWE-bench.

Resolved true The record shows it happened or was so.

The evidence is the person's or their organisation's own records.

Said for an organisation they lead or work for; it counts on both records.

What would count as true or false

Judge as of 2024-11-11. 'Something like 50%' is approximate. TRUE: Anthropic's official reported SWE-bench score (e.g., SWE-bench Verified) for the upgraded Claude 3.5 Sonnet (October 2024) is roughly 45–55%. MOSTLY TRUE: the reported score is 40–45% or 55–60%, or the figure is for a SWE-bench variant other than the one implied. MOSTLY FALSE: the score is 30–40% or 60–70%. FALSE: the score is below 30% or above 70%, or no such score was reported for that model.

Evidence

  1. Computer use, Claude 3.5 Sonnet, and Claude 3.5 Haiku Anthropic · 22 October 2024 Own record
    “On coding, it improves performance on SWE-bench Verified from 33.4% to 49.0%, scoring higher than all publicly available models—including reasoning models like OpenAI o1-preview and specialized systems designed for agentic coding.”
  2. Model Card Addendum: Claude 3.5 Haiku and Upgraded Claude 3.5 Sonnet Anthropic · 17 August 2026 Own record
    “The upgraded Claude 3.5 Sonnet model achieves a state-of-the-art pass@1 performance on SWE-bench Verified of 49.0%.2 We believe dedicated scaffolding and prompting can further improve the results.”
  3. Model Card Addendum: Claude 3.5 Haiku and Upgraded Claude 3.5 Sonnet Anthropic · 17 August 2026 Own record
    “2Compared to the current state-of-the-art score of 45.2% as reported on SWE-bench’s leaderboard as of October 22nd,”
  4. Anthropic advances AI with Claude 3.5 Haiku, improved Claude 3.5 Sonnet with computer control, and Palantir partnership for US Government Intelligence and Defense Operations Notebookcheck · 9 November 2024
    “On coding, it improves performance on SWE-bench Verified from 33.4% to 49.0%, scoring higher than all publicly available models—including reasoning models like OpenAI o1-preview and specialized systems designed for agentic coding.”

Reasoning

Anthropic's launch announcement of 22 October 2024 for the upgraded Claude 3.5 Sonnet says the model improves SWE-bench Verified performance from 33.4% to 49.0% (E1). The model card addendum gives the same pass@1 score of 49.0% on SWE-bench Verified (E2). Notebookcheck's report of 9 November 2024 repeats this figure (E4). Under the criteria, the claim turns on Anthropic's officially reported score. That score is 49.0%, which falls within the 45–55% range for TRUE, so "something like 50%" resolves true.

Cite this claim

Dario Amodei, “Anthropic's updated Claude Sonnet 3.5 scores about 50% on SWE-bench.” (said 11 November 2024). Verdict: resolved true. Reliability API, claim c_9c8b13320708, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_9c8b13320708

Claims without a verdict

Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.