ClaimsDario Amodei

“And we published all of our work on it so others could benefit from it as well”

Dario Amodei, Anthropic CEO 10 March 2025 CEO Speaker Series with Dario Amodei of Anthropic (Council on Foreign Relations) archived copy

Factual AI safety and alignment

Anthropic published all of its interpretability work so others could benefit.

Unresolvable The public record could not settle it.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The evidence is the person's or their organisation's own records.

Said for an organisation they lead or work for; it counts on both records.

What would count as true or false

Judge as of 2025-03-10. True: Anthropic's interpretability research up to that date was publicly released (e.g. the Transformer Circuits publications, papers, blog posts, and released code or tools where relevant), and there is no evidence of significant interpretability work being kept unpublished. Mostly true: the large majority of the work was published, with only minor or incidental internal work left unreleased. Mixed: substantial work was published, but a significant portion is documented as withheld. Mostly false: only selected results were published, while Anthropic or credible sources acknowledge that significant interpretability work was kept internal; this is a part stated as the whole. False: little of the work was published.

Set before the research began.

Evidence (7)

  1. E1 Circuits Updates - March 2024 Anthropic interpretability team (transformer-circuits.pub) · March 2024 Own record

    “While these were improvements to the training process we used at the time, other changes have superseded them. We intend to publish these changes in a future update once we’ve vetted them further.”
  2. E2 Circuits Updates - March 2024 Anthropic interpretability team (transformer-circuits.pub) · March 2024 Own record

    “Others are minor points we wish to share, since we're unlikely to ever write a paper about them.”
  3. E3 A mathematical framework for Transformer Circuits Anthropic · 22 December 2021 Own record

    “Dec 22, 2021”
  4. E4 Open-sourcing circuit-tracing tools Anthropic · 29 May 2025 Own record

    “Today, we’re open-sourcing the method so that anyone can build on our research.”
  5. E5 Circuits Updates - March 2024 Anthropic (transformer-circuits.pub, Anthropic interpretability team) · March 2024 Own record

    “Some of these are emerging strands of research where we expect to publish more on in the coming months. Others are minor points we wish to share, since we're unlikely to ever write a paper about them.”
  6. E6 Circuits Updates - March 2024 Anthropic (transformer-circuits.pub, Anthropic interpretability team) · March 2024 Own record

    “While these were improvements to the training process we used at the time, other changes have superseded them. We intend to publish these changes in a future update once we've vetted them further.”
  7. E7 Toy models of superposition Anthropic · 14 September 2022 Own record

    “In this paper, we use toy models — small ReLU networks trained on synthetic data with sparse input features — to investigate how and when models represent more features than they have dimensions.”

Reasoning

Anthropic's own pages show that several interpretability works were published before the judging date, including the Transformer Circuits framework (E3) and Toy Models of Superposition (E7), and that minor findings were shared in a March 2024 update (E2, E5). The same update says some training-process changes were held back pending further vetting (E1, E6), and Anthropic open-sourced its circuit-tracing method only in May 2025, after the judging date (E4). No independent source describes the total scope of Anthropic's interpretability work, so the evidence cannot establish whether 'all' or most of it was published.

Cite this claim

Dario Amodei, “Anthropic published all of its interpretability work so others could benefit.” (said 10 March 2025). Verdict: unresolvable. Reliability API, claim c_6efa84fc06b6, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_6efa84fc06b6

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Dario Amodei, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Dario Amodei

  1. Mostly true Factual 28 February 2025
    “So we did this experiment where we basically train the model to be all the good thing, helpful, honest, harmless, friendly.”

    Anthropic ran an experiment training a model to be helpful, honest, harmless and friendly.

  2. Resolved true Factual 28 February 2025
    “They're not yet at the stage where we think that there is a real and meaningful increase in the threat end to end,”

    Anthropic assessed that Claude 3.7 Sonnet is not yet at a stage giving a real and meaningful end-to-end increase in dangerous threat capability.

  3. Resolved true Factual 28 February 2025
    “10 to 25% referred to the chance of civilization getting substantially derailed, right?”

    Amodei's earlier 10 to 25% figure referred to the chance of civilization getting substantially derailed.

  4. Mostly true Factual 18 February 2025
    “this lack of understanding is essentially unprecedented in the history of technology.”

    The lack of understanding of how AI systems work is essentially unprecedented in the history of technology.

  5. Mostly true Factual 18 February 2025
    “We were able to provide a strong theoretical basis for having conviction that superposition was the right hypothesis to pursue.”

    Amodei said that "we" were able to provide a strong theoretical basis for having conviction that superposition was the right hypothesis to pursue; the surrounding text does not say who "we" refers to.

All of them

Verdicts are made automatically; how verdicts are made.