Anthropic published all of its interpretability work so others could benefit.
Unresolvable The public record could not settle it.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The evidence is the person's or their organisation's own records.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judge as of 2025-03-10. True: Anthropic's interpretability research up to that date was publicly released (e.g. the Transformer Circuits publications, papers, blog posts, and released code or tools where relevant), and there is no evidence of significant interpretability work being kept unpublished. Mostly true: the large majority of the work was published, with only minor or incidental internal work left unreleased. Mixed: substantial work was published, but a significant portion is documented as withheld. Mostly false: only selected results were published, while Anthropic or credible sources acknowledge that significant interpretability work was kept internal; this is a part stated as the whole. False: little of the work was published.
Set before the research began.
Evidence (7)
-
E1 Circuits Updates - March 2024 Anthropic interpretability team (transformer-circuits.pub) · March 2024 Own record
“While these were improvements to the training process we used at the time, other changes have superseded them. We intend to publish these changes in a future update once we’ve vetted them further.”
-
E2 Circuits Updates - March 2024 Anthropic interpretability team (transformer-circuits.pub) · March 2024 Own record
“Others are minor points we wish to share, since we're unlikely to ever write a paper about them.”
-
E3 A mathematical framework for Transformer Circuits Anthropic · 22 December 2021 Own record
“Dec 22, 2021”
-
E4 Open-sourcing circuit-tracing tools Anthropic · 29 May 2025 Own record
“Today, we’re open-sourcing the method so that anyone can build on our research.”
-
E5 Circuits Updates - March 2024 Anthropic (transformer-circuits.pub, Anthropic interpretability team) · March 2024 Own record
“Some of these are emerging strands of research where we expect to publish more on in the coming months. Others are minor points we wish to share, since we're unlikely to ever write a paper about them.”
-
E6 Circuits Updates - March 2024 Anthropic (transformer-circuits.pub, Anthropic interpretability team) · March 2024 Own record
“While these were improvements to the training process we used at the time, other changes have superseded them. We intend to publish these changes in a future update once we've vetted them further.”
-
E7 Toy models of superposition Anthropic · 14 September 2022 Own record
“In this paper, we use toy models — small ReLU networks trained on synthetic data with sparse input features — to investigate how and when models represent more features than they have dimensions.”
Reasoning
Anthropic's own pages show that several interpretability works were published before the judging date, including the Transformer Circuits framework (E3) and Toy Models of Superposition (E7), and that minor findings were shared in a March 2024 update (E2, E5). The same update says some training-process changes were held back pending further vetting (E1, E6), and Anthropic open-sourced its circuit-tracing method only in May 2025, after the judging date (E4). No independent source describes the total scope of Anthropic's interpretability work, so the evidence cannot establish whether 'all' or most of it was published.
Cite this claim
Dario Amodei, “Anthropic published all of its interpretability work so others could benefit.” (said 10 March 2025). Verdict: unresolvable. Reliability API, claim c_6efa84fc06b6, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_6efa84fc06b6
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Dario Amodei
-
Mostly true
“So we did this experiment where we basically train the model to be all the good thing, helpful, honest, harmless, friendly.”
Anthropic ran an experiment training a model to be helpful, honest, harmless and friendly.
-
Resolved true
“They're not yet at the stage where we think that there is a real and meaningful increase in the threat end to end,”
-
Resolved true
“10 to 25% referred to the chance of civilization getting substantially derailed, right?”
-
Mostly true
“this lack of understanding is essentially unprecedented in the history of technology.”
-
Mostly true
“We were able to provide a strong theoretical basis for having conviction that superposition was the right hypothesis to pursue.”
Verdicts are made automatically; how verdicts are made.