Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 69 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
56 42 70 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 4 promises resolved, 5 needed for a score.
All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Dario Amodei's claims
49 claims
“When we founded Anthropic, we decided to make it a central part of the new company’s direction”
Dario Amodei, Anthropic co-founder, writing on his own site 18 February 2025 The Urgency of Interpretability (darioamodei.com)
When Anthropic was founded, its founders made mechanistic interpretability a central part of the company's direction, focused on LLMs.
Mostly true True in substance, wrong in a detail.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judge as of 2025-02-18 against evidence from Anthropic's founding in 2021. True: records from 2021 or shortly after show that interpretability research on language models was a central, stated research direction at founding. Such records include early hiring of interpretability researchers such as Chris Olah, founding announcements or mission statements naming interpretability, and the early Transformer Circuits publications (e.g. 'A Mathematical Framework for Transformer Circuits', December 2021). Mostly true: interpretability was a prominent early focus but one of several co-equal priorities, or it started within the first year rather than strictly at founding. Mixed: interpretability work existed early but founding-era materials give it only a minor role. Mostly false: interpretability became central only well after founding (e.g. 2023 or later). False: founding-era evidence shows interpretability was not part of the company's direction.
Evidence
- Anthropic is the new AI research outfit from OpenAI's Dario Amodei, and it has $124M to burn | TechCrunch TechCrunch · 28 May 2021
“Anthropic, as it’s called, was founded with his sister Daniela and its goal is to create “large-scale AI systems that are steerable, interpretable, and robust.””
- Anthropic is the new AI research outfit from OpenAI's Dario Amodei, and it has $124M to burn | TechCrunch TechCrunch · 28 May 2021
“The company is a public benefit corporation, and the plan for now, as the limited information on the site suggests, is to remain heads-down on researching these fundamental questions of how to make large models more tractable and interpretable.”
- A Mathematical Framework for Transformer Circuits Transformer Circuits Thread (Anthropic) · 22 December 2021 Own record
“One avenue for addressing these issues is mechanistic interpretability, attempting to reverse engineer the detailed computations performed by transformers, similar to how a programmer might try to reverse engineer complicated binaries into human-readable source code.”
- Anthropic raises Series B to build robust AI Anthropic · 29 April 2022 Own record
“On interpretability, it has made progress in mathematically reverse engineering the behavior of small language models and begun to understand the source of pattern-matching behavior in large language models.”
Reasoning
Independent reporting at Anthropic's founding in May 2021 says the company's stated goal was to build "large-scale AI systems that are steerable, interpretable, and robust" (E1). It also says the company planned to stay "heads-down" on making large models "more tractable and interpretable" (E2). In December 2021, Anthropic published a mechanistic interpretability paper on transformers (E3), and in 2022 it reported progress on reverse engineering language models (E4). This shows interpretability was a stated, central direction from founding, but E1 lists it as one of three properties with no ranking among them. Under the criteria, one of several co-equal priorities counts as mostly true.
Cite this claim
Dario Amodei, “When Anthropic was founded, its founders made mechanistic interpretability a central part of the company's direction, focused on LLMs.” (said 18 February 2025). Verdict: mostly true. Reliability API, claim c_61cbc9d52549, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_61cbc9d52549
Claims without a verdict
- Unresolvable 157
- Not yet due 40
- Own records only 43
- Not researched 134
- Not checkable 864
Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.