Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
83 78 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 2 predictions resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 0 promises resolved, 5 needed for a score.
All types combined: 83 (likely 78 to 88, high confidence), from 86 claims: 86 factual claims. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Daniela Amodei's claims
38 claims
“Some of the larger models that we've seen, we basically think that they have figured out how to lie unintentionally.”
Daniela Amodei, Anthropic president 2022 Podcast Transcript: Daniela and Dario Amodei on Anthropic (LessWrong)
Anthropic believes some of the larger language models it has seen have figured out how to lie unintentionally.
Mostly true True in substance, wrong in a detail.
The second judge said resolved true; the verdict shown is the first judge's.
The evidence is the person's or their organisation's own records.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
The claim is about what Anthropic believed in 2022. True if Anthropic's published research or statements from around 2022 express the view that larger language models produce false or misleading statements without being designed to, for example findings on sycophancy or untruthfulness increasing with scale. Mostly true if the research supports that larger models say false things but frames it differently from "lying unintentionally". Mixed if the evidence is ambiguous. Mostly false if Anthropic's research from that time only weakly or tangentially supports the belief. False if Anthropic's statements from that time contradict it.
Evidence
- Discovering Language Model Behaviors with Model-Written Evaluations arXiv (paper released with Anthropic's evals repository) Own record
“Instead, these models may simply provide incorrect answers that appear correct to us.”
- Discovering Language Model Behaviors with Model-Written Evaluations arXiv (paper released with Anthropic's evals repository) Own record
“Larger LMs repeat back a dialog user’s preferred answer (“sycophancy”) and express greater desire to pursue concerning goals like resource acquisition and goal preservation.”
- TruthfulQA: Measuring How Models Mimic Human Falsehoods arXiv · 16 August 2021
“The largest models were generally the least truthful.”
- Language models (mostly) know what they know Anthropic · 11 July 2022 Own record
“We first show that larger models are well-calibrated on diverse multiple choice and true/false questions when they are provided in the right format.”
Reasoning
Anthropic's model-written evaluations paper reports that larger language models repeat back a user's preferred answer, which it calls "sycophancy" [E2]. It also warns that such models "may simply provide incorrect answers that appear correct to us" [E1]. That supports the view that larger models produce incorrect output they were not designed to produce. However, the paper frames this as sycophancy or incorrect answers rather than in the terms the quote uses. Anthropic's July 2022 calibration research [E4] shows larger models are well-calibrated in some formats, but this does not contradict the belief. The independent TruthfulQA finding that the largest models were the least truthful [E3] is consistent with it but is not an Anthropic statement.
Cite this claim
Daniela Amodei, “Anthropic believes some of the larger language models it has seen have figured out how to lie unintentionally.” (said 2022). Verdict: mostly true. Reliability API, claim c_e9c487d15746, method 0.1.0+28da144b. https://epistacklabs.com/claims/c_e9c487d15746
Claims without a verdict
Is a verdict here wrong, or do you speak for Daniela Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.