Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
83 78 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 2 predictions resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 0 promises resolved, 5 needed for a score.
All types combined: 83 (likely 78 to 88, high confidence), from 86 claims: 86 factual claims. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Daniela Amodei's claims
43 claims
“We are very open about the fact that the models make things up sometimes.”
Daniela Amodei, Anthropic president, interviewed 2026 Daniela Amodei Says Curiosity Is Underrated (Stanford GSB)
Anthropic is open about the fact that its models sometimes make things up.
Resolved true The record shows it happened or was so.
The evidence is the person's or their organisation's own records.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judged as of 2026. True: Anthropic's public materials from that time (model cards, system cards, user-facing disclaimers in Claude, help-centre pages, research posts) openly say that its models can hallucinate, confabulate or produce false information. Mostly true: such statements exist but are mostly in technical documents, with only minor gaps. Mixed: the acknowledgments are present in some channels but missing or played down in prominent ones. Mostly false: acknowledgments are rare or buried, while Anthropic's main messaging presents the models as reliable. False: the evidence shows Anthropic denied or hid that its models make things up.
Evidence
- Why do AI models hallucinate? · Claude Academy Anthropic (Claude Academy) · 1 January 2026 Own record
“But sometimes AIs still make things up. We call these errors hallucinations.”
- Claude está fornecendo respostas incorretas ou enganosas. O que está acontecendo? | Anthropic Help Center Anthropic Help Center · 5 March 2026 Own record
“Na tentativa de ser um assistente útil, Claude pode ocasionalmente produzir respostas que são incorretas ou enganosas.”
- Reduce hallucinations Anthropic (Claude Developer Platform docs) · 21 October 2026 Own record
“Even the most advanced language models, such as Claude, can sometimes generate text that is factually incorrect or inconsistent with the given context.”
- Model Card and Evaluations for Claude Models - Anthropic Anthropic · 8 August 2026 Own record
“Claude models still confabulate – getting facts wrong, hallucinating details, and filling in gaps in knowledge with fabrication.”
Reasoning
Anthropic's published materials from 2026 say openly, in several channels, that its models make things up. The user-facing Claude Academy tutorial says AIs "sometimes still make things up" and calls these hallucinations (E1). Two technical documents say the same: the developer docs say Claude can generate factually incorrect text (E3), and the model card says Claude models "still confabulate" and fill gaps with fabrication (E4). Because the claim is about what Anthropic itself publishes, these published materials are the direct record, and they cover both user-facing and technical channels, as the criteria for "true" require.
Cite this claim
Daniela Amodei, “Anthropic is open about the fact that its models sometimes make things up.” (said 2026). Verdict: resolved true. Reliability API, claim c_8af95caa8ce6, method 0.1.0+28da144b. https://epistacklabs.com/claims/c_8af95caa8ce6
Claims without a verdict
Is a verdict here wrong, or do you speak for Daniela Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.