Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
83 78 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 2 predictions resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 0 promises resolved, 5 needed for a score.
All types combined: 83 (likely 78 to 88, high confidence), from 86 claims: 86 factual claims. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Daniela Amodei's claims
43 claims
“We’re very open about the fact that these models sometimes make things up or get confused.”
Daniela Amodei, Anthropic president, interviewee 9 May 2026 Daniela Amodei, Co-Founder and President of Anthropic: Building AI the Right Way (transcript) (The Transcript Desk)
Anthropic is open about the fact that its AI models sometimes make things up or get confused.
Resolved true The record shows it happened or was so.
The evidence is the person's or their organisation's own records.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judged as of 2026-05-09. True: Anthropic's public materials from around that date (model and system cards, Claude interface disclaimers, help-centre pages, research posts) openly say that its models can hallucinate or make errors and become confused. Mostly true: the acknowledgments exist but appear mostly in technical documents, or cover making things up but not confusion. Mixed: acknowledgment is inconsistent across channels. Mostly false: acknowledgments are rare or buried, while Anthropic's main messaging presents the models as reliable. False: the evidence shows Anthropic denied or hid these limitations.
Evidence
- Claude is providing incorrect or misleading responses. What's going on? | Claude Help Center Anthropic (Claude Help Center) · 16 March 2026 Own record
“In an attempt to be a helpful assistant, Claude can occasionally produce responses that are incorrect or misleading. This is known as "hallucinating" information, and it’s a byproduct of some of the current limitations of frontier Generative AI models, like Claude.”
- Claude is providing incorrect or misleading responses. What's going on? | Claude Help Center Anthropic (Claude Help Center) · 16 March 2026 Own record
“For example, in some subject areas, Claude might not have been trained on the most-up-to-date information and may get confused when prompted about current events.”
- Tracing the thoughts of a large language model Anthropic · 27 March 2025 Own record
“Often this extended thinking gives better answers, but sometimes this "chain of thought" ends up being misleading; Claude sometimes makes up plausible-sounding steps to get where it wants to go.”
- Consumer Terms of Service Anthropic · 8 October 2025 Own record
“Outputs may not always be accurate and may contain material inaccuracies even if they appear accurate because of their level of detail or specificity.”
Reasoning
That page covers both parts of the proposition in a consumer-facing channel, not only in technical documents. An Anthropic research post (E3) says Claude sometimes makes up plausible-sounding reasoning steps. The consumer terms (E4) warn that outputs may contain material inaccuracies. All of these are Anthropic's own published materials, which here are the record the claim is about, and they were in place before the judging date.
Cite this claim
Daniela Amodei, “Anthropic is open about the fact that its AI models sometimes make things up or get confused.” (said 9 May 2026). Verdict: resolved true. Reliability API, claim c_17e2f2a99095, method 0.1.0+28da144b. https://epistacklabs.com/claims/c_17e2f2a99095
Claims without a verdict
Is a verdict here wrong, or do you speak for Daniela Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.