AI models probably hallucinate less than humans do, but in more surprising ways.
Unresolvable The public record could not settle it.
Factual: Statements about the present or the past, checked against the record: did they hold up?
Said for an organisation they lead or work for; it counts on both records.
Reasoning
Hedged ('probably') comparison of hallucination rates and 'surprising' ways is too vague to test.
Cite this claim
Dario Amodei, “AI models probably hallucinate less than humans do, but in more surprising ways.” (said 22 May 2025). Verdict: unresolvable. Reliability API, claim c_2f1c3f575cb3, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_2f1c3f575cb3
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Dario Amodei
-
Mixed
“It’s easy to dismiss this as a one-off or curiosity, but we’ve repeatedly seen a pattern where AI performance in new intellectual domains goes from weak to superhuman in a matter of a few years.”
-
Mixed
“we were measuring these trends back when models cost $1,000 or $10,000 to train”
Amodei's group measured AI scaling trends when models cost $1,000 or $10,000 to train.
-
Mixed
“a lot of the other reasoning models in the market are trained primarily on math and competition coding,”
-
Mostly true
“I do think AI coding is moving the fastest of all the other areas.”
Amodei said he thinks AI coding is moving the fastest of all the areas of AI.
-
Mostly true
“Because when it knows that it doesn't get any gain out of thinking further, it doesn't think for longer.”
Verdicts are made automatically; how verdicts are made.