Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
80 72 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
70 62 78 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 2 promises resolved, 5 needed for a score.
All types combined: 75 (likely 69 to 80, high confidence), from 79 claims: 35 factual claims, 44 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Scott Alexander's claims
35 claims
“There’s this thing where through history, people have been really reluctant to admit an AI is truly intelligent.”
Scott Alexander, interviewee 3 April 2025 AI 2027: month-by-month model of intelligence explosion — Scott Alexander & Daniel Kokotajlo (Dwarkesh Podcast)
Through history, people have been reluctant to admit an AI is truly intelligent.
Mostly true True in substance, wrong in a detail.
The second judge said resolved true; the verdict shown is the first judge's.
What would count as true or false
Judge as of 2025-04-03. True: the historical record shows a repeated pattern of people declining to call AI systems truly intelligent once they achieve a milestone (the 'AI effect' or moving goalposts, as with chess, Go and language models), documented by commentators and researchers. Mostly true: the pattern is well documented, but it is overstated as universal or its long history is partly overstated. Mixed: some evidence for the pattern, and comparable evidence of people readily attributing intelligence to AI (e.g. the ELIZA effect). Mostly false: the pattern is mainly anecdotal and is stated as an established general fact. False: the evidence shows people have generally been quick to call AI truly intelligent.
Evidence
- AI effect Wikipedia
“Historian Pamela McCorduck described this as a recurring feature of AI research, noting in her 2004 book Machines Who Think that once a problem is solved, it is no longer considered evidence of intelligence.”
- The AI effect today: On denials of AI's intelligence Információs Társadalom (Primož Krašovec, University of Ljubljana) · 2025
“It’s part of the history of the field of artificial intelligence that every time somebody figured out how to make a computer do something—play good checkers, solve simple but relatively informal problems—there was a chorus of critics to say, but that’s not thinking.”
- AI effect Wikipedia
“As these systems improved and became better understood, their achievements were often reinterpreted as examples of computation rather than intelligence.”
- ELIZA | AI Wiki AI Wiki (aiwiki.ai) · 19 March 2026
“Users consistently attributed understanding, empathy, and even personality to the program, despite its reliance on simple pattern matching.”
Reasoning
E1 reports that historian Pamela McCorduck described a recurring feature of AI research: once a problem is solved, it is no longer considered evidence of intelligence; E3 adds that such achievements were often reinterpreted as computation rather than intelligence. E2, a 2025 academic paper, quotes the observation that every AI achievement, such as playing checkers, was met by critics saying "that's not thinking". This supports a documented "AI effect" pattern. E4, however, shows that ELIZA users readily attributed understanding and personality to a simple program, so the reluctance is not universal and the claim is somewhat overstated.
Cite this claim
Scott Alexander, “Through history, people have been reluctant to admit an AI is truly intelligent.” (said 3 April 2025). Verdict: mostly true. Reliability API, claim c_401695afe9e2, method 0.1.0+8bea457b. https://epistacklabs.com/claims/c_401695afe9e2
Claims without a verdict
Is a verdict here wrong, or do you speak for Scott Alexander? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.