Through history, people have been reluctant to admit an AI is truly intelligent.
Mostly true True in substance, wrong in a detail.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge said resolved true; the verdict shown is the first judge's.
What would count as true or false
Judge as of 2025-04-03. True: the historical record shows a repeated pattern of people declining to call AI systems truly intelligent once they achieve a milestone (the 'AI effect' or moving goalposts, as with chess, Go and language models), documented by commentators and researchers. Mostly true: the pattern is well documented, but it is overstated as universal or its long history is partly overstated. Mixed: some evidence for the pattern, and comparable evidence of people readily attributing intelligence to AI (e.g. the ELIZA effect). Mostly false: the pattern is mainly anecdotal and is stated as an established general fact. False: the evidence shows people have generally been quick to call AI truly intelligent.
Set before the research began.
Evidence (4)
-
E1 AI effect Wikipedia
“Historian Pamela McCorduck described this as a recurring feature of AI research, noting in her 2004 book Machines Who Think that once a problem is solved, it is no longer considered evidence of intelligence.”
-
E2 The AI effect today: On denials of AI's intelligence Információs Társadalom (Primož Krašovec, University of Ljubljana) · 2025
“It’s part of the history of the field of artificial intelligence that every time somebody figured out how to make a computer do something—play good checkers, solve simple but relatively informal problems—there was a chorus of critics to say, but that’s not thinking.”
-
E3 AI effect Wikipedia
“As these systems improved and became better understood, their achievements were often reinterpreted as examples of computation rather than intelligence.”
-
E4 ELIZA | AI Wiki AI Wiki (aiwiki.ai) · 19 March 2026
“Users consistently attributed understanding, empathy, and even personality to the program, despite its reliance on simple pattern matching.”
Reasoning
E1 reports that historian Pamela McCorduck described a recurring feature of AI research: once a problem is solved, it is no longer considered evidence of intelligence; E3 adds that such achievements were often reinterpreted as computation rather than intelligence. E2, a 2025 academic paper, quotes the observation that every AI achievement, such as playing checkers, was met by critics saying "that's not thinking". This supports a documented "AI effect" pattern. E4, however, shows that ELIZA users readily attributed understanding and personality to a simple program, so the reluctance is not universal and the claim is somewhat overstated.
Cite this claim
Scott Alexander, “Through history, people have been reluctant to admit an AI is truly intelligent.” (said 3 April 2025). Verdict: mostly true. Reliability API, claim c_401695afe9e2, method 0.1.0+8bea457b, dataset release v1.1.2. https://epistacklabs.com/claims/c_401695afe9e2
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Scott Alexander
-
Mostly true
“Since most of the benefits of prison come from incapacitation rather than deterrence, we should expect this to have limited effect”
Most of the benefits of prison come from incapacitation rather than deterrence.
-
Resolved true
“I do think solitary might be more expensive”
Solitary confinement for prisoners might be more expensive than standard imprisonment.
-
Resolved true
“I (following Roodman) gave two conclusions in my cost-benefit analysis - one that counted the suffering by prisoners themselves, and one that didn’t.”
-
Mostly true
“I started this essay by pointing out that, despite what geographical and cultural distance would suggest, the Nazis’ outgroup was not the vastly different Japanese, but the almost-identical German…”
-
Mostly true
“People have been studying “belief congruence theory” – the idea that differences in beliefs are more important than demographic factors in forming in-groups and outgroups – for decades.”
Verdicts are made automatically; how verdicts are made.