Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 70 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
60 42 78
All types combined: 74 (likely 68 to 80, high confidence), from 79 claims: 71 factual claims, 8 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Eliezer Yudkowsky's claims
21 claims
“I doubt a thousandfold increase in hardware would purchase anything like a thousandfold increase in effective intelligence”
Eliezer Yudkowsky, author 2008 Artificial Intelligence as a Positive and Negative Factor in Global Risk (MIRI)
This quote could not be matched word for word to the source page.
Yudkowsky doubted that a thousandfold increase in AI hardware would buy anything like a thousandfold increase in effective intelligence, while noting that such doubt is not reliable without an analytical calculation.
Resolved true The record shows it happened or was so.
What would count as true or false
The test is whether a roughly 1000x increase in hardware or compute gives roughly 1000x gains in effective intelligence. True: scaling research shows strongly sublinear returns, for example 1000x compute giving modest or logarithmic gains in loss, benchmark scores or capability measures, far short of a 1000x improvement on any accepted measure. Mostly true: returns are sublinear on most measures, but a few narrow metrics show very large gains. Mixed: experts or evidence are evenly divided, or the returns depend heavily on which measure is used. Mostly false: credible measures show near-proportional capability gains from 1000x compute in important domains. False: 1000x hardware is shown to give roughly 1000x or greater gains in general effective intelligence.
Evidence
- Scaling Laws for Neural Language Models arXiv (Kaplan et al.) · 23 January 2020
“The loss scales as a power-law with model size, dataset size, and the amount of compute used for training, with some trends spanning more than seven orders of magnitude.”
- Where’s the “intelligence explosion”? Noahpinion (Substack/blog) · 27 September 2026
“In OpenAI’s recently publicized results on unsolved math problems, success rises roughly with the log of compute over the range shown.”
- Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training arXiv (preprint) · 30 September 2024
“(2) scaling the total number of accelerators for large model training quickly yields diminishing returns even when hardware and parallelization strategies are properly optimized, implying poor marginal performance per additional unit of power or GPU-hour.”
- AI Scaling Wall - Wikipedia Wikipedia
“One 2025 analysis estimated that each tenfold rise in compute yields only one to two percentage points of MMLU-Pro accuracy.”
Reasoning
E1 reports that language-model loss falls as a power law in training compute, which is a sublinear relationship. E2 says success on unsolved math problems rises roughly with the log of compute. E4 cites a 2025 estimate that each tenfold rise in compute adds only one to two percentage points on MMLU-Pro. None of the evidence shows anything close to a 1000x capability gain from 1000x compute, so this meets the criteria for strongly sublinear returns.
Cite this claim
Eliezer Yudkowsky, “Yudkowsky doubted that a thousandfold increase in AI hardware would buy anything like a thousandfold increase in effective intelligence, while noting that such doubt is not reliable without an analytical calculation.” (said 2008). Verdict: resolved true. Reliability API, claim c_82ded51a6b60, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_82ded51a6b60
Claims without a verdict
Is a verdict here wrong, or do you speak for Eliezer Yudkowsky? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.