Yudkowsky doubted that a thousandfold increase in AI hardware would buy anything like a thousandfold increase in effective intelligence, while noting that such doubt is not reliable without an analytical calculation.
Resolved true The record shows it happened or was so.
Prediction: Statements about events outside the person's control, checked once they fell due: did they come true?
What would count as true or false
The test is whether a roughly 1000x increase in hardware or compute gives roughly 1000x gains in effective intelligence. True: scaling research shows strongly sublinear returns, for example 1000x compute giving modest or logarithmic gains in loss, benchmark scores or capability measures, far short of a 1000x improvement on any accepted measure. Mostly true: returns are sublinear on most measures, but a few narrow metrics show very large gains. Mixed: experts or evidence are evenly divided, or the returns depend heavily on which measure is used. Mostly false: credible measures show near-proportional capability gains from 1000x compute in important domains. False: 1000x hardware is shown to give roughly 1000x or greater gains in general effective intelligence.
Set before the research began.
Evidence (4)
-
E1 Scaling Laws for Neural Language Models arXiv (Kaplan et al.) · 23 January 2020
“The loss scales as a power-law with model size, dataset size, and the amount of compute used for training, with some trends spanning more than seven orders of magnitude.”
-
E2 Where’s the “intelligence explosion”? Noahpinion (Substack/blog) · 27 September 2026
“In OpenAI’s recently publicized results on unsolved math problems, success rises roughly with the log of compute over the range shown.”
-
E3 Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training arXiv (preprint) · 30 September 2024
“(2) scaling the total number of accelerators for large model training quickly yields diminishing returns even when hardware and parallelization strategies are properly optimized, implying poor marginal performance per additional unit of power or GPU-hour.”
-
E4 AI Scaling Wall - Wikipedia Wikipedia
“One 2025 analysis estimated that each tenfold rise in compute yields only one to two percentage points of MMLU-Pro accuracy.”
Reasoning
E1 reports that language-model loss falls as a power law in training compute, which is a sublinear relationship. E2 says success on unsolved math problems rises roughly with the log of compute. E4 cites a 2025 estimate that each tenfold rise in compute adds only one to two percentage points on MMLU-Pro. None of the evidence shows anything close to a 1000x capability gain from 1000x compute, so this meets the criteria for strongly sublinear returns.
Cite this claim
Eliezer Yudkowsky, “Yudkowsky doubted that a thousandfold increase in AI hardware would buy anything like a thousandfold increase in effective intelligence, while noting that such doubt is not reliable without an analytical calculation.” (said 2008). Verdict: resolved true. Reliability API, claim c_82ded51a6b60, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_82ded51a6b60
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More prediction claims by Eliezer Yudkowsky
-
Mixed
“Beating GPT-4 on GI just forces OpenAI to release 4.5.”
-
Resolved false
“The current crop of people will not try it.”
-
Mostly false
“So probably Paul’s going to win, but slight moral victory.”
-
Resolved true
“Alignment will not be solved in a few years.”
-
Resolved true
“even if GPT-5 doesn’t end the world, which I agree is like more than 50% of where my probability mass lies”
GPT-5 will not end the world, with more than 50% of Yudkowsky's probability on that outcome.
Verdicts are made automatically; how verdicts are made.