Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 69 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
56 42 70 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 4 promises resolved, 5 needed for a score.
All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Dario Amodei's claims
49 claims
“Because the value of having a more intelligent system is so high, this shifting of the curve typically causes companies to spend more, not less, on training models”
Dario Amodei, essay author 13 October 2022 On DeepSeek and Export Controls (darioamodei.com)
Improvements in training cost efficiency typically lead AI companies to spend more, not less, on training models.
Mostly true True in substance, wrong in a detail.
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
The claim is a general factual statement: when the cost of training a model at a given capability level falls (the cost curve 'shifts'), AI companies typically respond by raising total training spending rather than cutting it. TRUE: evidence up to the statement date shows the pattern holds in general. That means credible data (for example Epoch AI or similar compute and cost trend analyses, company disclosures, or industry reports) showing large, sustained algorithmic or hardware efficiency gains alongside rising frontier training budgets and compute at the leading labs, with little sign that labs typically cut training spend after efficiency gains. MOSTLY TRUE: the pattern holds for frontier labs generally, with minor exceptions or some imprecision in how widely it applies. MIXED: the evidence is split, with some major companies raising spend and a comparable number holding or cutting it after efficiency gains, or the pattern holds only in some periods. MOSTLY FALSE: spending rose, but the evidence shows the rise was mainly driven by things other than efficiency gains, or the pattern holds only for one or two firms and is stated as typical. FALSE: the evidence shows that efficiency gains have typically been followed by flat or lower training spending at AI companies.
Evidence
- How much does it cost to train frontier AI models? Epoch AI · 3 June 2024
“Our analysis reveals that the amortized hardware and energy cost for the final training run of frontier models has grown rapidly, at a rate of 2.4x per year since 2016 (95% CI: 2.0x to 3.1x).”
- Trends in GPU price-performance Epoch AI · 27 June 2022
“Our higher point estimate for the rate of performance improvements amongst GPUs used for ML research could be explained by relevant labs spending more resources on procuring top GPUs over time.”
- Trends in GPU price-performance Epoch AI · 27 June 2022
“we find that the amount of floating-point operations/second per $ (hereafter FLOP/s per $) doubles every ~2.5 years.”
- Trends in AI Epoch AI · 5 February 2026
“The consequences are striking. Training costs are climbing by 3.5× annually.”
- Algorithmic progress in language models Epoch AI · 12 March 2024
“We find that the level of compute needed to achieve a given level of performance has halved roughly every 8 months, with a 95% confidence interval of 5 to 14 months.”
Reasoning
Before the statement date, Epoch measured hardware efficiency gains, with GPU FLOP/s per dollar doubling about every 2.5 years [E3]. Epoch's later analysis of the period since 2016 finds that the cost of final training runs for frontier models grew about 2.4x per year [E1]. A separate Epoch study finds large algorithmic efficiency gains over the same era [E5]. So falling costs went together with rising frontier training spend, and no evidence shows labs cutting spend. However, the evidence covers frontier labs rather than AI companies in general. It also does not show that the efficiency gains caused the higher spending; E2 offers this only as a possible explanation.
Cite this claim
Dario Amodei, “Improvements in training cost efficiency typically lead AI companies to spend more, not less, on training models.” (said 13 October 2022). Verdict: mostly true. Reliability API, claim c_ca656861e0c6, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_ca656861e0c6
Claims without a verdict
- Unresolvable 157
- Not yet due 40
- Own records only 43
- Not researched 134
- Not checkable 864
Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.