Improvements in training cost efficiency typically lead AI companies to spend more, not less, on training models.
Mostly true True in substance, wrong in a detail.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
The claim is a general factual statement: when the cost of training a model at a given capability level falls (the cost curve 'shifts'), AI companies typically respond by raising total training spending rather than cutting it. TRUE: evidence up to the statement date shows the pattern holds in general. That means credible data (for example Epoch AI or similar compute and cost trend analyses, company disclosures, or industry reports) showing large, sustained algorithmic or hardware efficiency gains alongside rising frontier training budgets and compute at the leading labs, with little sign that labs typically cut training spend after efficiency gains. MOSTLY TRUE: the pattern holds for frontier labs generally, with minor exceptions or some imprecision in how widely it applies. MIXED: the evidence is split, with some major companies raising spend and a comparable number holding or cutting it after efficiency gains, or the pattern holds only in some periods. MOSTLY FALSE: spending rose, but the evidence shows the rise was mainly driven by things other than efficiency gains, or the pattern holds only for one or two firms and is stated as typical. FALSE: the evidence shows that efficiency gains have typically been followed by flat or lower training spending at AI companies.
Set before the research began.
Evidence (5)
-
E1 How much does it cost to train frontier AI models? Epoch AI · 3 June 2024
“Our analysis reveals that the amortized hardware and energy cost for the final training run of frontier models has grown rapidly, at a rate of 2.4x per year since 2016 (95% CI: 2.0x to 3.1x).”
-
E2 Trends in GPU price-performance Epoch AI · 27 June 2022
“Our higher point estimate for the rate of performance improvements amongst GPUs used for ML research could be explained by relevant labs spending more resources on procuring top GPUs over time.”
-
E3 Trends in GPU price-performance Epoch AI · 27 June 2022
“we find that the amount of floating-point operations/second per $ (hereafter FLOP/s per $) doubles every ~2.5 years.”
-
E4 Trends in AI Epoch AI · 5 February 2026
“The consequences are striking. Training costs are climbing by 3.5× annually.”
-
E5 Algorithmic progress in language models Epoch AI · 12 March 2024
“We find that the level of compute needed to achieve a given level of performance has halved roughly every 8 months, with a 95% confidence interval of 5 to 14 months.”
Reasoning
Before the statement date, Epoch measured hardware efficiency gains, with GPU FLOP/s per dollar doubling about every 2.5 years [E3]. Epoch's later analysis of the period since 2016 finds that the cost of final training runs for frontier models grew about 2.4x per year [E1]. A separate Epoch study finds large algorithmic efficiency gains over the same era [E5]. So falling costs went together with rising frontier training spend, and no evidence shows labs cutting spend. However, the evidence covers frontier labs rather than AI companies in general. It also does not show that the efficiency gains caused the higher spending; E2 offers this only as a possible explanation.
Cite this claim
Dario Amodei, “Improvements in training cost efficiency typically lead AI companies to spend more, not less, on training models.” (said 13 October 2022). Verdict: mostly true. Reliability API, claim c_ca656861e0c6, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_ca656861e0c6
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Dario Amodei
-
Resolved true
“DeepSeek produced a model close to the performance of US models 7-10 months older, for a good deal less cost (but not anywhere near the ratios people have suggested)”
-
Mixed
“Human economic planners made the decisions that led to this success, not by directly controlling entire economies but by pulling a few key levers”
-
Mostly true
“Diseases have been eradicated and many countries have gone from poor to rich, and it is clear that the decisions involved in these tasks exhibit high returns to intelligence”
-
Mostly true
“biomedicine is unique in that although the process of developing drugs is overly cumbersome, once developed they generally are successfully deployed and used.”
-
Mixed
“It’s easy to dismiss this as a one-off or curiosity, but we’ve repeatedly seen a pattern where AI performance in new intellectual domains goes from weak to superhuman in a matter of a few years.”
Verdicts are made automatically; how verdicts are made.