Amodei's group measured AI scaling trends when models cost $1,000 or $10,000 to train.
Mixed Partly true and partly false in roughly equal measure.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
The test is whether Amodei and his collaborators (at Baidu, OpenAI or Anthropic) measured AI scaling trends in work where individual models cost roughly $1,000 to $10,000 to train. Treat the figures as order-of-magnitude. TRUE: dated publications or contemporaneous records show his group studied scaling trends with models whose training cost was in the thousands to low tens of thousands of dollars. Examples are early scaling work such as Baidu's 2017 'Deep Learning Scaling is Predictable, Empirically' or early OpenAI scaling studies, with compute or cost estimates in that range. MOSTLY TRUE: the group did do early scaling measurements, but the models cost somewhat more or less than stated (for example around $100 or about $50,000), or the timing detail is slightly off. MIXED: scaling work in that era is documented, but whether Amodei's own group did it, or the cost scale, is only partly supported. MOSTLY FALSE: Amodei was involved in scaling work, but the earliest measurements involved models far more expensive (hundreds of thousands of dollars or more), so the claim overstates how early or cheap the work was. FALSE: the evidence shows his group did no such scaling measurements at that cost level.
Set before the research began.
Evidence (12)
-
E1 The Making Of Dario Amodei Big Technology · 29 July 2025
“In their experiments, Amodei and his colleagues found that AI’s performance improved meaningfully as they added more of these ingredients. The team released a paper on speech recognition that showed that model size directly correlated with performance.”
-
E2 The Making Of Dario Amodei Big Technology · 29 July 2025
“But the jump from GPT-2 to GPT-3 would be massive, a 100x project costing tens of millions of dollars.”
-
E3 When Will We Spend Enough to Train Transformative AI EA Forum · 28 March 2023
“estimates put the cost of training GPT-2 in 2019 around $20k-$100k. Training GPT-3 in 2020 cost $2m-$10m.”
-
E4 The Making Of Dario Amodei Big Technology · 29 July 2025
“We’ve done scaling laws. We could see the path to the models getting good.”
-
E5 The Making Of Dario Amodei Big Technology · 29 July 2025
“In their experiments, Amodei and his colleagues found that AI’s performance improved meaningfully as they added more of these ingredients.”
-
E6 The Making Of Dario Amodei Big Technology · 29 July 2025
“The team released a paper on speech recognition that showed that model size directly correlated with performance.”
-
E7 The Making Of Dario Amodei Big Technology · 29 July 2025
“Amodei, who’d become a research director at OpenAI, got directly involved in the next iteration, GPT-2, which was effectively the same model as GPT, just bigger.”
-
E8 The Making Of Dario Amodei Big Technology · 29 July 2025
“But the jump from GPT-2 to GPT-3 would be massive, a 100x project costing tens of millions of dollars.”
-
E9 AI and compute OpenAI · 16 May 2018 Own record
“Dario Amodei, Danny Hernandez”
-
E10 AI and compute OpenAI · 16 May 2018 Own record
“2012 to 2014: Infrastructure to train on many GPUs was uncommon, so most results used 1-8 GPUs rated at 1-2 TFLOPS for a total of 0.001-0.1 pfs-days.”
-
E11 Scaling laws for neural language models - OpenAI OpenAI · 23 January 2020 Own record
“Jared Kaplan, Sam McCandlish, Tom Henighan, Tom Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, Dario Amodei”
-
E12 Deep Learning Scaling is Predictable, Empirically arXiv
“In speech recognition, Amodei et al. (2016) show word error rate improvement for a Deep Speech 2 model on varying sizes of training data.”
Reasoning
Independent sources show that Amodei and colleagues ran early scaling experiments. E1, E5 and E6 describe work by Amodei and colleagues, including a speech-recognition paper linking model size to performance, and E12 cites Amodei et al. (2016) on how Deep Speech 2 error rates changed with the amount of training data. None of the evidence gives a dollar training cost for that early speech-recognition scaling work. E10 gives compute only in petaflop/s-days, and the paper credits in E11 carry no cost figure. The nearest cost figure is a third-party estimate of $20k–$100k for GPT-2 (E3), a model Amodei worked on (E7). That figure is near the claimed range but above it, so the cost part of the claim is only partly supported.
Cite this claim
Dario Amodei, “Amodei's group measured AI scaling trends when models cost $1,000 or $10,000 to train.” (said 10 March 2025). Verdict: mixed. Reliability API, claim c_96cb67eda7c1, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_96cb67eda7c1
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Dario Amodei
-
Mixed
“It’s easy to dismiss this as a one-off or curiosity, but we’ve repeatedly seen a pattern where AI performance in new intellectual domains goes from weak to superhuman in a matter of a few years.”
-
Mixed
“a lot of the other reasoning models in the market are trained primarily on math and competition coding,”
-
Mostly true
“I do think AI coding is moving the fastest of all the other areas.”
Amodei said he thinks AI coding is moving the fastest of all the areas of AI.
-
Mostly true
“Because when it knows that it doesn't get any gain out of thinking further, it doesn't think for longer.”
-
Resolved true
“we train Claude 3.7, you know, more to focus on these real-world tasks.”
Anthropic trained Claude 3.7 to focus more on real-world tasks, as distinct from competition coding.
Verdicts are made automatically; how verdicts are made.