Because reasoning-focused RL is new, the amount all AI developers spend on the RL training stage is still small, so the field is early on its scaling curve.
Mostly true True in substance, wrong in a detail.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
Judge as of the date the statement was made: 2022-10-13 as given, or, if the source shows it was actually made later, that later date. True: evidence from that time shows that RL training aimed at reasoning was a recent development and that developers' spending on the RL stage was small (for example small compared with pretraining compute), so large gains from further scaling remained available. Mostly true: the substance holds, but a detail such as the extent of spending across 'all' developers is slightly overstated. Mixed: RL for reasoning was new, but there is evidence that some developers already spent heavily on it, or the 'early on the scaling curve' point is contested. Mostly false: the claim stretches a narrow or early observation into a general one, or reasoning RL was not new or not small-scale at that time. False: the evidence shows major developers were already spending at large scale on reasoning RL, with limited room to scale left.
Set before the research began.
Evidence (3)
-
E1 Training compute | AI Wiki AI Wiki · 15 October 2026
“Until recently, Epoch AI wrote in 2025, most large language models were trained with about 100 times more pretraining compute than post-training compute.”
-
E2 Training compute | AI Wiki AI Wiki · 15 October 2026
“Reasoning models changed that by spending large amounts of compute on reinforcement learning after pretraining and on long chains of reasoning when answering, known as test-time compute.”
-
E3 Training compute | AI Wiki AI Wiki · 15 October 2026
“xAI said it used its 200,000-GPU Colossus cluster to run reinforcement learning for Grok 4 "at pretraining scale", and that the run used over an order of magnitude more compute than had been used previously.”
Reasoning
E1 reports Epoch AI's 2025 finding that until recently most large language models used about 100 times more pretraining compute than post-training compute. That fits the claim that spending on the RL stage was small. E2 describes reasoning models, with their heavy RL after pretraining, as a later change from that pattern, which supports the claim that reasoning-focused RL was new and had room to scale. E3's Grok 4 RL run "at pretraining scale" is undated and appears to come later, so it does not contradict the claim as of the judging date. The evidence does not say exactly when reasoning RL emerged or confirm the claim for every developer, so the verdict is mostly true rather than true.
Cite this claim
Dario Amodei, “Because reasoning-focused RL is new, the amount all AI developers spend on the RL training stage is still small, so the field is early on its scaling curve.” (said 13 October 2022). Verdict: mostly true. Reliability API, claim c_430da0a8e630, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_430da0a8e630
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Dario Amodei
-
Mostly true
“the amount of computation that goes into the models doubles every four months.”
The amount of computation going into AI models doubles every four months.
-
Mostly true
“Distillation of frontier models allows lagging companies to narrow the gap using a fraction of the cost it would take to develop their own AI independently.”
-
Mostly false
“I thought it was a very plausible blocker one or two years ago.”
-
Resolved true
“I'd guess the number today is maybe ~4x/year.”
The current rate of algorithmic curve shift is maybe about 4x per year.
-
Mixed
“It’s easy to dismiss this as a one-off or curiosity, but we’ve repeatedly seen a pattern where AI performance in new intellectual domains goes from weak to superhuman in a matter of a few years.”
Verdicts are made automatically; how verdicts are made.