AI models will not have enough autonomy within two years to raise alignment concerns, though that may not be far behind.
Mostly true True in substance, wrong in a detail.
Prediction: Statements about events outside the person's control, checked once they fell due: did they come true?
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
Judge as of August 2025, two years after the statement. The claim has two parts: (a) by then, AI models will not have enough autonomy for alignment failures to be a practical worry; (b) that level may not be far off. TRUE: as of August 2025, authoritative assessments (frontier lab system cards and safety frameworks, government AI safety institute evaluations) conclude that deployed models lack the autonomy to cause serious alignment-related harm on their own (for example, no lab declares that autonomy or AI R&D risk thresholds have been crossed). Those same assessments also describe rising agentic capability and emerging precursor behaviours, consistent with the concern being near. Misaligned behaviour shown only in contrived test settings does not by itself falsify part (a). MOSTLY TRUE: part (a) holds, but there is little sign that the concern is approaching, or the assessments are slightly ambiguous. MIXED: the assessments are split, for example a lab treats autonomy-related alignment risk as already needing active safeguards while others say it does not. MOSTLY FALSE: by August 2025, a major lab or government body formally determines that models had reached autonomy levels where alignment failure is a present practical concern, or real-world incidents of autonomous misaligned model behaviour causing notable harm are documented. FALSE: such determinations or incidents were widespread well before August 2025, showing that the autonomy concern had already arrived.
Set before the research began.
Evidence (2)
-
E1 Measuring AI Ability to Complete Long Software Tasks METR · 19 March 2025
“And yet the best AI agents are not currently able to carry out substantive projects by themselves or directly substitute for human labor.”
-
E2 Measuring AI Ability to Complete Long Software Tasks METR · 19 March 2025
“If the trend of the past 6 years continues to the end of this decade, frontier AI systems will be capable of autonomously carrying out month-long projects.”
Reasoning
METR is an independent evaluator. In March 2025 it reported that the best AI agents could not yet carry out substantive projects on their own or directly replace human labour (E1). That supports part (a): models lacked the autonomy for alignment failures to be a practical concern. The same analysis projected that, if the trend of the past six years continues, frontier AI systems could autonomously carry out month-long projects by the end of the decade [E2], which fits part (b). The evidence is a single source dated about five months before the August 2025 judgment date, and it includes no lab system cards or government evaluations on whether risk thresholds had been crossed, so the verdict is mostly true rather than fully true.
Cite this claim
Dario Amodei, “AI models will not have enough autonomy within two years to raise alignment concerns, though that may not be far behind.” (said 8 August 2023). Verdict: mostly true. Reliability API, claim c_bc1553c50892, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_bc1553c50892
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More prediction claims by Dario Amodei
-
Resolved true
“I would not be surprised at all if we hit ASL-3 next year.”
Dario Amodei said he would not be surprised at all if Anthropic's models hit ASL-3 in 2025.
-
Mostly false
“We believe AI for biology is on a similar exponential trend.”
-
Mostly true
“We're gonna be fine. The-- the impact of this designation is fairly small.”
-
Resolved false
“where AI is writing 90 percent of the code”
Within three to six months of March 2025, AI will be writing 90 percent of code.
-
Resolved false
“And then in twelve months, we may be in a world where AI is writing essentially all of the code”
Within twelve months of March 2025, AI may be writing essentially all of the code.
Verdicts are made automatically; how verdicts are made.