AI performance in new intellectual domains has repeatedly gone from weak to superhuman within a few years.
Mixed Partly true and partly false in roughly equal measure.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judge as of 2026-09-23. True: documented benchmark or competition history shows several (at least three or so) distinct intellectual domains where AI went from clearly weak (well below average human expert) to superhuman (beating top humans) within a few years, i.e. about 2–5 years (e.g. Go, competitive programming, math olympiad problems or other domains). Mostly true: the pattern holds repeatedly but some cases took somewhat longer than 'a few years' or reached top-expert level rather than clearly superhuman. Mixed: only one or two clear cases fit, with others still sub-human or taking much longer. Mostly false: there are isolated examples, but most domains cited show slow progress or have not reached superhuman level. False: no domain shows this weak-to-superhuman transition within a few years.
Set before the research began.
Evidence (12)
-
E1 AlphaGo versus Lee Sedol - Wikipedia Wikipedia · 9 March 2016
“Computer programs Zen and Crazy Stone had previously defeated 9 dan professional players only with large handicaps of four or five stones.”
-
E2 AlphaGo versus Lee Sedol - Wikipedia Wikipedia · 9 March 2016
“AlphaGo versus Lee Sedol, also known as the DeepMind Challenge Match, was a five-game Go match between top Go player Lee Sedol and AlphaGo, a computer Go program developed by DeepMind, played in Seoul, South Korea between the 9th and 15th of March 2016.”
-
E3 Advanced version of Gemini with Deep Think officially achieves gold-medal standard at the International Mathematical Olympiad Google DeepMind · 21 July 2025
“Last year, Google DeepMind’s combined AlphaProof and AlphaGeometry 2 systems achieved the silver-medal standard, solving four out of the six problems and scoring 28 points.”
-
E4 AI at the 2025 ICPC World Finals | AI Wiki AI Wiki (aiwiki.ai) · 8 June 2026
“The AI systems did not compete inside the official standings.”
-
E5 AlphaGo versus Lee Sedol - Wikipedia Wikipedia
“Computer programs Zen and Crazy Stone had previously defeated 9 dan professional players only with large handicaps of four or five stones.”
-
E6 AlphaGo versus Lee Sedol - Wikipedia Wikipedia
“AlphaGo defeated European champion Fan Hui, a 2 dan professional, 5–0 in October 2015, the first time an AI had beaten a human professional player at the game on a full-sized board without a handicap.”
-
E7 AI at the 2025 ICPC World Finals | AI Wiki AI Wiki (aiwiki.ai) · 8 June 2026
“In September 2025, at the 49th International Collegiate Programming Contest (ICPC) World Finals in Baku, Azerbaijan, two leading artificial-intelligence laboratories reported that their general-purpose reasoning models reached or surpassed the level of the world's best university programming teams.”
-
E8 AI at the 2025 ICPC World Finals | AI Wiki AI Wiki (aiwiki.ai) · 8 June 2026
“Several commentators cautioned against reading the result as evidence that AI had broadly surpassed human programmers, as opposed to excelling at a specific, well-defined competitive format.”
-
E9 AlphaGo - Wikipedia Wikipedia · 27 January 2016
“In March 2016, it beat Lee Sedol in a five-game match, the first time a computer Go program has beaten a 9-dan professional without handicap.”
-
E10 AlphaGo - Wikipedia Wikipedia · 27 January 2016
“Almost two decades after IBM's computer Deep Blue beat world chess champion Garry Kasparov in the 1997 match, the strongest Go programs using artificial intelligence techniques only reached about amateur 5-dan level”
-
E11 Computer Go - Wikipedia Wikipedia
“Before 2015, programs were weak. The best efforts of the 1980s and 1990s produced only AIs that could be defeated by beginners, and AIs of the early 2000s were intermediate level at best.”
-
E12 OpenAI Five defeats Dota 2 world champions OpenAI · 15 April 2019
“OpenAI Five’s victories on Saturday, as compared to its losses at The International 2018, are due to a major change: 8x more training compute.”
Reasoning
Go is one clear case. Before 2015, Go programs were weak: about amateur 5-dan, and able to beat professionals only with large handicaps (E10, E11, E1). AlphaGo then beat a professional without handicap in October 2015 and beat top player Lee Sedol in March 2016 (E6, E9, E2). The other domains are only partly shown. At the math olympiad, AI went from silver-medal standard in 2024 to gold in 2025 (E3), which is top-expert level, not clearly superhuman, and no weak starting point is documented. In competitive programming, labs self-reported in 2025 that their models matched or beat the best ICPC teams, outside the official standings, with commentators urging caution and no earlier baseline given (E4, E7, E8). Dota 2 losses in 2018 followed by wins in 2019 (E12) do not show a clearly weak starting point. So the evidence shows one or two clear cases rather than a well-documented repeated pattern.
Cite this claim
Dario Amodei, “AI performance in new intellectual domains has repeatedly gone from weak to superhuman within a few years.” (said 23 September 2026). Verdict: mixed. Reliability API, claim c_bfc1b6e378b0, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_bfc1b6e378b0
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Dario Amodei
-
Mixed
“we were measuring these trends back when models cost $1,000 or $10,000 to train”
Amodei's group measured AI scaling trends when models cost $1,000 or $10,000 to train.
-
Mixed
“a lot of the other reasoning models in the market are trained primarily on math and competition coding,”
-
Mostly true
“I do think AI coding is moving the fastest of all the other areas.”
Amodei said he thinks AI coding is moving the fastest of all the areas of AI.
-
Mostly true
“Because when it knows that it doesn't get any gain out of thinking further, it doesn't think for longer.”
-
Resolved true
“we train Claude 3.7, you know, more to focus on these real-world tasks.”
Anthropic trained Claude 3.7 to focus more on real-world tasks, as distinct from competition coding.
Verdicts are made automatically; how verdicts are made.