ClaimsDario Amodei

“I do think AI coding is moving the fastest of all the other areas.”

Dario Amodei, Anthropic CEO, interviewed 28 February 2025 Hard Fork - Anthropic's C.E.O. Dario Amodei on Surviving the A.I. Endgame Transcript (Podscripts (Hard Fork)) archived copy

Factual AI capabilities

Amodei said he thinks AI coding is moving the fastest of all the areas of AI.

Mostly true True in substance, wrong in a detail.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The second judge would not resolve this claim; the verdict shown is the first judge's.

What would count as true or false

Judge as of 2025-02-28. The claim is about degree and comparison, and it is hedged ('I do think'). True: as of early 2025, benchmark trends, expert assessments or adoption and capability data show AI coding (e.g. SWE-bench-type benchmark gains, code-assistant adoption) improving faster than other major AI application areas (e.g. writing, customer service, medicine, law, robotics). Mostly true: coding is among the fastest-advancing areas and arguably the fastest, but one or two other areas show similar progress. Mixed: the evidence is genuinely split, with coding fast but several other areas advancing at least as quickly by common measures. Mostly false: coding is advancing quickly but other areas clearly advanced faster by most measures. False: the evidence shows coding progress was slower than most other application areas at the time.

Set before the research began.

Evidence (4)

  1. E1 Technical Performance Stanford HAI, AI Index 2025 Report

    “By 2024, AI performance on these benchmarks saw remarkable improvements, with gains of 18.8 and 48.9 percentage points on MMMU and GPQA, respectively. On SWE-bench, AI systems could solve just 4.4% of coding problems in 2023—a figure that jumped to 71.7% in 2024.”

  2. E2 How Does Time Horizon Vary Across Domains? METR · 14 July 2025

    “Visual computer use (OSWorld, WebArena) time horizons are 40-100x shorter than the software and reasoning cluster but are increasing at similar rates.”

  3. E3 Coding as the epicenter of AI progress and the path to general agents Interconnects · 18 September 2025

    “Coding is maybe the only domain of AI use where I’ve felt this slow, gradual improvement.”

  4. E4 Coding as the epicenter of AI progress and the path to general agents Interconnects · 18 September 2025

    “Chat and the quality of prose written by models has leveled off, other than finetuning to user measures such as sycophancy.”

Reasoning

The Stanford AI Index [E1] reports that SWE-bench coding performance rose from 4.4% to 71.7% in 2024. That gain is larger than the gains it reports for MMMU (18.8 points) and GPQA (48.9 points), so coding looks like one of the fastest-advancing areas. METR [E2] finds that visual computer-use time horizons were rising at rates similar to the software and reasoning cluster, which means at least one other area kept pace. The Interconnects post [E3, E4] says prose and chat quality had levelled off, while coding kept improving steadily. Taken together, coding is among the fastest-moving areas and arguably the fastest, with one comparable area, which fits the "mostly true" criteria.

Cite this claim

Dario Amodei, “Amodei said he thinks AI coding is moving the fastest of all the areas of AI.” (said 28 February 2025). Verdict: mostly true. Reliability API, claim c_918831e7507a, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_918831e7507a

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Dario Amodei, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Dario Amodei

  1. Mixed Factual 23 September 2026
    “It’s easy to dismiss this as a one-off or curiosity, but we’ve repeatedly seen a pattern where AI performance in new intellectual domains goes from weak to superhuman in a matter of a few years.”

    AI performance in new intellectual domains has repeatedly gone from weak to superhuman within a few years.

  2. Mixed Factual 10 March 2025
    “we were measuring these trends back when models cost $1,000 or $10,000 to train”

    Amodei's group measured AI scaling trends when models cost $1,000 or $10,000 to train.

  3. Mixed Factual 28 February 2025
    “a lot of the other reasoning models in the market are trained primarily on math and competition coding,”

    Many other companies' reasoning models on the market are trained primarily on math and competition coding.

  4. Mostly true Factual 28 February 2025
    “Because when it knows that it doesn't get any gain out of thinking further, it doesn't think for longer.”

    The model sometimes gives a very short response because, when it knows it gains nothing from thinking further, it does not think for longer; a bound on how long it thinks is still described as valuable.

  5. Resolved true Factual 28 February 2025
    “we train Claude 3.7, you know, more to focus on these real-world tasks.”

    Anthropic trained Claude 3.7 to focus more on real-world tasks, as distinct from competition coding.

All of them

Verdicts are made automatically; how verdicts are made.