Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 69 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
56 42 70 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 4 promises resolved, 5 needed for a score.
All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Dario Amodei's claims
“I would guess a year from now, the models can do this very, very reliably.”
Dario Amodei, Anthropic CEO 11 November 2024 Transcript for Dario Amodei: Anthropic CEO on Claude, AGI & the Future of AI & Humanity (Lex Fridman Podcast)
Amodei guessed that by about November 2025, AI models would be able to perform computer-use tasks very, very reliably.
Mostly true True in substance, wrong in a detail.
What would count as true or false
The claim is that by about November 2025 AI models will perform computer-use tasks (operating a GUI computer to complete tasks) 'very, very reliably', compared with a state of the art of about 15–22% on OSWorld in late 2024. Reliability is measured mainly by the best reported OSWorld (or OSWorld-Verified) score, with human-level performance (about 72%) as the benchmark for 'very reliable'. True: by 30 Nov 2025 the best reported score is 70% or higher, or comparable evidence shows near-human reliability on everyday computer tasks. Mostly true: 65% to under 70%. Mostly false: 40% to under 65% (large progress, but not very reliable). False: below 40%, or dated reports from late 2025 describing computer-use agents as still unreliable for routine tasks.
Evidence
- Introducing Claude Sonnet 4.5 Anthropic · 29 September 2025 Own record
“On OSWorld, a benchmark that tests AI models on real-world computer tasks, Sonnet 4.5 now leads at 61.4%. Just four months ago, Sonnet 4 held the lead at 42.2%.”
- Introducing OSWorld-Verified XLANG Lab (HKU), OSWorld benchmark maintainers · 28 July 2025
“With human performance estimated at ~72% from our original study, the best current systems have now reached 84.4% of human capability (CoACT-1 at 60.76%).”
- osworld.md Steel (leaderboard.steel.dev) · 16 October 2026
“| 13 | Claude Opus 4.5 | 66.3% | Anthropic | OSWorld-Verified self-reported result; reported on anthropic.com. | https://www.anthropic.com/news/claude-opus-4-5 | — |”
- OSWorld | AI Wiki AI Wiki (aiwiki.ai) · 7 May 2026
“Within five months that number had been overtaken by frontier production systems, with Claude Opus 4.5 reaching 66.3% and Claude Opus 4.6 crossing the 72% human baseline in February 2026.”
- Introducing OSWorld-Verified XLANG Lab (xlang.ai) · 28 July 2025
“With human performance estimated at ~72% from our original study, the best current systems have now reached 84.4% of human capability (CoACT-1 at 60.76%).”
- OSWorld | AI Wiki AI Wiki (aiwiki.ai) · 7 May 2026
“| November 2025 | Claude Opus 4.5 | Anthropic | 66.3% | n/a | First model above 60% on main leaderboard |”
- OSWorld | AI Wiki AI Wiki (aiwiki.ai) · 7 May 2026
“Third, the trajectory crossed the 72.36% human baseline in February 2026 when Claude Opus 4.6 reached 72.7%.”
- OSWorld | AI Wiki AI Wiki (aiwiki.ai) · 7 May 2026
“The September 2025 jump to 61.4% in Claude Sonnet 4.5 was widely characterized in the developer press as the first "production-grade" computer-use Claude.”
- Claude Opus 4.6: Features, Benchmarks, and Pricing Guide Digital Applied · 5 February 2026
“| OSWorld | 72.7% | 66.3% | — | — |”
- Introducing Claude Opus 4.5 Anthropic · 24 November 2025 Own record
“Each of these updates takes advantage of Claude Opus 4.5’s market-leading performance in using computers, spreadsheets, and handling long-running tasks.”
- Anthropic releases Opus 4.5 with new Chrome and Excel integrations | TechCrunch TechCrunch · 24 November 2025
“Anthropic also emphasized Opus’ computer use and spreadsheet capabilities, and launched a number of parallel products to showcase how the model holds up in those settings.”
Reasoning
An independent wiki timeline lists Claude Opus 4.5 at 66.3% on OSWorld in November 2025 (E6, E4), and Anthropic's launch post for that model is dated 2025-11-24 (E10). A third-party leaderboard also lists this 66.3% OSWorld-Verified result, though it marks it as self-reported by Anthropic (E3). The same sources say the ~72% human baseline was first crossed in February 2026, after the deadline (E4, E7). The best score reported by 30 Nov 2025 was therefore in the 65% to under-70% band, which the criteria define as mostly true.
Cite this claim
Dario Amodei, “Amodei guessed that by about November 2025, AI models would be able to perform computer-use tasks very, very reliably.” (said 11 November 2024). Verdict: mostly true. Reliability API, claim c_4ce12261556e, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_4ce12261556e
Claims without a verdict
- Unresolvable 157
- Not yet due 40
- Own records only 43
- Not researched 134
- Not checkable 864
Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.