Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
80 72 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
70 62 78 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 2 promises resolved, 5 needed for a score.
All types combined: 75 (likely 69 to 80, high confidence), from 79 claims: 35 factual claims, 44 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Scott Alexander's claims
“In our scenario, that starts with cyber warfare, the government sees that these AIs are now as capable as the best human hackers, but can be deployed at humongous scale.”
Scott Alexander, co-author of AI 2027 3 April 2025 AI 2027: month-by-month model of intelligence explosion — Scott Alexander & Daniel Kokotajlo (Dwarkesh Podcast)
In the AI 2027 scenario, the government sees via cyber warfare that AIs are as capable as the best human hackers but deployable at huge scale.
Mostly true True in substance, wrong in a detail.
What would count as true or false
This is a claim about what the AI 2027 scenario says, not about real-world events. True: the scenario text describes the government's recognition of AI's strategic importance starting with, or driven by, cyber capabilities, with AIs matching top human hackers and able to run at huge scale (many copies at once). Mostly true: cyber capability matching top hackers and deployable at scale is shown as a main driver of the government's recognition, but not clearly as the first. Mixed: the scenario mentions AI cyber capabilities, but the government's recognition is driven mainly by other factors, or one of the two elements (human-expert level, mass scale) is missing. Mostly false: cyber capabilities appear only in passing and play no part in the government's recognition. False: the scenario contains no such development.
Evidence
- AI 2027 AI 2027 authors (ai-2027.com) · 3 April 2025 Own record
“Officials are most interested in its cyberwarfare capabilities: Agent-2 is “only” a little worse than the best human hackers, but thousands of copies can be run in parallel, searching for and exploiting weaknesses faster than defenders can respond.”
- AI 2027 Forecast Explained: Exploring the Path from AGI to Superintelligence Zenn (third-party article by taku_sid) · 12 April 2025
“The National Security Council (NSC), the Department of Defense (DOD), and the U.S. AI Safety Institute (AISI) show interest. Particular attention is focused on its cyber warfare capabilities. Agent-2 is only slightly inferior to the best human hackers, but it can run thousands of copies in parallel, searching for and exploiting vulnerabilities faster than a human defender can respond.”
- AI 2027 AI 2027 authors (ai-2027.com) · 3 April 2025 Own record
“The Department of Defense considers this a critical advantage in cyberwarfare, and AI moves from #5 on the administration’s priority list to #2.”
- My Takeaways From AI 2027 Astral Codex Ten (Scott Alexander) · 8 April 2025 Own record
“AI will scare people with hacking before it scares people with bioterrorism or whatever.”
Reasoning
The scenario text says officials are most interested in Agent-2's cyberwarfare capabilities: it is "only a little worse than the best human hackers" and thousands of copies can run in parallel (E1). This leads the Department of Defense to treat it as a critical advantage, and AI moves from #5 to #2 on the administration's priority list (E3). An independent summary confirms this (E2). The scenario shows cyber capability at scale as a main driver of the government's interest [E1][E3], but it puts the AI slightly below the best human hackers rather than equal to them, and does not explicitly call this the first step.
Cite this claim
Scott Alexander, “In the AI 2027 scenario, the government sees via cyber warfare that AIs are as capable as the best human hackers but deployable at huge scale.” (said 3 April 2025). Verdict: mostly true. Reliability API, claim c_d247da1f8cba, method 0.1.0+8bea457b. https://epistacklabs.com/claims/c_d247da1f8cba
Claims without a verdict
Is a verdict here wrong, or do you speak for Scott Alexander? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.