Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 69 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
56 42 70 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 4 promises resolved, 5 needed for a score.
All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Dario Amodei's claims
28 claims
“The RSP basically develops what we've called an if-then structure, which is if the models pass a certain capability, then we impose a certain set of safety and security requirements on them.”
Dario Amodei, Anthropic CEO 11 November 2024 Transcript for Dario Amodei: Anthropic CEO on Claude, AGI & the Future of AI & Humanity (Lex Fridman Podcast)
Anthropic's Responsible Scaling Policy uses an if-then structure: if models pass a certain capability, Anthropic imposes a set of safety and security requirements.
Resolved true The record shows it happened or was so.
The evidence is the person's or their organisation's own records.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judge as of 2024-11-11. True: Anthropic's Responsible Scaling Policy as published by then sets capability thresholds that, once reached or approached, trigger specified safety and security requirements (AI Safety Levels / required safeguards). Mostly true: this structure is present, with a minor difference in detail, for example thresholds triggered by evaluations indicating the capability might be reached rather than definitively passed. Mixed: the policy only partly has this structure. Mostly false: the policy refers to capabilities and safeguards, but they are not linked conditionally. False: the RSP has no such structure.
Evidence
- Our updated Responsible Scaling Policy Anthropic · 15 October 2024 Own record
“Capability Thresholds: Specific AI abilities that, if reached, would require stronger safeguards than our current baseline.”
- Our updated Responsible Scaling Policy Anthropic · 15 October 2024 Own record
“Required Safeguards: The specific ASL Standards needed to mitigate risks once a Capability Threshold has been reached.”
- Our updated Responsible Scaling Policy Anthropic · 15 October 2024 Own record
“Chemical, Biological, Radiological, and Nuclear (CBRN) weapons: If a model can meaningfully assist someone with a basic technical background in creating or deploying CBRN weapons, we require enhanced security and deployment safeguards (ASL-3 standards).”
- Our updated Responsible Scaling Policy Anthropic · 15 October 2024 Own record
“Autonomous AI Research and Development: If a model can independently conduct complex AI research tasks typically requiring human expertise—potentially significantly accelerating AI development in an unpredictable way—we require elevated security standards (potentially ASL-4 or higher standards) and additional safety assurances”
Reasoning
Anthropic's official announcement of its updated Responsible Scaling Policy, dated 2024-10-15 (before the claim date), defines Capability Thresholds as specific abilities that, if reached, require stronger safeguards (E1). It defines Required Safeguards as the ASL Standards needed once a threshold has been reached (E2). The announcement also gives concrete conditional rules for CBRN weapons, which require ASL-3 safeguards (E3), and for autonomous AI research and development, which require elevated security standards (E4). Together these show the if-then structure the claim describes. This rests only on Anthropic's own published policy announcement, which here counts as the official record of the policy itself.
Cite this claim
Dario Amodei, “Anthropic's Responsible Scaling Policy uses an if-then structure: if models pass a certain capability, Anthropic imposes a set of safety and security requirements.” (said 11 November 2024). Verdict: resolved true. Reliability API, claim c_0036bea19755, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_0036bea19755
Claims without a verdict
- Unresolvable 157
- Not yet due 40
- Own records only 43
- Not researched 134
- Not checkable 864
Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.