Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 69 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
56 42 70 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 4 promises resolved, 5 needed for a score.
All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Dario Amodei's claims
49 claims
“Anthropic is unilaterally committing to the first of these steps.”
Dario Amodei, Anthropic CEO, on X 12 September 2026 Post by @DarioAmodei on X, 2026-09-12 (X)
Anthropic commits unilaterally to the first step of the plan: giving third-party evaluators permanent, employee-level access to its systems.
Mostly true True in substance, wrong in a detail.
The second judge would not resolve this claim; the verdict shown is the first judge's.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
This is a promise that Anthropic will give third-party evaluators permanent, employee-level access to its systems. It is judged on delivery, not on the announcement. TRUE: independent evidence shows that at least one external evaluator organisation has standing, ongoing access to Anthropic's systems comparable to an employee's, with no fixed end date. Acceptable evidence includes an agreement, a statement from the evaluator itself, or an independent report. MOSTLY TRUE: such access is in place, but a minor detail differs (for example the evaluators are embedded under NDA terms that differ slightly from employees'). MOSTLY FALSE: access is only time-limited, project-based, or clearly narrower than employee-level (for example API or pre-deployment testing windows only). Also mostly false if it is in place only as a pilot. FALSE: dated reports show that the step was abandoned or delayed, or that no evaluator has such access. This could come from an evaluator saying it has no such access, or from Anthropic withdrawing the commitment. Anthropic's own statement that it delivered is not enough on its own.
Evidence
- Anthropic update on independent evaluators Anthropic · 15 October 2026 Own record
“We’ve onboarded six METR employees with company hardware, office space, and access to internal tools and systems that are roughly on par with what our own risk assessment teams have access to.”
- Anthropic gives outside AI watchdog “employee-like” access Ars Technica · 18 October 2026
“METR, a nonprofit that has worked with leading labs including OpenAI, Anthropic, Google, and Meta, now has a team embedded in the Claude maker’s office with access to its hardware and internal systems.”
- Anthropic says it gave METR access, can't veto reports SecondSource · 16 October 2026
“but access and renewal stay with the evaluated company.”
- Updates METR
“A METR staff member spent three weeks red-teaming a subset of Anthropic's internal agent monitoring and security systems, discovering several novel vulnerabilities.”
Reasoning
Anthropic's update (E1) says six METR staff were onboarded with company hardware, office space, and access to internal tools and systems roughly on par with its own risk-assessment teams. An independent source, Ars Technica (E2), reports that a METR team is embedded in Anthropic's office with access to its hardware and internal systems, which supports standing access comparable to an employee's. However, no source shows the access is permanent or has no end date: SecondSource (E3) says access and renewal stay with the evaluated company. METR's blog (E4) describes a three-week red-teaming engagement on a subset of Anthropic's systems; the item is undated and does not address standing access. Access appears to be in place, but its duration is not independently established, so the verdict is mostly true rather than true.
Cite this claim
Dario Amodei, “Anthropic commits unilaterally to the first step of the plan: giving third-party evaluators permanent, employee-level access to its systems.” (said 12 September 2026). Verdict: mostly true. Reliability API, claim c_18eb9d30b8ec, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_18eb9d30b8ec
Claims without a verdict
- Unresolvable 157
- Not yet due 40
- Own records only 43
- Not researched 134
- Not checkable 864
Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.