Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
83 78 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 2 predictions resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 0 promises resolved, 5 needed for a score.
All types combined: 83 (likely 78 to 88, high confidence), from 86 claims: 86 factual claims. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Daniela Amodei's claims
44 claims
“we've been supporting NIST, which is the National Institute for Standards and Technology on developing something called an AI Risk Management Framework.”
Daniela Amodei, Anthropic president, interview 4 March 2022 Daniela and Dario Amodei on Anthropic (Future of Life Institute)
Anthropic has been supporting NIST in developing an AI Risk Management Framework.
Unresolvable The public record could not settle it.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judge as of 2022-03-04. True: records show that by that date Anthropic contributed to NIST's AI Risk Management Framework development, for example by submitting comments on the RFI or concept paper or by taking part in workshops. Mostly true: Anthropic's support is documented but began very shortly after the statement, or it was minimal (a single comment) yet real. Mixed: only indirect support is shown, such as through a coalition, and no direct Anthropic contribution. Mostly false: Anthropic's involvement was only planned or nominal, with no contribution made by that date. False: NIST's records of contributors and comments for that period show no Anthropic involvement.
Evidence
- AI Risk Management Framework Concept Paper NIST · 13 December 2021
“NIST intends to publish that initial draft for public comment in early 2022, as well as to hold additional workshops, with the goal of releasing the AI RMF 1.0 in early 2023.”
- Brief Summary NIST · 15 October 2021
“The responses were supportive of NIST’s effort to develop the AI RMF.”
- Comments on the 1st Draft of AI Risk Management Framework NIST · 18 May 2022
“1st Draft AI RMF Comments on the initial draft of the AI Risk Management Framework”
- AI RMF RFI Comments NIST
“Anthropic (https://www.anthropic.com/);”
- NIST Seeks Comments on Concept Paper for AI Risk Management Framework NIST · 14 December 2021
“The paper incorporates input from a NIST Request for Information (RFI) and an October workshop.”
- AI Risk Management Framework - Engage NIST · 13 July 2021
“many organizations and individuals have contributed their insights to NIST, which has considered all suggestions.”
Reasoning
The NIST records provided describe the AI RMF process, including the RFI, the October workshop, the concept paper and broad unnamed contributions (E1, E2, E5, E6). None of them shows Anthropic submitting comments or taking part in workshops by 2022-03-04. E4, a NIST-hosted RFI comment document, lists Anthropic's name, but the excerpt does not show in what capacity, so it does not establish an Anthropic contribution; no evidence shows NIST's contributor records excluding Anthropic either. The evidence therefore does not settle the claim.
Cite this claim
Daniela Amodei, “Anthropic has been supporting NIST in developing an AI Risk Management Framework.” (said 4 March 2022). Verdict: unresolvable. Reliability API, claim c_b9f92afa9e84, method 0.1.0+28da144b. https://epistacklabs.com/claims/c_b9f92afa9e84
Claims without a verdict
Is a verdict here wrong, or do you speak for Daniela Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.