Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
83 77 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
69 49 87 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
69 49 87
All types combined: 81 (likely 76 to 86, high confidence), from 87 claims: 77 factual claims, 5 predictions, 5 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Sam Altman's claims
40 claims
“"What we have been saying as clearly as we know how all year is that we expect progress to continue," Altman.”
Sam Altman, OpenAI CEO, in telephone interview 30 November 2023 Altman: OpenAI governance changes could include altering non-profit structure (Axios)
OpenAI has said throughout 2023 that it expects AI progress to continue.
Mostly true True in substance, wrong in a detail.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judged as of 2023-11-30. True: OpenAI or its leaders (Altman, Brockman, Sutskever or official OpenAI posts) said repeatedly and publicly across 2023, and not only in one month, that they expected AI capabilities or progress to keep advancing. Examples would be Altman's congressional testimony, blog posts such as 'Governance of superintelligence', the Superalignment announcement, or interviews. Mostly true: such statements were made in most of 2023 but were sparse in part of the year, or were hedged. Mixed: only a few such statements can be found, or OpenAI's messaging in 2023 was notably contradictory, for example statements that progress would slow. Mostly false: OpenAI's 2023 messaging mostly stressed limits or a slowdown, with only isolated statements expecting continued progress. False: OpenAI said in 2023 that it did not expect progress to continue.
Evidence
- Governance of superintelligence - OpenAI OpenAI · 22 May 2023 Own record
“Given the picture as we see it now, it’s conceivable that within the next ten years, AI systems will exceed expert skill level in most domains, and carry out as much productive activity as one of today’s largest corporations.”
- Introducing Superalignment OpenAI · 5 July 2023 Own record
“we believe it could arrive this decade.”
- Inside OpenAI [Entire Talk] Stanford Technology Ventures Program · 26 April 2023
“AI is going to continue to progress.”
- GPT‑4 - OpenAI OpenAI · 14 March 2023 Own record
“As we continue to focus on reliable scaling, we aim to hone our methodology to help us predict and prepare for future capabilities increasingly far in advance—something we view as critical for safety.”
Reasoning
OpenAI publicly said in several different months of 2023 that it expected AI capabilities to keep advancing. The GPT-4 post (E4, March) speaks of continued "reliable scaling" and preparing for future capabilities. A Stanford talk on OpenAI (E3, April) states that "AI is going to continue to progress." 'Governance of superintelligence' (E1, May) and the Superalignment announcement (E2, July) say AI could exceed expert skill or arrive this decade. This meets the "not only in one month" test, but the evidence covers only March to July, gives nothing for August to November, and E1 and E2 are hedged ("conceivable", "could"), so the verdict is mostly true rather than true.
Cite this claim
Sam Altman, “OpenAI has said throughout 2023 that it expects AI progress to continue.” (said 30 November 2023). Verdict: mostly true. Reliability API, claim c_0cc39d207ce6, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_0cc39d207ce6
Claims without a verdict
Is a verdict here wrong, or do you speak for Sam Altman? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.