Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
83 77 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
69 49 87 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
69 49 87
All types combined: 81 (likely 76 to 86, high confidence), from 87 claims: 77 factual claims, 5 predictions, 5 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Sam Altman's claims
5 claims
| Verdict | Kind | Said | Claim | Topic |
|---|---|---|---|---|
| Mostly true | Promise | 21 Dec 2024 | OpenAI is giving all Plus users unlimited Sora access via the relaxed queue over the 2024 holidays. Promise · 21 Dec 2024 | Their own work or organisation |
| Delivered on time | Promise | 4 Dec 2024 | OpenAI will hold a livestream with a launch or demo each weekday during its '12 days of openai' starting 2024-12-05 at 10am Pacific. Promise · 4 Dec 2024 | Their own work or organisation |
| Delivered on time | Promise | 18 Mar 2024 | OpenAI will release an amazing new model in 2024. Promise · 18 Mar 2024 | Their own work or organisation |
| Mostly true | Promise | 24 Feb 2023 | OpenAI will discuss in more detail, later in 2023, independent audits of AI systems before release. Promise · 24 Feb 2023 | AI safety and alignment |
| Mostly true | Promise | 1 Jan 2017 | Sam Altman will teach YC's online startup course in 2017. Promise · 1 Jan 2017 | Their own work or organisation |
“We will release an amazing new model this year. I don't know what we'll call it.”
Sam Altman, CEO of OpenAI, interview answer 18 March 2024 Transcript for Sam Altman: OpenAI, GPT-5, Sora, Board Saga, Elon Musk, Ilya, Power & AGI (Lex Fridman)
OpenAI will release an amazing new model in 2024.
Delivered on time The record shows it happened or was so.
The evidence is the person's or their organisation's own records.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
True: OpenAI publicly released (generally available to users or via API, not just a preview to select testers) at least one new major model in calendar 2024 (e.g. GPT-4o in May 2024, o1 in September/December 2024), as shown by OpenAI release announcements. 'Amazing' is subjective and is not tested beyond the model being a significant new flagship-level release. Mostly true: the only 2024 releases were previews or limited releases of a major new model. Mostly false: only minor updates or variants of existing models were released in 2024. False: no new model was released in 2024.
Evidence
- Introducing GPT-4o and more tools to ChatGPT free users - OpenAI OpenAI · 13 May 2024
“We are beginning to roll out GPT‑4o to ChatGPT Plus and Team users, with availability for Enterprise users coming soon.”
- Introducing GPT-4o and more tools to ChatGPT free users - OpenAI OpenAI · 13 May 2024
“We are also starting to roll out to ChatGPT Free with usage limits today.”
- Introducing ChatGPT Pro - OpenAI OpenAI · 5 December 2024
“This plan includes unlimited access to our smartest model, OpenAI o1, as well as to o1‑mini, GPT‑4o, and Advanced Voice.”
Reasoning
OpenAI's release announcement dated 2024-05-13 says GPT-4o was beginning to roll out to ChatGPT Plus and Team users and to ChatGPT Free users with usage limits (E1, E2). That is a general public release of a major new model, not a limited preview. A 2024-12-05 announcement also describes access to OpenAI o1, which it calls 'our smartest model', in the ChatGPT Pro plan (E3). Both releases happened in calendar 2024, so the criteria for true are met before the deadline. These are OpenAI's own official announcements, the source type the criteria name.
Cite this claim
Sam Altman, “OpenAI will release an amazing new model in 2024.” (said 18 March 2024). Verdict: delivered on time. Reliability API, claim c_747b05512d73, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_747b05512d73
Claims without a verdict
Is a verdict here wrong, or do you speak for Sam Altman? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.