Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
83 77 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
69 49 87 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
69 49 87
All types combined: 81 (likely 76 to 86, high confidence), from 87 claims: 77 factual claims, 5 predictions, 5 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Sam Altman's claims
41 claims
“We will release an amazing new model this year. I don't know what we'll call it.”
Sam Altman, CEO of OpenAI, interview answer 18 March 2024 Transcript for Sam Altman: OpenAI, GPT-5, Sora, Board Saga, Elon Musk, Ilya, Power & AGI (Lex Fridman)
OpenAI will release an amazing new model in 2024.
Delivered on time The record shows it happened or was so.
The evidence is the person's or their organisation's own records.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
True: OpenAI publicly released (generally available to users or via API, not just a preview to select testers) at least one new major model in calendar 2024 (e.g. GPT-4o in May 2024, o1 in September/December 2024), as shown by OpenAI release announcements. 'Amazing' is subjective and is not tested beyond the model being a significant new flagship-level release. Mostly true: the only 2024 releases were previews or limited releases of a major new model. Mostly false: only minor updates or variants of existing models were released in 2024. False: no new model was released in 2024.
Evidence
- Introducing GPT-4o and more tools to ChatGPT free users - OpenAI OpenAI · 13 May 2024
“We are beginning to roll out GPT‑4o to ChatGPT Plus and Team users, with availability for Enterprise users coming soon.”
- Introducing GPT-4o and more tools to ChatGPT free users - OpenAI OpenAI · 13 May 2024
“We are also starting to roll out to ChatGPT Free with usage limits today.”
- Introducing ChatGPT Pro - OpenAI OpenAI · 5 December 2024
“This plan includes unlimited access to our smartest model, OpenAI o1, as well as to o1‑mini, GPT‑4o, and Advanced Voice.”
Reasoning
OpenAI's release announcement dated 2024-05-13 says GPT-4o was beginning to roll out to ChatGPT Plus and Team users and to ChatGPT Free users with usage limits (E1, E2). That is a general public release of a major new model, not a limited preview. A 2024-12-05 announcement also describes access to OpenAI o1, which it calls 'our smartest model', in the ChatGPT Pro plan (E3). Both releases happened in calendar 2024, so the criteria for true are met before the deadline. These are OpenAI's own official announcements, the source type the criteria name.
Cite this claim
Sam Altman, “OpenAI will release an amazing new model in 2024.” (said 18 March 2024). Verdict: delivered on time. Reliability API, claim c_747b05512d73, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_747b05512d73
Claims without a verdict
Is a verdict here wrong, or do you speak for Sam Altman? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.