Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
83 77 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
69 49 87 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
69 49 87
All types combined: 81 (likely 76 to 86, high confidence), from 87 claims: 77 factual claims, 5 predictions, 5 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Sam Altman's claims
5 claims
| Verdict | Kind | Said | Claim | Topic |
|---|---|---|---|---|
| Mostly true | Promise | 21 Dec 2024 | OpenAI is giving all Plus users unlimited Sora access via the relaxed queue over the 2024 holidays. Promise · 21 Dec 2024 | Their own work or organisation |
| Delivered on time | Promise | 4 Dec 2024 | OpenAI will hold a livestream with a launch or demo each weekday during its '12 days of openai' starting 2024-12-05 at 10am Pacific. Promise · 4 Dec 2024 | Their own work or organisation |
| Delivered on time | Promise | 18 Mar 2024 | OpenAI will release an amazing new model in 2024. Promise · 18 Mar 2024 | Their own work or organisation |
| Mostly true | Promise | 24 Feb 2023 | OpenAI will discuss in more detail, later in 2023, independent audits of AI systems before release. Promise · 24 Feb 2023 | AI safety and alignment |
| Mostly true | Promise | 1 Jan 2017 | Sam Altman will teach YC's online startup course in 2017. Promise · 1 Jan 2017 | Their own work or organisation |
“each weekday, we will have a livestream with a launch or demo, some big ones and some stocking stuffers.”
Sam Altman, OpenAI CEO, on X 4 December 2024 Post by @sama on X, 2024-12-04 (X)
OpenAI will hold a livestream with a launch or demo each weekday during its '12 days of openai' starting 2024-12-05 at 10am Pacific.
Delivered on time The record shows it happened or was so.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
True: OpenAI held a livestream with a launch or demo on each of the 12 weekdays from 5 December 2024 through about 20 December 2024, as shown by OpenAI's YouTube or X archive or by reporting. Mostly true: all 12 weekday sessions took place with a launch or demo, but with a minor variation (e.g. one session was a short video or blog post rather than a livestream, or the start time differed). Mostly false: several weekdays were skipped, or many sessions had no launch or demo. False: the series did not take place or was cut off early.
Evidence
- 12 days of OpenAI: The Ars Technica recap Ars Technica · 12 December 2024
“Over the past 12 business days, OpenAI has announced a new product or demoed an AI feature every weekday, calling the PR event “12 days of OpenAI.””
- Live Updates: 12 Days of OpenAI ChatGPT announcements and reveals TechCrunch · 17 December 2024
“Today marks the last announcement stream from OpenAI’s “12 Days of OpenAI” event.”
- OpenAI 2024 event: How to watch new ChatGPT product reveals and demos | TechCrunch TechCrunch · 20 December 2024
“The ChatGPT series of reveals, called “12 Days of OpenAI,” will be streamed live at 10 a.m. PT each weekday through December 20.”
- Live blog: the 12th day of OpenAI—“Early evals for OpenAI o3” Simon Willison's Weblog · 20 December 2024
“since I built a live blogging system a couple of months ago I’ve decided to roll it out again to provide live commentary during the half hour event, which kicks off at 10am San Francisco time.”
Reasoning
Ars Technica's recap (E1) says that over the 12 business days of "12 days of OpenAI," OpenAI announced a new product or demoed an AI feature every weekday. TechCrunch (E2, E3) describes the series as announcement streams shown live at 10 a.m. PT each weekday through December 20, and E2 reports the last stream taking place. Simon Willison's live blog (E4) covers the 12th-day event at 10am San Francisco time on 2024-12-20. Taken together, these independent sources show the series ran in full, with a launch or demo each weekday, by the deadline.
Cite this claim
Sam Altman, “OpenAI will hold a livestream with a launch or demo each weekday during its '12 days of openai' starting 2024-12-05 at 10am Pacific.” (said 4 December 2024). Verdict: delivered on time. Reliability API, claim c_a102c8a94eb1, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_a102c8a94eb1
Claims without a verdict
Is a verdict here wrong, or do you speak for Sam Altman? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.