Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
83 77 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
69 49 87 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
69 49 87
All types combined: 81 (likely 76 to 86, high confidence), from 87 claims: 77 factual claims, 5 predictions, 5 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Sam Altman's claims
40 claims
“we significantly underestimated demand for sora; it is going to take awhile to get everyone access.”
Sam Altman, OpenAI CEO, on X 10 December 2024 Post by @sama on X, 2024-12-10 (X)
OpenAI significantly underestimated demand for Sora at its December 2024 launch.
Mostly true True in substance, wrong in a detail.
The second judge would not resolve this claim; the verdict shown is the first judge's.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
True: dated evidence from the December 2024 Sora launch shows demand well above what OpenAI planned for, e.g. sign-ups were paused or new account creation was disabled, capacity limits were hit, or long waits occurred because of unexpected load. Mostly true: demand clearly exceeded capacity but the shortfall looks moderate rather than 'significant', or access limits were partly planned. Mixed: access limits were at least as much a planned staged rollout as a response to unexpected demand. Mostly false: restrictions came mainly from planned limits (e.g. regional exclusions, a deliberately capped rollout) with little sign of unexpected demand. False: evidence shows access worked without demand-driven restrictions, or OpenAI's capacity matched demand.
Evidence
- OpenAI disables new Sora sign-ups due to high demand TechCrunch · 9 December 2024
“demand higher than expected; signups will be disabled on and off and generations will be slow for awhile.”
- OpenAI disables new Sora sign-ups due to high demand TechCrunch · 9 December 2024
“OpenAI CEO Sam Altman posted on X that due to higher than expected demand, they are pausing new sign-ups for its video generator Sora and that video generations will be slower for the time being.”
Reasoning
TechCrunch reported on 2024-12-09 that OpenAI paused new Sora sign-ups and that video generations would be slower because demand was higher than expected (E1, E2). That meets the resolution criteria's example for demand well above plan. However, TechCrunch's account comes from Altman's own post on X, and the evidence does not independently show how large the shortfall was. The sign-up pause is reported by an independent outlet, but the "significant" part of the claim rests on Altman's own description, so the verdict is mostly true rather than true.
Cite this claim
Sam Altman, “OpenAI significantly underestimated demand for Sora at its December 2024 launch.” (said 10 December 2024). Verdict: mostly true. Reliability API, claim c_c7fd57e77147, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_c7fd57e77147
Claims without a verdict
Is a verdict here wrong, or do you speak for Sam Altman? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.