OpenAI's Sora will continue to have trouble with physics in 2025.
Mostly true True in substance, wrong in a detail.
Prediction: Statements about events outside the person's control, checked once they fell due: did they come true?
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
This prediction is judged over calendar year 2025. It covers any OpenAI video model released under the Sora name (including Sora 2). TRUE: through 2025, credible evidence shows Sora outputs still commonly break physical plausibility. Examples are objects merging or appearing from nowhere, wrong collisions, gravity or fluid errors, and body or limb artifacts. The evidence can be independent reviews, physics-focused benchmarks or evaluations, widely documented examples, or OpenAI's own acknowledgment of physics limits. The problems must persist into the latter part of 2025, including for the newest Sora version available then. MOSTLY TRUE: physics errors are clearly documented in 2025 but are described as markedly less frequent or confined to harder scenes in the latest version. MOSTLY FALSE: physics problems were documented early in 2025, but by late 2025 credible evaluations show the then-current Sora handles physics reliably and errors are rare. FALSE: credible evaluations across 2025 show Sora consistently produces physically accurate video and physics errors are not a notable problem.
Set before the research began.
Evidence (4)
-
E1 Sora 2 is here OpenAI · 30 September 2025 Own record
“Interestingly, “mistakes” the model makes frequently appear to be mistakes of the internal agent that Sora 2 is implicitly modeling; though still imperfect, it is better about obeying the laws of physics compared to prior systems.”
-
E2 Sora and The Big Bright Screen Slop Machine Zvi Mowshowitz (Don't Worry About the Vase, Substack) · 3 October 2025
“It does still fail in ways that can look embarrassing. For example, here we have it successfully having a ball respond to gravity when the ball is white, then have it all go wrong when the ball is red.”
-
E3 Sora 2 is mind-blowing... LilysAI (AI-generated note summarising a YouTube video) · 11 November 2025
“Milk was poured into dark coffee, but the expected plume did not appear.”
-
E4 PhyWorldBench: A Comprehensive Evaluation of Physical Realism in Text-to-Video Models arXiv (academic paper by external researchers)
“Well-performed models like Sora, Gen-3, and Pika often introduce exaggerated motion dynamics, such as objects moving with heightened fluidity or unnatural acceleration, making scenes appear choreographed rather than physically grounded.”
Reasoning
At the Sora 2 launch in September 2025, OpenAI said the model was "still imperfect" but "better about obeying the laws of physics compared to prior systems" (E1). An October 2025 review describes a Sora 2 ball that responds correctly to gravity when white but goes wrong when red (E2), and a November 2025 AI-generated summary of a video review reports that the expected plume did not appear when milk was poured into coffee (E3). PhyWorldBench (E4, undated) finds that Sora exaggerates motion dynamics in ways that are not physically grounded. So physics errors in the newest version are documented into late 2025. But the evidence is mostly individual examples rather than proof that errors were common, and OpenAI describes clear improvement, which fits the mostly-true criterion better than the true one.
Cite this claim
Gary Marcus, “OpenAI's Sora will continue to have trouble with physics in 2025.” (said 1 January 2025). Verdict: mostly true. Reliability API, claim c_f78e68dfbc91, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_f78e68dfbc91
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More prediction claims by Gary Marcus
-
Mostly true
“Some of its advice will be head-scratchingly bad.”
-
Mostly true
“GPT-5 will surely be better, a lot better than GPT-4.”
-
Resolved true
“GPT-5 really is about to drop, no foolin’.”
-
Resolved true
“It will still make a significant number of shake-your-head stupid errors, in ways that are hard to fully predict.”
GPT-5 will still make a significant number of obvious errors that are hard to predict.
-
Mostly true
“Neurosymbolic AI will become much more prominent.”
Verdicts are made automatically; how verdicts are made.