ClaimsGary Marcus

“Sora will continue to have trouble with physics.”

Gary Marcus, Substack author 1 January 2025 25 AI Predictions for 2025, from Marcus on AI (Marcus on AI)

Prediction AI capabilities

OpenAI's Sora will continue to have trouble with physics in 2025.

Mostly true True in substance, wrong in a detail.

Prediction: Statements about events outside the person's control, checked once they fell due: did they come true?

The second judge would not resolve this claim; the verdict shown is the first judge's.

What would count as true or false

This prediction is judged over calendar year 2025. It covers any OpenAI video model released under the Sora name (including Sora 2). TRUE: through 2025, credible evidence shows Sora outputs still commonly break physical plausibility. Examples are objects merging or appearing from nowhere, wrong collisions, gravity or fluid errors, and body or limb artifacts. The evidence can be independent reviews, physics-focused benchmarks or evaluations, widely documented examples, or OpenAI's own acknowledgment of physics limits. The problems must persist into the latter part of 2025, including for the newest Sora version available then. MOSTLY TRUE: physics errors are clearly documented in 2025 but are described as markedly less frequent or confined to harder scenes in the latest version. MOSTLY FALSE: physics problems were documented early in 2025, but by late 2025 credible evaluations show the then-current Sora handles physics reliably and errors are rare. FALSE: credible evaluations across 2025 show Sora consistently produces physically accurate video and physics errors are not a notable problem.

Set before the research began.

Evidence (4)

  1. E1 Sora 2 is here OpenAI · 30 September 2025 Own record

    “Interestingly, “mistakes” the model makes frequently appear to be mistakes of the internal agent that Sora 2 is implicitly modeling; though still imperfect, it is better about obeying the laws of physics compared to prior systems.”
  2. E2 Sora and The Big Bright Screen Slop Machine Zvi Mowshowitz (Don't Worry About the Vase, Substack) · 3 October 2025

    “It does still fail in ways that can look embarrassing. For example, here we have it successfully having a ball respond to gravity when the ball is white, then have it all go wrong when the ball is red.”
  3. E3 Sora 2 is mind-blowing... LilysAI (AI-generated note summarising a YouTube video) · 11 November 2025

    “Milk was poured into dark coffee, but the expected plume did not appear.”
  4. E4 PhyWorldBench: A Comprehensive Evaluation of Physical Realism in Text-to-Video Models arXiv (academic paper by external researchers)

    “Well-performed models like Sora, Gen-3, and Pika often introduce exaggerated motion dynamics, such as objects moving with heightened fluidity or unnatural acceleration, making scenes appear choreographed rather than physically grounded.”

Reasoning

At the Sora 2 launch in September 2025, OpenAI said the model was "still imperfect" but "better about obeying the laws of physics compared to prior systems" (E1). An October 2025 review describes a Sora 2 ball that responds correctly to gravity when white but goes wrong when red (E2), and a November 2025 AI-generated summary of a video review reports that the expected plume did not appear when milk was poured into coffee (E3). PhyWorldBench (E4, undated) finds that Sora exaggerates motion dynamics in ways that are not physically grounded. So physics errors in the newest version are documented into late 2025. But the evidence is mostly individual examples rather than proof that errors were common, and OpenAI describes clear improvement, which fits the mostly-true criterion better than the true one.

Cite this claim

Gary Marcus, “OpenAI's Sora will continue to have trouble with physics in 2025.” (said 1 January 2025). Verdict: mostly true. Reliability API, claim c_f78e68dfbc91, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_f78e68dfbc91

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Gary Marcus, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More prediction claims by Gary Marcus

  1. Mostly true Prediction 27 July 2025
    “Some of its advice will be head-scratchingly bad.”

    Some of GPT-5's advice will be very bad.

  2. Mostly true Prediction 27 July 2025
    “GPT-5 will surely be better, a lot better than GPT-4.”

    GPT-5 will be considerably better than GPT-4.

  3. Resolved true Prediction 27 July 2025
    “GPT-5 really is about to drop, no foolin’.”

    OpenAI will release GPT-5 imminently.

  4. Resolved true Prediction 27 July 2025
    “It will still make a significant number of shake-your-head stupid errors, in ways that are hard to fully predict.”

    GPT-5 will still make a significant number of obvious errors that are hard to predict.

  5. Mostly true Prediction 1 January 2025
    “Neurosymbolic AI will become much more prominent.”

    Neurosymbolic AI will become much more prominent in 2025.

All of them

Verdicts are made automatically; how verdicts are made.