ClaimsGary Marcus

“Immediately after the February announcement of Sora, I noted Sora’s troubles with physics and predicted that they wouldn’t go away. They haven’t.”

Gary Marcus, Substack author February 2024 25 AI Predictions for 2025, from Marcus on AI (Marcus on AI)

Factual Their own work or organisation

After Sora's February 2024 announcement, Marcus predicted its physics troubles would persist, and they have.

Resolved true The record shows it happened or was so.

Factual: Statements about the present or the past, checked against the record: did they hold up?

What would count as true or false

Two parts, judged as of the date Marcus published this statement (after February 2024, likely later in 2024). (a) Immediately after OpenAI announced Sora (15 February 2024), Marcus noted its physics problems and predicted they would persist. (b) Those physics problems had not gone away by the time of the statement. True: dated Marcus posts from within days of the announcement contain both the observation and the prediction, and evidence up to the statement date (released Sora outputs, reviews, analyses) shows Sora still producing physically implausible results. Mostly true: both parts hold, but a minor detail differs, for example the prediction came some days or weeks later, or the problems had lessened noticeably while remaining evident. Mixed: one part holds and the other does not, for example he noted the problems but made no prediction. Mostly false: he made the prediction, but the physics problems had largely been resolved by the time of the statement. False: he made no such observation or prediction around the announcement, and the problems were resolved.

Set before the research began.

Evidence (4)

  1. E1 Sora’s Surreal Physics Gary Marcus (Substack) · 16 February 2024 Own record

    “And importantly, I predict that many will be hard to remedy.”
  2. E2 Sora is here OpenAI · 9 December 2024

    “It often generates unrealistic physics and struggles with complex actions over long durations.”
  3. E3 Sora still appears to have trouble with physics Gary Marcus (Substack) · 10 December 2024 Own record

    “Looks like these problems linger in a new release of Sora that came out today”
  4. E4 No, Sora has not “learned physics” Gary Marcus (Substack) · 2 March 2024 Own record

    “It is precisely because Sora is not a physics engine that a large fraction of Sora's videos are inconsistent with physics or biology, in very basic ways.”

Reasoning

Marcus's own post dated 16 February 2024, the day after the Sora announcement, is a dated record of what he wrote then. In it he noted physical glitches and predicted that many would be "hard to remedy" (E1), and he repeated the point on 2 March 2024 (E4). OpenAI is independent of Marcus, and its December 2024 release announcement says Sora "often generates unrealistic physics" (E2). That shows the problems were still there in 2024, which matches Marcus's December 2024 observation (E3).

Cite this claim

Gary Marcus, “After Sora's February 2024 announcement, Marcus predicted its physics troubles would persist, and they have.” (said February 2024). Verdict: resolved true. Reliability API, claim c_c25cce7c54bc, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_c25cce7c54bc

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Gary Marcus, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Gary Marcus

  1. Resolved true Factual 9 November 2024
    “For years I have been warning that “scaling” — eeking out improvements in AI by adding more data and more compute, without making fundamental architectural changes — would not continue forever.”

    Gary Marcus has for years warned that AI scaling by adding data and compute without architectural changes would not continue forever.

  2. Mostly true Factual 31 March 2024
    “In early August, I wrote a piece called What if Generative AI turned out to be a Dud, picked up in the Financial Times and elsewhere.”

    In early August 2023 Gary Marcus wrote a piece titled 'What if Generative AI turned out to be a Dud', which was picked up by the Financial Times and other outlets.

  3. Mostly true Factual 26 October 2023
    “So it was heartening to see many of the ideas that I have been pushing for a long time, including a CERN for AI and Global AI governance (which I emphasized in April in my TED talk and in The…”

    Gary Marcus emphasized a CERN for AI and global AI governance in April 2023 in his TED talk and in The Economist.

  4. Resolved true Factual 30 March 2023
    “It actually called for *more* research.”

    The FLI open letter called for more AI research.

  5. Resolved true Factual 30 March 2023
    “The letter didn't call for a ban on AI. It didn't call for a permanent ban.”

    The FLI open letter did not call for a ban on AI or for a permanent ban.

All of them

Verdicts are made automatically; how verdicts are made.