ClaimsGary Marcus

“There could continue to be no “GPT-5 level” model (meaning a huge, across the board quantum leap forward as judged by community consensus) throughout 2025.”

Gary Marcus, Substack author 1 January 2025 25 AI Predictions for 2025, from Marcus on AI (Marcus on AI)

Prediction AI timelines and forecasting

No 'GPT-5 level' model, a huge across-the-board leap by community consensus, may appear throughout 2025.

Unresolvable The public record could not settle it.

Prediction: Statements about events outside the person's control, checked once they fell due: did they come true?

The second judge would not resolve this claim; the verdict shown is the first judge's.

What would count as true or false

Judge at the end of 2025, against the claim's own definition. A 'GPT-5 level' model means a huge, across-the-board quantum leap forward over prior frontier models, as judged by community consensus. This is comparable to the jump from GPT-3 to GPT-4, not an incremental improvement or progress on a few benchmarks only. A model's name, including one called 'GPT-5', does not settle the question; only the consensus judgement of the leap does. The claim is strongly hedged ('could'), so resolve it on whether the possibility it raises came about. TRUE: no model released in 2025 is regarded by broad community consensus (researchers, independent evaluators, major commentators) as a huge across-the-board leap. MOSTLY TRUE: no consensus leap occurred, but at least one 2025 model is argued by a notable minority to have been one. MIXED: the community is roughly evenly divided on whether a 2025 model was such a leap. MOSTLY FALSE: a majority, though not a clear consensus, views a 2025 model as such a leap. FALSE: there is clear community consensus that a model released in 2025 was a huge across-the-board quantum leap.

Set before the research began.

Evidence (4)

  1. E1 GPT-5 Benchmarks and Analysis Artificial Analysis · 7 August 2025

    “While High sets a new standard, the increase over o3 is not comparable to the jump from GPT-3 to GPT-4 or GPT-4o to o1.”
  2. E2 GPT-5's modest gains suggest AI progress is slowing down New Scientist · 13 August 2025

    “It has improved on GPT-4, but the difference for many benchmarks is smaller than the leap from GPT-3 to GPT-4.”
  3. E3 GPT-5 failed the hype test The Verge · 15 August 2025

    “The general consensus is that although GPT-5 wasn’t as significant of an advancement as people expected, it offered upgrades in cost and speed, plus fewer hallucinations”
  4. E4 Gemini 3 just got *scary* good readray.ai (LilysAI video note) · 26 November 2025

    “This analysis confirms that Gemini 3 is a massive, non-incremental leap forward, crushing competitors across critical benchmarks like Vending Bench 2 and Humanity's Last Exam.”

Reasoning

The evidence shows independent sources did not regard GPT-5 as a GPT-3-to-GPT-4-scale leap (E1, E2, E3), but the only item on Gemini 3 is a single auto-generated video note arguing it was such a leap (E4). The evidence does not show how the wider community judged Gemini 3, so it cannot settle whether any 2025 model was seen by consensus, or by a notable minority, as a huge across-the-board leap.

Cite this claim

Gary Marcus, “No 'GPT-5 level' model, a huge across-the-board leap by community consensus, may appear throughout 2025.” (said 1 January 2025). Verdict: unresolvable. Reliability API, claim c_34b5aafeb059, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_34b5aafeb059

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Gary Marcus, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More prediction claims by Gary Marcus

  1. Resolved true Prediction 27 July 2025
    “GPT-5 by itself won’t be a general purpose artificial general intelligence capable of taking on arbitrary tasks.”

    GPT-5 by itself will not be a general-purpose AGI capable of arbitrary tasks.

  2. Resolved true Prediction 1 January 2025
    “We will not see artificial general intelligence this year, despite claims by Elon Musk to the contrary.”

    Artificial general intelligence will not be achieved in 2025.

  3. Mostly true Prediction 31 March 2024
    “But will we see a mindblowing GPT this year? I doubt it.”

    Marcus doubted that a mindblowing GPT model would be released in 2024.

  4. Resolved false Prediction 14 December 2021
    “my bet: hybrid models will pull ahead next year.”

    Gary Marcus bet that hybrid (neurosymbolic) AI models would pull ahead in 2022.

  5. Resolved true Prediction 20 September 2019
    “I don’t think it’s going to happen in the next five years.”

    Marcus said he did not think machines would reach world-class scientific reasoning within the next five years (by 2024).

All of them

Verdicts are made automatically; how verdicts are made.