ClaimsGary Marcus

“GPT-5 by itself won’t be a general purpose artificial general intelligence capable of taking on arbitrary tasks.”

Gary Marcus, author 27 July 2025 What to Expect When You're Expecting … GPT-5 (Marcus on AI) archived copy

Prediction AI timelines and forecasting

GPT-5 by itself will not be a general-purpose AGI capable of arbitrary tasks.

Resolved true The record shows it happened or was so.

Prediction: Statements about events outside the person's control, checked once they fell due: did they come true?

What would count as true or false

The claim is that GPT-5 on its own would not be a general-purpose AGI able to take on arbitrary tasks. True: after GPT-5's release, OpenAI does not credibly claim it is AGI, and the expert consensus and benchmarks or evaluations show GPT-5 alone cannot reliably do arbitrary tasks. Evidence would include clear failures on broad agentic or novel tasks, ARC-AGI style tests, or long-horizon real-world tasks. Mostly true: the same, but a noticeable minority of credible experts argue it meets some definition of AGI. Mixed: credible expert opinion is genuinely split. Mostly false: OpenAI or a broad expert consensus treats GPT-5 alone as AGI, with only narrow exceptions. False: GPT-5 by itself is widely shown and accepted to perform arbitrary tasks at a general human level.

Set before the research began.

Evidence (4)

  1. E1 Details about METR's evaluation of OpenAI GPT-5 METR · 7 August 2025

    “To determine if GPT-5 is capable of executing any of our three main threat models, we used our time-horizon evaluation and determined it has a 50% time-horizon of around 2 hours 17 minutes on agentic software engineering tasks.”
  2. E2 Details about METR's evaluation of OpenAI GPT-5 METR · 7 August 2025

    “Like other models, GPT-5 performed poorly on some of the longest HCAST tasks, and some shorter tasks which load particularly heavily on forward planning.”
  3. E3 OpenAI's GPT-5 is here | TechCrunch TechCrunch · 7 August 2025

    “During a briefing with reporters, OpenAI CEO Sam Altman claimed GPT-5 is “the best model in the world,” and said it represented a “significant step” along the company’s path to developing AI that can outperform humans at most economically valuable work — that is, artificial general intelligence (AGI).”
  4. E4 OpenAI Researcher Mocks Elon Musk's AGI Claim to His Face Futurism · 21 October 2025

    “In the build up to the launch of OpenAI’s newest GPT-5 model this summer — considered a massive disappointment by many — Altman declared it a “significant step along the path to AGI.””

Reasoning

At launch, OpenAI's CEO called GPT-5 a "significant step" toward AGI rather than AGI itself (E3, E4). Neither source reports OpenAI claiming that GPT-5 is AGI. METR's independent evaluation measured a 50% time horizon of about 2 hours 17 minutes on agentic software tasks, and found that GPT-5 did poorly on some of the longest and most planning-heavy tasks (E1, E2). The evidence shows limits on long-horizon and planning-heavy tasks [E1][E2], and none of it reports OpenAI or credible experts treating GPT-5 alone as AGI.

Cite this claim

Gary Marcus, “GPT-5 by itself will not be a general-purpose AGI capable of arbitrary tasks.” (said 27 July 2025). Verdict: resolved true. Reliability API, claim c_a05902e075bc, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_a05902e075bc

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Gary Marcus, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More prediction claims by Gary Marcus

  1. Resolved true Prediction 1 January 2025
    “We will not see artificial general intelligence this year, despite claims by Elon Musk to the contrary.”

    Artificial general intelligence will not be achieved in 2025.

  2. Mostly true Prediction 31 March 2024
    “But will we see a mindblowing GPT this year? I doubt it.”

    Marcus doubted that a mindblowing GPT model would be released in 2024.

  3. Resolved false Prediction 14 December 2021
    “my bet: hybrid models will pull ahead next year.”

    Gary Marcus bet that hybrid (neurosymbolic) AI models would pull ahead in 2022.

  4. Resolved true Prediction 20 September 2019
    “I don’t think it’s going to happen in the next five years.”

    Marcus said he did not think machines would reach world-class scientific reasoning within the next five years (by 2024).

  5. Mostly true Prediction 27 July 2025
    “Some of its advice will be head-scratchingly bad.”

    Some of GPT-5's advice will be very bad.

All of them

Verdicts are made automatically; how verdicts are made.