ClaimsGary Marcus

“Overall, by my count, sixteen of my seventeen “high confidence” predictions about 2025 proved to be correct.”

Gary Marcus, author January 2026 Six (or seven) predictions for AI 2026 from a Generative AI realist (Marcus on AI)

Factual Their own work or organisation

By Gary Marcus's own count, sixteen of his seventeen high-confidence predictions about 2025 proved correct.

Unresolvable The public record could not settle it.

Factual: Statements about the present or the past, checked against the record: did they hold up?

What would count as true or false

Judge as of January 2026. Identify the 17 'high confidence' predictions about 2025 that Marcus published (likely in his Substack around the end of 2024), and check each against what actually happened in 2025, without relying on his own scoring alone. True: an independent assessment finds 16 of 17 (or 17) correct. Mostly true: 14–15 are correct, or 16 are only with lenient readings of some vague predictions. Mixed: about 9–13 are correct. Mostly false: about 5–8 are correct. False: fewer than 5 are correct, or there was no such list of 17 high-confidence predictions.

Set before the research began.

Evidence (10)

  1. E1 2025 in AI predictions — LessWrong LessWrong (post by jessicata) · 2 January 2026

    “Gary Marcus*: “No single system will solve more than 4 of the AI 2027 Marcus-Brundage tasks by the end of 2025. I wouldn’t be shocked if none were reliably solved by the end of the year.” Evaluation: Correct. AI can perhaps pass the reading comprehension task. But not any 4 of the tasks.”
  2. E2 AI Policy News aipolicy.onair.cc (AI Policy News aggregator) · 20 December 2025 Own record

    “AGI didn’t materialize (contra predictions from Elon Musk and others); GPT-5 was underwhelming, and didn’t solve hallucinations.”
  3. E3 25 AI Predictions for 2025, from Marcus on AI Marcus on AI (Gary Marcus Substack) · 1 January 2025 Own record

    “here my own predictions for where we will be at the end of this year:”
  4. E4 GPT-5 will blow minds — Gary Marcus Prediction Scorecard · 27 July 2025

    “GPT-5 (7 August 2025) was much better than the original GPT-4 on benchmarks such as SWE-bench (74.9% vs GPT-4o's 30.8%), but its launch was widely received as underwhelming, with a user backlash that made OpenAI restore GPT-4o; Marcus himself called it "underwhelming" in December 2025.”
  5. E5 2025 in AI predictions — LessWrong LessWrong · 2 January 2026

    “Evaluation: Correct. AI can perhaps pass the reading comprehension task. But not any 4 of the tasks.”
  6. E6 AI Policy News aipolicy.onair.cc (aggregator page reproducing a Marcus on AI post dated 2025-12-20) · 20 December 2025 Own record

    “No system solved more than 4 (or maybe any) of the Marcus-Brundage tasks. Despite all the hype, agents didn’t turn out to be reliable.”
  7. E7 No AGI by 2025 — Gary Marcus Prediction Scorecard · 1 January 2025

    “1 January 2025 · Annual predictions post on his Substack, Marcus on AI ("High confidence" list)”
  8. E8 No AGI by 2025 — Gary Marcus Prediction Scorecard · 1 January 2025

    “No system recognized as AGI appeared in 2025; by late 2025 even leading figures such as Ilya Sutskever said scaling had stalled and new research was needed, putting human-level learning years away.”
  9. E9 The People Building AI Are the Worst at Predicting It Whizi · 22 August 2026

    “Gary Marcus, January 2025 | 25 dated predictions, four graded here | All four correct, and none of the year's successes on the list | A-”
  10. E10 Gary Marcus's AI Predictions: 19 tracked | Forecast Fools Forecast Fools · 28 July 2025

    “Forecast Fools tracks 19 rankable AI predictions from Gary Marcus, covering AGI, Markets, Regulation, Safety. 14 have resolved so far: 13 correct, 0 wrong, and 1 partial.”

Reasoning

E3 confirms that Marcus published a list of predictions for 2025 on 1 January 2025, and E8 refers to a "High confidence" list in that post, but none of the evidence lists all seventeen high-confidence items. Independent sources check only a few of them. LessWrong (E1/E5) found the Marcus-Brundage tasks prediction correct, Prediction Scorecard (E9) found the no-AGI prediction accurate, and Whizi (E10) graded four of the 25 predictions and found all four correct. Without an independent check of most of the seventeen, the evidence cannot show whether sixteen of them proved correct.

Cite this claim

Gary Marcus, “By Gary Marcus's own count, sixteen of his seventeen high-confidence predictions about 2025 proved correct.” (said January 2026). Verdict: unresolvable. Reliability API, claim c_9c3e2abb3b96, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_9c3e2abb3b96

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Gary Marcus, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Gary Marcus

  1. Resolved true Factual 9 November 2024
    “For years I have been warning that “scaling” — eeking out improvements in AI by adding more data and more compute, without making fundamental architectural changes — would not continue forever.”

    Gary Marcus has for years warned that AI scaling by adding data and compute without architectural changes would not continue forever.

  2. Mostly true Factual 31 March 2024
    “In early August, I wrote a piece called What if Generative AI turned out to be a Dud, picked up in the Financial Times and elsewhere.”

    In early August 2023 Gary Marcus wrote a piece titled 'What if Generative AI turned out to be a Dud', which was picked up by the Financial Times and other outlets.

  3. Resolved true Factual February 2024
    “Immediately after the February announcement of Sora, I noted Sora’s troubles with physics and predicted that they wouldn’t go away. They haven’t.”

    After Sora's February 2024 announcement, Marcus predicted its physics troubles would persist, and they have.

  4. Mostly true Factual 26 October 2023
    “So it was heartening to see many of the ideas that I have been pushing for a long time, including a CERN for AI and Global AI governance (which I emphasized in April in my TED talk and in The…”

    Gary Marcus emphasized a CERN for AI and global AI governance in April 2023 in his TED talk and in The Economist.

  5. Resolved true Factual 30 March 2023
    “It actually called for *more* research.”

    The FLI open letter called for more AI research.

All of them

Verdicts are made automatically; how verdicts are made.