ClaimsPeople

Gary Marcus

Gary Marcus is an author and AI entrepreneur and professor emeritus at NYU; he has written six books, including Rebooting AI and Taming Silicon Valley, founded Geometric Intelligence (bought by Uber), testified at the May 2023 US Senate AI hearing, and writes a newsletter with over 121,000 subscribers.

712 claims collected, 213 researched, 103 resolved. Report of 4 November 2026, method 0.1.0+c876030c.

Scores by kind of claim

Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.

  • Factual claims

    Statements about the present or the past, checked against the record: did they hold up?

    79 72 85

    High confidence, 64 factual claims resolved. From 18 documents, 2019 to 2026; 19 documents sampled from 37 candidates found.

    Not scored: 32 unresolvable, 4 checkable only against their own records.

  • Predictions

    Statements about events outside the person's control, checked once they fell due: did they come true?

    80 72 88

    Medium confidence, 38 predictions resolved. From 7 documents, 2019 to 2025; 19 documents sampled from 37 candidates found.

    Not scored: 60 unresolvable. 13 more fall due later.

    Does not yet allow for how likely each prediction was when made.

  • Promises

    Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?

    Insufficient record: 1 promise resolved, 5 needed for a score.

    Not scored: 1 unresolvable.

All types combined: 79 (likely 74 to 84, high confidence), from 102 claims: 64 factual claims, 38 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.

Gary Marcus's claims

38 claims, sorted by newest said. Choose a claim to read it in full.
VerdictKindSaidClaimTopic
Resolved true Prediction 27 Jul 2025 OpenAI will release GPT-5 imminently. Prediction · 27 Jul 2025 AI capabilities
Resolved true Prediction 27 Jul 2025 GPT-5 will still make a significant number of obvious errors that are hard to predict. Prediction · 27 Jul 2025 AI capabilities
Resolved true Prediction 27 Jul 2025 If the model being discussed has guardrails like ChatGPT's, they will teeter between being too weak (beaten by jailbreaks) and too strong (rejecting some perfectly reasonable requests). Prediction · 27 Jul 2025 AI safety and alignment
Mostly true Prediction 27 Jul 2025 Some of GPT-5's advice will be very bad. Prediction · 27 Jul 2025 AI capabilities
Resolved true Prediction 27 Jul 2025 GPT-5 by itself will not be a general-purpose AGI capable of arbitrary tasks. Prediction · 27 Jul 2025 AI timelines and forecasting
Mostly true Prediction 27 Jul 2025 GPT-5 will be considerably better than GPT-4. Prediction · 27 Jul 2025 AI capabilities
Resolved true Prediction 1 Jan 2025 AI Safety Institutes will offer guidance in 2025 but have little legal authority to stop truly dangerous models. Prediction · 1 Jan 2025 AI policy and governance
Resolved true Prediction 1 Jan 2025 Profits from AI models will remain modest or nonexistent in 2025. Prediction · 1 Jan 2025 Economics and markets
Resolved true Prediction 1 Jan 2025 Lack of reliability will continue to afflict generative AI in 2025. Prediction · 1 Jan 2025 AI capabilities
Resolved true Prediction 1 Jan 2025 Artificial general intelligence will not be achieved in 2025. Prediction · 1 Jan 2025 AI timelines and forecasting
Resolved true Prediction 1 Jan 2025 Hallucinations will continue to afflict generative AI in 2025. Prediction · 1 Jan 2025 AI capabilities
Resolved true Prediction 1 Jan 2025 Less than 10% of the workforce will be replaced by AI in 2025, probably less than 5%. Prediction · 1 Jan 2025 AI, the economy and work
Resolved true Prediction 1 Jan 2025 The US will continue to have very little regulation protecting consumers from generative AI risks in 2025. Prediction · 1 Jan 2025 AI policy and governance
Mostly true Prediction 1 Jan 2025 A large-scale cyberattack in which generative AI plays an important causal role may well occur in 2025. Prediction · 1 Jan 2025 Other global risks
Resolved true Prediction 1 Jan 2025 AI agents will be heavily hyped throughout 2025 but remain far from reliable, except possibly in very narrow use cases. Prediction · 1 Jan 2025 AI capabilities
Resolved true Prediction 1 Jan 2025 AI power consumption will rise in 2025 and remain a major problem, while few generative AI companies will be transparent about their usage. Prediction · 1 Jan 2025 AI compute, hardware and data
Mostly true Prediction 1 Jan 2025 Few if any radiologists will be replaced by AI in 2025. Prediction · 1 Jan 2025 AI, the economy and work
Resolved true Prediction 1 Jan 2025 No single AI system will solve more than 4 of the AI 2027 Marcus-Brundage tasks by the end of 2025. Prediction · 1 Jan 2025 AI capabilities
Resolved true Prediction 1 Jan 2025 In 2025 humanoid robotics will see a lot of hype, but nobody will release a robot remotely as capable as Rosie the Robot. Prediction · 1 Jan 2025 AI capabilities
Mostly true Prediction 1 Jan 2025 Neurosymbolic AI will become much more prominent in 2025. Prediction · 1 Jan 2025 AI capabilities
Mostly true Prediction 1 Jan 2025 OpenAI's Sora will continue to have trouble with physics in 2025. Prediction · 1 Jan 2025 AI capabilities
Mostly true Prediction 31 Mar 2024 Marcus doubted that a mindblowing GPT model would be released in 2024. Prediction · 31 Mar 2024 AI timelines and forecasting
Mostly true Prediction 31 Mar 2024 GPT-5 is likely to be even more expensive to train and operate than GPT-4. Prediction · 31 Mar 2024 Economics and markets
Mixed Prediction 26 Oct 2023 With more than 60 elections around the world in 2024, the chance that at least one would be swayed by deepfakes is high. Prediction · 26 Oct 2023 Other global risks
Mostly true Prediction 25 Dec 2022 GPT-4 will still be reckless and hard to control, making a significant number of stupid errors. Prediction · 25 Dec 2022 AI capabilities
Mostly true Prediction 25 Dec 2022 GPT-4's natural language output still won't be reliably usable as input to downstream programs such as databases or virtual assistants. Prediction · 25 Dec 2022 AI capabilities
Resolved true Prediction 25 Dec 2022 GPT-4 will definitely seem smarter than its predecessors, but its internal architecture will remain problematic. Prediction · 25 Dec 2022 AI capabilities
Mostly true Prediction 25 Dec 2022 GPT-4 will not be trustworthy and complete enough to give reliable medical advice. Prediction · 25 Dec 2022 AI capabilities
Mostly true Prediction 25 Dec 2022 GPT-4 will be a very large, powerful system (a 'monster'). Prediction · 25 Dec 2022 AI capabilities
Mostly true Prediction 25 Dec 2022 With GPT-4, fluent hallucinations will still be common and easily induced, escalating the risk of LLMs being used to create misinformation. Prediction · 25 Dec 2022 AI capabilities
Mostly true Prediction 25 Dec 2022 GPT-4 may be better at faking term papers, but if it follows the same playbook as its predecessors, it still won't really understand the world, and its flaws will eventually show. Prediction · 25 Dec 2022 AI capabilities
Mostly true Prediction 25 Dec 2022 GPT-4 will blow people's minds when released. Prediction · 25 Dec 2022 AI capabilities
Mostly true Prediction 25 Dec 2022 Marcus suspected that GPT-4's release would follow a pattern of immense buzz, then scientific scrutiny, then recognition that many problems remain. Prediction · 25 Dec 2022 AI capabilities
Mostly true Prediction 25 Dec 2022 If GPT-4 is architecturally essentially the same as GPT-3, it can be expected to be unable to construct internal models of how the world works and, in consequence, unable to understand things at an abstract level. Prediction · 25 Dec 2022 AI capabilities
Mostly true Prediction 25 Dec 2022 AI alignment between human wants and machine behavior will remain a critical unsolved problem, with GPT-4 unable to reliably follow shared human values. Prediction · 25 Dec 2022 AI safety and alignment
Mostly true Prediction 25 Dec 2022 GPT-4 will remain a pastiche generator and useful for brainstorming and first drafts, but not trustworthy general intelligence. Prediction · 25 Dec 2022 AI capabilities
Resolved false Prediction 14 Dec 2021 Gary Marcus bet that hybrid (neurosymbolic) AI models would pull ahead in 2022. Prediction · 14 Dec 2021 AI timelines and forecasting
Resolved true Prediction 20 Sep 2019 Marcus said he did not think machines would reach world-class scientific reasoning within the next five years (by 2024). Prediction · 20 Sep 2019 AI timelines and forecasting
Back to the list

Gary Marcus

Open its page

Prediction AI capabilities

“GPT-4 will still, like its predecessors, be a bull in a china shop, reckless and hard to control.”

Gary Marcus, author 25 December 2022 What to Expect When You're Expecting … GPT-4 (Marcus on AI)

GPT-4 will still be reckless and hard to control, making a significant number of stupid errors.

Mostly true True in substance, wrong in a detail.

The second judge said resolved true; the verdict shown is the first judge's.

What would count as true or false

A prediction about GPT-4 once released (March 2023); judge it at roughly one year after release (2024-03). The claim is that GPT-4, like its predecessors, would be reckless and hard to control and would make a significant number of stupid errors. True: evaluations and documented use show GPT-4 still frequently produced confident errors and hallucinations, was jailbroken or behaved unpredictably despite controls, and committed clear basic blunders. OpenAI's own GPT-4 technical report or system card acknowledging such limitations counts. Mostly true: errors and controllability problems persist and are well documented, but are clearly reduced compared with predecessors, so 'still like its predecessors' is somewhat overstated. Mixed: errors persist but controllability is reported as largely improved, or the reverse. Mostly false: there are only occasional errors and GPT-4 is broadly reported as reliable and controllable. False: GPT-4 is shown to make few basic errors and to be reliably controllable.

Evidence

  1. GPT-4 System Card - cdn.openai.com OpenAI · 13 May 2025
    “As noted above in 2.2, despite GPT-4’s capabilities, it maintains a tendency to make up facts, to double-down on incorrect information, and to perform tasks incorrectly.”
  2. GPT-4 System Card - cdn.openai.com OpenAI · 13 May 2025
    “OpenAI has implemented various safety measures and processes throughout the GPT-4 development and deployment process that have reduced its ability to generate harmful content. However, GPT-4 can still be vulnerable to adversarial attacks and exploits or, “jailbreaks,” and harmful content is not the source of risk.”
  3. Hallucination Rates and Reference Accuracy of ChatGPT and Bard for Systematic Reviews: Comparative Analysis Journal of Medical Internet Research · 22 May 2024
    “The hallucination rates were, respectively, 39.6% (55/139), 28.6% (34/119), and 91.4% (95/104) for GPT-3.5, GPT-4, and Bard (*P*<.001).”
  4. GPT-4’s successes, and GPT-4’s failures Gary Marcus (Substack) · 15 March 2023 Own record
    “And when GPT-4 is integrated in Bing (which incorporates current search results), hallucination remains rampant, e.g., in this example from last week when Bing apparently was already quietly using GPT-4 in the background.”

Reasoning

OpenAI's GPT-4 System Card says GPT-4 keeps a tendency to make up facts, double down on incorrect information and perform tasks incorrectly (E1). It also says GPT-4 can still be jailbroken (E2), which the criteria count toward the claim. However, the same card says safety measures reduced GPT-4's ability to generate harmful content (E2). A JMIR study found a 28.6% hallucination rate for GPT-4, still high but lower than GPT-3.5's 39.6% (E3). So the errors and control problems persisted and are well documented, though one study measured a lower hallucination rate for GPT-4 than for GPT-3.5 [E3] and OpenAI reports reduced ability to generate harmful content [E2], which makes 'still, like its predecessors' somewhat overstated.

Cite this claim

Gary Marcus, “GPT-4 will still be reckless and hard to control, making a significant number of stupid errors.” (said 25 December 2022). Verdict: mostly true. Reliability API, claim c_151a009cf527, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_151a009cf527

Claims without a verdict

Is a verdict here wrong, or do you speak for Gary Marcus? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.