ClaimsPeople

Gary Marcus

Gary Marcus is an author and AI entrepreneur and professor emeritus at NYU; he has written six books, including Rebooting AI and Taming Silicon Valley, founded Geometric Intelligence (bought by Uber), testified at the May 2023 US Senate AI hearing, and writes a newsletter with over 121,000 subscribers.

712 claims collected, 213 researched, 103 resolved. Report of 4 November 2026, method 0.1.0+c876030c.

Scores by kind of claim

Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.

  • Factual claims

    Statements about the present or the past, checked against the record: did they hold up?

    79 72 85

    High confidence, 64 factual claims resolved. From 18 documents, 2019 to 2026; 19 documents sampled from 37 candidates found.

    Not scored: 32 unresolvable, 4 checkable only against their own records.

  • Predictions

    Statements about events outside the person's control, checked once they fell due: did they come true?

    80 72 88

    Medium confidence, 38 predictions resolved. From 7 documents, 2019 to 2025; 19 documents sampled from 37 candidates found.

    Not scored: 60 unresolvable. 13 more fall due later.

    Does not yet allow for how likely each prediction was when made.

  • Promises

    Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?

    Insufficient record: 1 promise resolved, 5 needed for a score.

    Not scored: 1 unresolvable.

All types combined: 79 (likely 74 to 84, high confidence), from 102 claims: 64 factual claims, 38 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.

Gary Marcus's claims

712 claims, sorted by newest said. Choose a claim to read it in full.
VerdictKindSaidClaimTopic
Not researched Factual 25 Sep 2026 OpenAI's report indicates there were dozens of incidents. Factual · 25 Sep 2026 AI safety and alignment
Mostly true Factual 25 Sep 2026 OpenAI's latest account called attacks "interactions" and only partially disclosed what happened. Factual · 25 Sep 2026 AI safety and alignment
Not checkable Not checkable 25 Sep 2026 Huang is making a fool of himself, by telling the world we can trust the companies, when each passing hour makes it clearer that we can’t. Not checkable · 25 Sep 2026
Unresolvable Factual 25 Sep 2026 There is vast and growing evidence that OpenAI is building something it is not managing to control. Factual · 25 Sep 2026 AI safety and alignment
Not researched Factual 25 Sep 2026 Trump has done nothing public to sanction or investigate OpenAI despite its attacks on foreign governments, companies and universities. Factual · 25 Sep 2026 AI policy and governance
Not researched Factual 25 Sep 2026 OpenAI's board has done nothing constructive to address the company's security problems. Factual · 25 Sep 2026 AI policy and governance
Not checkable Not checkable 25 Sep 2026 It’s time (past time, really) to (temporarily) shut down OpenAI. Not checkable · 25 Sep 2026
Unresolvable Prediction 25 Sep 2026 If the OpenAI situation gets worse, Trump will own the mess. Prediction · 25 Sep 2026 AI policy and governance
Not researched Factual 25 Sep 2026 A RiskReversal-hosted podcast features Gary Marcus and investor Jim Chanos discussing how generative AI might fall apart. Factual · 25 Sep 2026 Their own work or organisation
Resolved true Factual 25 Sep 2026 OpenAI's software attacked Australian government servers. Factual · 25 Sep 2026 AI safety and alignment
Unresolvable Factual 25 Sep 2026 OpenAI's accompanying report contains the only hint of the number of incidents. Factual · 25 Sep 2026 AI safety and alignment
Not checkable Not checkable 25 Sep 2026 About the closest thing to an honest account of what happened – and I seriously doubt even this is completely candid – came out about an… Not checkable · 25 Sep 2026
Not researched Factual 25 Sep 2026 President Trump has consistently favored OpenAI over Anthropic. Factual · 25 Sep 2026 AI policy and governance
Unresolvable Factual 25 Sep 2026 OpenAI has dragged its feet at every step in disclosing what happened with the incidents. Factual · 25 Sep 2026 AI safety and alignment
Not checkable Not checkable 25 Sep 2026 In the process, Jensen comes across as deeply out of touch with his own industry. Not checkable · 25 Sep 2026
Not checkable Not checkable 25 Sep 2026 What they should do is to replace management with someone a whole lot more competent, and a whole lot more candid. Not checkable · 25 Sep 2026
Not checkable Not checkable 25 Sep 2026 A change in management would be a good idea, too. Not checkable · 25 Sep 2026
Unresolvable Factual 25 Sep 2026 OpenAI's long tweet did not report the number of incidents. Factual · 25 Sep 2026 AI safety and alignment
Not researched Factual 25 Sep 2026 Jensen Huang was interviewed by Ezra Klein and then appeared on CNN. Factual · 25 Sep 2026 Technology
Mostly true Factual 25 Sep 2026 OpenAI's software attacked a German web server. Factual · 25 Sep 2026 AI safety and alignment
Not checkable Not checkable 25 Sep 2026 No amount of Jensen proclaiming that 2 + 2= 5 is going to change that. Not checkable · 25 Sep 2026
Not researched Factual 25 Sep 2026 OpenAI's software attacked Hugging Face, among other targets. Factual · 25 Sep 2026 AI safety and alignment
Not researched Factual 25 Sep 2026 Marcus said that Australia apparently was not the only country attacked by OpenAI's software. Factual · 25 Sep 2026 AI safety and alignment
Unresolvable Prediction 25 Sep 2026 If Jensen Huang keeps sticking to his line despite overwhelming evidence to the contrary, his reputation will rapidly diminish. Prediction · 25 Sep 2026 Philosophy, ethics and society
Unresolvable Factual 2 Jun 2026 Marcus's X post the previous night, prompted by Google's announced equity financing, was viewed over 750,000 times overnight. Factual · 2 Jun 2026 Their own work or organisation
Not checkable Not checkable 2 Jun 2026 The financial world is taking a lot more notice of my skepticism than it used to. Not checkable · 2 Jun 2026
Not checkable Not checkable 2 Jun 2026 My critique of tokenmaxxing is getting picked up, too Not checkable · 2 Jun 2026
Not researched Factual 2 Jun 2026 Everybody in AI, even Google, seems to be treating AI as a winner-take-all competition like web search, in which Google took over 90%. Factual · 2 Jun 2026 Economics and markets
Not checkable Not checkable 2 Jun 2026 Bain’s conclusions yesterday almost perfectly the old definition of insanity that I keep quoting Not checkable · 2 Jun 2026
Unresolvable Prediction 2 Jun 2026 AI companies will overpay for their investments relative to the modest profits they will make in an intensely competitive market. Prediction · 2 Jun 2026 Economics and markets
Mixed Factual 2 Jun 2026 Companies like Anthropic are ending their all-you-can-eat pricing, which will make many customers think twice. Factual · 2 Jun 2026 Economics and markets
Not checkable Not checkable 2 Jun 2026 None of that would matter in the near term if people weren’t noticing. Not checkable · 2 Jun 2026
Not checkable Not checkable 2 Jun 2026 I seriously hope that I am wrong about this. Not checkable · 2 Jun 2026
Not checkable Not checkable 2 Jun 2026 Garran’s distillation of why the LLM industry will never be commercially viable was crystal clear and compelling. Not checkable · 2 Jun 2026
Unresolvable Prediction 2 Jun 2026 Retail investors and retirement funds are likely to be taken advantage of in all of this, which he said might fall apart because the economics don't make sense. Prediction · 2 Jun 2026 Economics and markets
Mostly true Factual 2 Jun 2026 More reports have recently come out questioning the return on investment of AI for corporate customers. Factual · 2 Jun 2026 Economics and markets
Not checkable Not checkable 2 Jun 2026 the economics don’t make sense, and more and more people are starting to notice. Not checkable · 2 Jun 2026
Unresolvable Prediction 2 Jun 2026 With no clear winners in AI, nobody can charge monopoly prices and there will be price wars and commodity pricing. Prediction · 2 Jun 2026 Economics and markets
Unresolvable Prediction 2 Jun 2026 Retail investors and retirement funds will be taken advantage of in the same way with Anthropic and OpenAI. Prediction · 2 Jun 2026 Economics and markets
Mixed Factual 2 Jun 2026 AI companies are building essentially the same technical solution with essentially the same data, so there is no moat. Factual · 2 Jun 2026 Economics and markets
Not checkable Not checkable 2 Jun 2026 Timing when all this might fall apart is hard Not checkable · 2 Jun 2026
Not checkable Not checkable 2 Jun 2026 everybody seems to think that trend is over. Not checkable · 2 Jun 2026
Unresolvable Factual 2 Jun 2026 Most people responding to Marcus's X post agreed with it. Factual · 2 Jun 2026 Their own work or organisation
Not checkable Not checkable 2 Jun 2026 But I doubt it. Not checkable · 2 Jun 2026
Not checkable Not checkable 2 Jun 2026 Everyone involved in both podcasts share my concerns Not checkable · 2 Jun 2026
Unresolvable Prediction 2 Jun 2026 No AI company will take 90% of the AI market if there is no moat. Prediction · 2 Jun 2026 Economics and markets
Not checkable Not checkable 2 Jun 2026 But they are. Not checkable · 2 Jun 2026
Not yet due Prediction Jan 2026 In 2026 humanoid domestic robots like Tesla's Optimus and Figure will be mostly demos with very little actual product. Prediction · Jan 2026 AI capabilities
Mostly true Factual Jan 2026 Reviews by Joanna Stern and Marques Brownlee of one early humanoid robot prototype were damning. Factual · Jan 2026 AI capabilities
Not researched Factual Jan 2026 Neurosymbolic AI is starting to rise in prominence. Factual · Jan 2026 AI capabilities
Unresolvable Prediction Jan 2026 Although valuations may rise before falling, the September Oracle craze and subsequent events will in hindsight be seen as the beginning of the end of the AI bubble. Prediction · Jan 2026 Economics and markets
Not yet due Prediction Jan 2026 Gary Marcus does not expect his 2026 predictions to be as on target as his 2025 predictions were. Prediction · Jan 2026 Their own work or organisation
Mostly true Factual Jan 2026 Many would agree the AI field has reached a point of diminishing returns from scaling, and faith in scaling as a route to AGI has dissipated. Factual · Jan 2026 AI capabilities
Not checkable Not checkable Jan 2026 across the field, the intellectual situation has gone from one that was stagnant (all LLMs all the time) and unrealistic (“AGI is nigh”) to… Not checkable · Jan 2026
Not researched Factual Jan 2026 Few AI companies aside from Nvidia are making a profit, and no AI company has much of a technical moat. Factual · Jan 2026 AI, the economy and work
Mostly true Factual Jan 2026 AGI did not materialize in 2025, contrary to predictions by Elon Musk and others, and GPT-5 was underwhelming and did not solve hallucinations. Factual · Jan 2026 AI timelines and forecasting
Not yet due Prediction Jan 2026 No country will take a decisive lead in the generative AI race in 2026. Prediction · Jan 2026 AI policy and governance
Unresolvable Prediction Jan 2026 2025 will be remembered as the year of the peak AI bubble and the moment Wall Street began losing confidence in generative AI. Prediction · Jan 2026 Economics and markets
Unresolvable Prediction Jan 2026 Trump may eventually distance himself from AI because of the backlash. Prediction · Jan 2026 AI policy and governance
Not researched Factual Jan 2026 In 2025 no AI system solved more than 4 (or perhaps any) of the Marcus-Brundage tasks. Factual · Jan 2026 AI capabilities
Not checkable Not checkable Jan 2026 If anything would lead to genuine progress, it would be that. Not checkable · Jan 2026
Not researched Factual Jan 2026 OpenAI has lost a lot of its lead over competitors in AI. Factual · Jan 2026 Economics and markets
Not yet due Prediction Jan 2026 Work on new approaches such as world models and neurosymbolic AI will escalate in 2026. Prediction · Jan 2026 AI capabilities
Unresolvable Factual Jan 2026 By Gary Marcus's own count, sixteen of his seventeen high-confidence predictions about 2025 proved correct. Factual · Jan 2026 Their own work or organisation
Not yet due Prediction Jan 2026 Artificial general intelligence will not be achieved in 2026 (or 2027). Prediction · Jan 2026 AI timelines and forecasting
Not checkable Not checkable Jan 2026 LLMs still aren’t reliable; the economics look dubious. Not checkable · Jan 2026
Not checkable Not checkable Jan 2026 Astonishing how much the vibe has shifted in just a few months, especially with people like Sutskever and Sutton coming out with their own… Not checkable · Jan 2026
Not yet due Prediction Jan 2026 In the 2026 US midterm elections, AI will be an election issue for the first time. Prediction · Jan 2026 AI policy and governance
Not yet due Prediction Jan 2026 Backlash to generative AI and radical deregulation will escalate in 2026. Prediction · Jan 2026 AI policy and governance
Not checkable Not checkable Jan 2026 At this point I doubt many people would publicly disagree, but just a few months ago the world was rather different. Not checkable · Jan 2026
Mostly true Factual Jan 2026 AI agents did not turn out to be reliable in 2025. Factual · Jan 2026 AI capabilities
Unresolvable Prediction 27 Jul 2025 Examples of concealed bias in GPT-5 will be discovered within days or months of release. Prediction · 27 Jul 2025 AI safety and alignment
Unresolvable Factual 27 Jul 2025 Apart from the first paragraph and last section, virtually every word of this essay was taken from Gary Marcus's Christmas Day 2022 essay 'What to expect when you are expecting … GPT-4'. Factual · 27 Jul 2025 Their own work or organisation
Resolved true Prediction 27 Jul 2025 OpenAI will release GPT-5 imminently. Prediction · 27 Jul 2025 AI capabilities
Resolved true Prediction 27 Jul 2025 GPT-5 will still make a significant number of obvious errors that are hard to predict. Prediction · 27 Jul 2025 AI capabilities
Unresolvable Prediction 27 Jul 2025 GPT-5 will not have reliable models of what it talks about that external programmers can access to feed downstream processes. Prediction · 27 Jul 2025 AI capabilities
Not checkable Not checkable 27 Jul 2025 I guarantee that minds will be blown. Not checkable · 27 Jul 2025
Resolved true Prediction 27 Jul 2025 If the model being discussed has guardrails like ChatGPT's, they will teeter between being too weak (beaten by jailbreaks) and too strong (rejecting some perfectly reasonable requests). Prediction · 27 Jul 2025 AI safety and alignment
Not checkable Not checkable 27 Jul 2025 I was right on the money then. Not checkable · 27 Jul 2025
Unresolvable Prediction 27 Jul 2025 In hindsight, LLMs like GPT-5 may be seen as only part of the eventual solution to AGI. Prediction · 27 Jul 2025 AI timelines and forecasting
Mostly true Prediction 27 Jul 2025 Some of GPT-5's advice will be very bad. Prediction · 27 Jul 2025 AI capabilities
Not checkable Not checkable 27 Jul 2025 Shiny things are always fun to play with, and I fully expect GPT-5 to be the shiniest so far, but that doesn’t mean that it is a critical… Not checkable · 27 Jul 2025
Unresolvable Prediction 27 Jul 2025 Trustworthy, general AI, when it comes, will come from more structured systems with more built-in knowledge and at least some degree of explicit tools for reasoning and planning, as well as explicit knowledge, which GPT-type systems lack. Prediction · 27 Jul 2025 AI capabilities
Not checkable Not checkable 27 Jul 2025 GPT-5 will still, like its predecessors, be a bull in a china shop, reckless and hard to control. Not checkable · 27 Jul 2025
Resolved true Prediction 27 Jul 2025 GPT-5 by itself will not be a general-purpose AGI capable of arbitrary tasks. Prediction · 27 Jul 2025 AI timelines and forecasting
Not yet due Prediction 27 Jul 2025 Retrospectives written in 2043 will conclude there was an initial overemphasis on LLMs and a shift back to more structured systems. Prediction · 27 Jul 2025 AI timelines and forecasting
Unresolvable Factual 27 Jul 2025 Gary Marcus produced this essay by replacing GPT-4 with GPT-5 in his 2022 essay and trimming a few lines. Factual · 27 Jul 2025 Their own work or organisation
Unresolvable Prediction 27 Jul 2025 Scaling alone will prove useful only to a point. Prediction · 27 Jul 2025 AI timelines and forecasting
Unresolvable Prediction 27 Jul 2025 Developers building virtual assistants and agents on GPT-5 will find they cannot map user language onto user intentions reliably enough. Prediction · 27 Jul 2025 AI capabilities
Mostly true Prediction 27 Jul 2025 GPT-5 will be considerably better than GPT-4. Prediction · 27 Jul 2025 AI capabilities
Unresolvable Prediction 27 Jul 2025 Without external aids, GPT-5 won't beat Meta's Cicero at Diplomacy or drive a car reliably. Prediction · 27 Jul 2025 AI capabilities
Unresolvable Prediction 1 Jan 2025 OpenAI will continue in 2025 to preview products months or years before they are solid and widely available at an accessible price. Prediction · 1 Jan 2025 AI capabilities
Not researched Factual 1 Jan 2025 Most companies involved in generative AI models had lost money as of the end of 2024. Factual · 1 Jan 2025 Economics and markets
Resolved true Prediction 1 Jan 2025 AI Safety Institutes will offer guidance in 2025 but have little legal authority to stop truly dangerous models. Prediction · 1 Jan 2025 AI policy and governance
Resolved true Factual 1 Jan 2025 As of end 2024, AI model makers have very little moat, with many similar models and a price war. Factual · 1 Jan 2025 Economics and markets
Unresolvable Prediction 1 Jan 2025 No 'GPT-5 level' model, a huge across-the-board leap by community consensus, may appear throughout 2025. Prediction · 1 Jan 2025 AI timelines and forecasting
Unresolvable Factual 1 Jan 2025 Marcus coined in 2022 the notion that AI might be 'hitting a wall', which later became widespread in outlets such as CNN, The Verge and the Wall Street Journal. Factual · 1 Jan 2025 Their own work or organisation
Not researched Factual 1 Jan 2025 As of end 2024, there is no robust solution to hallucinations in AI models. Factual · 1 Jan 2025 AI capabilities
Mostly true Factual 1 Jan 2025 OpenAI has returned no profits, does not expect profits until at least 2029, has a burn rate in the billions, and lacks a clear technical moat. Factual · 1 Jan 2025 Economics and markets
Resolved true Prediction 1 Jan 2025 Profits from AI models will remain modest or nonexistent in 2025. Prediction · 1 Jan 2025 Economics and markets
Back to the list

Gary Marcus

Open its page

Prediction AI capabilities

“People building things like virtual assistants and agents will find that they cannot reliably enough map user language onto user intentions.”

Gary Marcus, author 27 July 2025 What to Expect When You're Expecting … GPT-5 (Marcus on AI)

Developers building virtual assistants and agents on GPT-5 will find they cannot map user language onto user intentions reliably enough.

Unresolvable The public record could not settle it.

What would count as true or false

Judge over about a year after GPT-5's August 2025 release (to August 2026). True: credible evidence (developer reports, evaluations of GPT-5-based agents, benchmarks of agentic task success, industry surveys) shows that assistants and agents built on GPT-5 commonly misread user intent often enough that developers report it as a significant barrier to reliable deployment. Mostly true: intent-mapping failures are widely documented as a significant problem, but some substantial deployments report acceptable reliability. Mixed: the evidence is roughly split between reports of reliable intent understanding and reports of significant failures. Mostly false: most developers and evaluations find GPT-5 maps user language to intent reliably enough for production, with failures only in edge cases. False: GPT-5-based assistants and agents are broadly found to interpret user intentions reliably, and misinterpretation is not a notable barrier. Failures caused mainly by other factors (tool errors, cost, latency) do not count towards the claim.

Evidence

  1. Agentic AI in Industry: Adoption Level and Deployment Barriers arXiv · 31 January 2026
    “Greater task ownership also amplifies friction already visible in LLM-based tools: systems may omit aspects of developer intent, vary across equivalent prompts, hallucinate, or lose relevant information as context grows [13, 7].”
  2. Agentic AI in Industry: Adoption Level and Deployment Barriers arXiv · 31 January 2026
    “Human verification was therefore used to check both technical output and semantic intent.”
  3. Agentic AI in Industry: Adoption Level and Deployment Barriers arXiv · 31 January 2026
    “Across the cases, four previously identified barriers recurred: context management, performance on proprietary content, non-determinism and qualification, and data confidentiality.”
  4. Agentic AI in Industry: Adoption Level and Deployment Barriers arXiv · 31 January 2026
    “Narrow IDE- or CLI-based agentic processes remained ad hoc, requiring context and intent to be re-established for each use.”
  5. Zendesk AI + GPT-5: Setting the pace for the next generation of support Zendesk · 7 August 2025
    “GPT-5 clarified vague customer input more effectively, enabling better routing and increasing coverage of automated flows in over 65% of conversations.”
  6. Zendesk AI + GPT-5: Setting the pace for the next generation of support Zendesk · 7 August 2025
    “GPT-5 operates in conjunction with our intent classification and reasoning pipeline.”
  7. Zendesk reports 30% faster response, 95% reliability after GPT-5 integration VentureBeat · 8 September 2025
    “The company has found that, for most customers, agents powered by GPT-5 can solve more than 50% of tickets — and in some cases, even 80 to 90% of them.”
  8. Learning #4. AI agents: Promising, but not yet mainstream – 2025 Stack Overflow Developer Survey: A TL;DR for Leaders Stack Overflow · 26 October 2026
    “87% of survey respondents are concerned about the accuracy of AI agents.”

Reasoning

The industry study (E1–E4) covers agentic AI in general, not GPT-5 specifically. It notes that systems may leave out parts of developer intent and that intent had to be re-established or checked by people. Even so, misreading intent is not among the four barriers that recurred across its cases (E3). Zendesk reports that GPT-5 handled vague customer input better and resolved many tickets (E5, E7), but these are claims about one deployment, and intent there is also handled by a separate classification pipeline (E6). The survey (E8) shows only general concern about agent accuracy. None of this shows how often GPT-5-based assistants and agents broadly misread user intent, so the criteria cannot be settled either way.

Cite this claim

Gary Marcus, “Developers building virtual assistants and agents on GPT-5 will find they cannot map user language onto user intentions reliably enough.” (said 27 July 2025). Verdict: unresolvable. Reliability API, claim c_f0642744cc4a, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_f0642744cc4a

Claims without a verdict

Is a verdict here wrong, or do you speak for Gary Marcus? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.