ClaimsPeople

Gary Marcus

Gary Marcus is an author and AI entrepreneur and professor emeritus at NYU; he has written six books, including Rebooting AI and Taming Silicon Valley, founded Geometric Intelligence (bought by Uber), testified at the May 2023 US Senate AI hearing, and writes a newsletter with over 121,000 subscribers.

712 claims collected, 213 researched, 103 resolved. Report of 4 November 2026, method 0.1.0+c876030c.

Scores by kind of claim

Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.

  • Factual claims

    Statements about the present or the past, checked against the record: did they hold up?

    79 72 85

    High confidence, 64 factual claims resolved. From 18 documents, 2019 to 2026; 19 documents sampled from 37 candidates found.

    Not scored: 32 unresolvable, 4 checkable only against their own records.

  • Predictions

    Statements about events outside the person's control, checked once they fell due: did they come true?

    80 72 88

    Medium confidence, 38 predictions resolved. From 7 documents, 2019 to 2025; 19 documents sampled from 37 candidates found.

    Not scored: 60 unresolvable. 13 more fall due later.

    Does not yet allow for how likely each prediction was when made.

  • Promises

    Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?

    Insufficient record: 1 promise resolved, 5 needed for a score.

    Not scored: 1 unresolvable.

All types combined: 79 (likely 74 to 84, high confidence), from 102 claims: 64 factual claims, 38 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.

Gary Marcus's claims

93 claims

93 claims, sorted by newest said. Choose a claim to read it in full.
VerdictKindSaidClaimTopic
Unresolvable Factual 25 Sep 2026 There is vast and growing evidence that OpenAI is building something it is not managing to control. Factual · 25 Sep 2026 AI safety and alignment
Unresolvable Prediction 25 Sep 2026 If the OpenAI situation gets worse, Trump will own the mess. Prediction · 25 Sep 2026 AI policy and governance
Unresolvable Factual 25 Sep 2026 OpenAI's accompanying report contains the only hint of the number of incidents. Factual · 25 Sep 2026 AI safety and alignment
Unresolvable Factual 25 Sep 2026 OpenAI has dragged its feet at every step in disclosing what happened with the incidents. Factual · 25 Sep 2026 AI safety and alignment
Unresolvable Factual 25 Sep 2026 OpenAI's long tweet did not report the number of incidents. Factual · 25 Sep 2026 AI safety and alignment
Unresolvable Prediction 25 Sep 2026 If Jensen Huang keeps sticking to his line despite overwhelming evidence to the contrary, his reputation will rapidly diminish. Prediction · 25 Sep 2026 Philosophy, ethics and society
Unresolvable Factual 2 Jun 2026 Marcus's X post the previous night, prompted by Google's announced equity financing, was viewed over 750,000 times overnight. Factual · 2 Jun 2026 Their own work or organisation
Unresolvable Prediction 2 Jun 2026 AI companies will overpay for their investments relative to the modest profits they will make in an intensely competitive market. Prediction · 2 Jun 2026 Economics and markets
Unresolvable Prediction 2 Jun 2026 Retail investors and retirement funds are likely to be taken advantage of in all of this, which he said might fall apart because the economics don't make sense. Prediction · 2 Jun 2026 Economics and markets
Unresolvable Prediction 2 Jun 2026 With no clear winners in AI, nobody can charge monopoly prices and there will be price wars and commodity pricing. Prediction · 2 Jun 2026 Economics and markets
Unresolvable Prediction 2 Jun 2026 Retail investors and retirement funds will be taken advantage of in the same way with Anthropic and OpenAI. Prediction · 2 Jun 2026 Economics and markets
Unresolvable Factual 2 Jun 2026 Most people responding to Marcus's X post agreed with it. Factual · 2 Jun 2026 Their own work or organisation
Unresolvable Prediction 2 Jun 2026 No AI company will take 90% of the AI market if there is no moat. Prediction · 2 Jun 2026 Economics and markets
Unresolvable Prediction Jan 2026 Although valuations may rise before falling, the September Oracle craze and subsequent events will in hindsight be seen as the beginning of the end of the AI bubble. Prediction · Jan 2026 Economics and markets
Unresolvable Prediction Jan 2026 2025 will be remembered as the year of the peak AI bubble and the moment Wall Street began losing confidence in generative AI. Prediction · Jan 2026 Economics and markets
Unresolvable Prediction Jan 2026 Trump may eventually distance himself from AI because of the backlash. Prediction · Jan 2026 AI policy and governance
Unresolvable Factual Jan 2026 By Gary Marcus's own count, sixteen of his seventeen high-confidence predictions about 2025 proved correct. Factual · Jan 2026 Their own work or organisation
Unresolvable Prediction 27 Jul 2025 Examples of concealed bias in GPT-5 will be discovered within days or months of release. Prediction · 27 Jul 2025 AI safety and alignment
Unresolvable Factual 27 Jul 2025 Apart from the first paragraph and last section, virtually every word of this essay was taken from Gary Marcus's Christmas Day 2022 essay 'What to expect when you are expecting … GPT-4'. Factual · 27 Jul 2025 Their own work or organisation
Unresolvable Prediction 27 Jul 2025 GPT-5 will not have reliable models of what it talks about that external programmers can access to feed downstream processes. Prediction · 27 Jul 2025 AI capabilities
Unresolvable Prediction 27 Jul 2025 In hindsight, LLMs like GPT-5 may be seen as only part of the eventual solution to AGI. Prediction · 27 Jul 2025 AI timelines and forecasting
Unresolvable Prediction 27 Jul 2025 Trustworthy, general AI, when it comes, will come from more structured systems with more built-in knowledge and at least some degree of explicit tools for reasoning and planning, as well as explicit knowledge, which GPT-type systems lack. Prediction · 27 Jul 2025 AI capabilities
Unresolvable Factual 27 Jul 2025 Gary Marcus produced this essay by replacing GPT-4 with GPT-5 in his 2022 essay and trimming a few lines. Factual · 27 Jul 2025 Their own work or organisation
Unresolvable Prediction 27 Jul 2025 Scaling alone will prove useful only to a point. Prediction · 27 Jul 2025 AI timelines and forecasting
Unresolvable Prediction 27 Jul 2025 Developers building virtual assistants and agents on GPT-5 will find they cannot map user language onto user intentions reliably enough. Prediction · 27 Jul 2025 AI capabilities
Unresolvable Prediction 27 Jul 2025 Without external aids, GPT-5 won't beat Meta's Cicero at Diplomacy or drive a car reliably. Prediction · 27 Jul 2025 AI capabilities
Unresolvable Prediction 1 Jan 2025 OpenAI will continue in 2025 to preview products months or years before they are solid and widely available at an accessible price. Prediction · 1 Jan 2025 AI capabilities
Unresolvable Prediction 1 Jan 2025 No 'GPT-5 level' model, a huge across-the-board leap by community consensus, may appear throughout 2025. Prediction · 1 Jan 2025 AI timelines and forecasting
Unresolvable Factual 1 Jan 2025 Marcus coined in 2022 the notion that AI might be 'hitting a wall', which later became widespread in outlets such as CNN, The Verge and the Wall Street Journal. Factual · 1 Jan 2025 Their own work or organisation
Unresolvable Prediction 1 Jan 2025 Copyright lawsuits over generative AI will continue throughout 2025. Prediction · 1 Jan 2025 AI policy and governance
Unresolvable Prediction 1 Jan 2025 Valuations of major AI companies may start to fall in 2025. Prediction · 1 Jan 2025 Economics and markets
Unresolvable Prediction 1 Jan 2025 In 2025 truly driverless cars will remain limited to a modest number of cities, mainly in the West and in good weather. Prediction · 1 Jan 2025 Technology
Unresolvable Prediction 1 Jan 2025 AI will presumably solve compositionality, factuality, reasoning and similar problems someday, though current techniques have thus far not been adequate. Prediction · 1 Jan 2025 AI capabilities
Unresolvable Factual 2025 The shortcuts that LLMs use work about 80% of the time but not 100%. Factual · 2025 AI capabilities
Unresolvable Factual 2025 Marcus said he thinks many, or possibly all, animals can do some variable binding, and he cited Randy Gallistel's work on ant navigation as an example. Factual · 2025 Science and research methods
Unresolvable Prediction 2025 Marcus said the chance that someone, possibly the person he was speaking with or someone else, has a different architecture that works is maybe a little higher. Prediction · 2025 AI timelines and forecasting
Unresolvable Prediction 2025 There are some questions, such as the definition of life in abortion decisions, on which humans will never agree. Prediction · 2025 Philosophy, ethics and society
Unresolvable Prediction 2025 When "it" arrives, people will look back at the early 2020s and ask why so much effort went in one direction when the answer lay elsewhere. Prediction · 2025 AI timelines and forecasting
Unresolvable Prediction 2025 Marcus said he thinks the chance that "it" (the development under discussion, which the quoted passage does not name) will come out of large language models is zero. Prediction · 2025 AI timelines and forecasting
Unresolvable Prediction 2025 Even if AGI is like a million smart people working 24/7, it will not magically solve all problems or remove the need for empirical data. Prediction · 2025 AI timelines and forecasting
Unresolvable Prediction 2025 Many different AGIs will probably appear in many places once AGI is reached. Prediction · 2025 AI timelines and forecasting
Unresolvable Prediction Dec 2024 With medium confidence, technical moat will continue to be elusive in 2025, with convergence on broadly similar models across the US and China and some European systems catching up to roughly the same place. Prediction · Dec 2024 Economics and markets
Unresolvable Prediction Dec 2024 Few companies and even fewer consumers will adopt OpenAI's o3 at wide scale in 2025 because of price and robustness concerns. Prediction · Dec 2024 Economics and markets
Unresolvable Prediction 9 Nov 2024 The US's focus on LLMs for AI may prove to be a massive mistake. Prediction · 9 Nov 2024 AI policy and governance
Unresolvable Prediction 9 Nov 2024 LLMs will become a commodity and price wars will keep revenue low. Prediction · 9 Nov 2024 Economics and markets
Unresolvable Prediction 9 Nov 2024 LLMs will not disappear, but their economics will likely never make sense because training costs rise with scaling. Prediction · 9 Nov 2024 AI, the economy and work
Unresolvable Prediction 9 Nov 2024 Given chip costs, profits from LLMs will be elusive. Prediction · 9 Nov 2024 Economics and markets
Unresolvable Prediction 9 Nov 2024 The AI financial bubble may burst quickly once people realize the situation, and Nvidia's valuation may take a hit. Prediction · 9 Nov 2024 Economics and markets
Unresolvable Factual 9 Nov 2024 Melanie Mitchell, Subbarao Kambhampati, Emily Bender, Ernie Davis and others have long emphasized that LLMs have principled limits. Factual · 9 Nov 2024 Their own work or organisation
Unresolvable Prediction Apr 2024 Reliable, trustworthy AI is achievable, but may require going back to the drawing board. Prediction · Apr 2024 AI safety and alignment
Unresolvable Prediction Apr 2024 If GenAI enthusiasm dwindles and valuations plummet, AI and LLMs will not disappear and will remain tools for statistical approximation. Prediction · Apr 2024 Economics and markets
Unresolvable Prediction Apr 2024 LLMs' place may be smaller, and LLMs on their own may never live up to the 2023 expectations. Prediction · Apr 2024 AI timelines and forecasting
Unresolvable Factual Apr 2024 Gary Marcus says that in April, when he first saw what he called direct empirical evidence that "this moment had come", he wrote a passage that he says he still stands by. Factual · Apr 2024 Their own work or organisation
Unresolvable Prediction 31 Mar 2024 If OpenAI releases a truly mindblowing GPT-5 in 2024, the generative AI bubble will not burst soon. Prediction · 31 Mar 2024 Economics and markets
Unresolvable Prediction 31 Mar 2024 If OpenAI releases a truly mindblowing GPT-5 in 2024, hype around generative AI will increase further. Prediction · 31 Mar 2024 Economics and markets
Unresolvable Factual 31 Mar 2024 LLMs themselves cannot look things up and reason over what they find. Factual · 31 Mar 2024 AI capabilities
Unresolvable Prediction 31 Mar 2024 Marcus said he would be truly astonished if hallucinations in large language models were brought down to human expert levels by the end of 2024. Prediction · 31 Mar 2024 AI capabilities
Unresolvable Prediction 31 Mar 2024 If OpenAI releases a truly mindblowing GPT-5 in 2024, generative AI will live for another day, perhaps imploding only later when people realize there is no killer app to justify the increasingly high costs. Prediction · 31 Mar 2024 Economics and markets
Unresolvable Prediction 31 Mar 2024 If no company releases a true quantum leap addressing reliability, hallucination, data leakage and security by the end of 2024, the generative AI bubble may start to pop by around March 2025. Prediction · 31 Mar 2024 Economics and markets
Unresolvable Factual 31 Mar 2024 All the big AI players are converging on systems roughly equivalent to GPT-4, all flawed in essentially the same ways. Factual · 31 Mar 2024 Economics and markets
Unresolvable Prediction 31 Mar 2024 Generative AI will still exist and find some use, but valuations and excitement may dissipate, returning only once genuine advances are made. Prediction · 31 Mar 2024 Economics and markets
Unresolvable Factual 30 Mar 2023 Gary Marcus wrote a long Twitter thread on the morning of 2023-03-30 responding to criticism of the FLI letter. Factual · 30 Mar 2023 Their own work or organisation
Unresolvable Factual 30 Mar 2023 Gary Marcus signed the Future of Life Institute open letter and promoted it publicly. Factual · 30 Mar 2023 Their own work or organisation
Unresolvable Prediction 25 Dec 2022 Trustworthy AI will need genuinely new architectures incorporating explicit knowledge and world models at their core. Prediction · 25 Dec 2022 AI capabilities
Unresolvable Factual 25 Dec 2022 ChatGPT is frequently retuned based on feedback, but weeks later Marcus still keeps being sent tweets showing its blunders. Factual · 25 Dec 2022 AI capabilities
Unresolvable Prediction 25 Dec 2022 When GPT-4 comes out it will totally eclipse ChatGPT, and it is a safe bet that even more people will be talking about it. Prediction · 25 Dec 2022 AI capabilities
Unresolvable Prediction 25 Dec 2022 Marcus fully expected GPT-4 to be the shiniest model so far, but said that this does not mean it is a critical step on the optimal path to AI that can be trusted. Prediction · 25 Dec 2022 AI capabilities
Unresolvable Factual 25 Dec 2022 GPT-4 is architecturally essentially the same as GPT-3, according to rumors. Factual · 25 Dec 2022 AI capabilities
Unresolvable Prediction 25 Dec 2022 GPT-4 by itself won't be a general-purpose AGI; without external aids it won't beat Cicero in Diplomacy, drive a car reliably, or reliably guide a robot like Optimus. Prediction · 25 Dec 2022 AI capabilities
Unresolvable Prediction 25 Dec 2022 GPT-4's reasoning about the physical, psychological and mathematical world will still be unreliable. Prediction · 25 Dec 2022 AI capabilities
Unresolvable Prediction 29 Dec 2021 Current AI, being an approximation to intelligence rather than the real thing, will never really be trustworthy. Prediction · 29 Dec 2021 AI safety and alignment
Unresolvable Factual 20 Dec 2021 Gary Marcus wrote the 2001 book The Algebraic Mind, and its predictions have so far held true. Factual · 20 Dec 2021 Their own work or organisation
Unresolvable Promise 17 Oct 2021 Gary Marcus will give a talk at the AGI21 conference on 2021-10-18. Promise · 17 Oct 2021 Their own work or organisation
Unresolvable Factual 13 Apr 2021 As of 2021, neural networks still struggle with notions that are obvious to babies. Factual · 13 Apr 2021 AI capabilities
Unresolvable Factual 4 Jun 2020 Anima Anandkumar misrepresented private correspondence with Gary Marcus. Factual · 4 Jun 2020 Their own work or organisation
Unresolvable Factual 4 Jun 2020 Gary Marcus said that Sergey Brin, Larry Page and Elon Musk lead a "hall of shame" list of billionaires who have made no known charitable contributions to helping the world cope with Covid. Factual · 4 Jun 2020 Other
Unresolvable Factual 2 Jun 2020 Robust.AI is closed on 2 June 2020 in solidarity with those seeking justice and in memory of George Floyd. Factual · 2 Jun 2020 Other
Unresolvable Factual 14 Nov 2019 Asked whether "they" understand the "no free lunch" point, Marcus said "about 75 percent" and "They do not yet"; the quote does not say who "they" are or what the 75 percent measures. Factual · 14 Nov 2019 Field building and careers
Unresolvable Prediction 14 Nov 2019 Marcus argues that AI will not proceed until the field allows some "neatness", meaning some innate structure (nativism), in its systems. Prediction · 14 Nov 2019 AI capabilities
Unresolvable Factual 14 Nov 2019 Most of the current best AI systems fundamentally just learn contingencies rather than general abstract concepts that humans can apply quickly. Factual · 14 Nov 2019 AI capabilities
Unresolvable Factual 14 Nov 2019 The best-selling domestic robot of all time is still the Roomba, which does not manipulate objects. Factual · 14 Nov 2019 Technology
Unresolvable Prediction 14 Nov 2019 The real action in AI will be in finding theoretically sound ways of combining symbolic and deep learning traditions. Prediction · 14 Nov 2019 AI capabilities
Unresolvable Prediction 20 Sep 2019 Marcus said he thinks it is just a question of whether "we will get there" gradually or through a lot of social unrest. Prediction · 20 Sep 2019 AI, the economy and work
Unresolvable Factual 20 Sep 2019 If the paddle in the game Breakout is moved by three pixels, a deep-learning system trained on the game fails. Factual · 20 Sep 2019 AI capabilities
Unresolvable Prediction 20 Sep 2019 Smarter AI could solve many medical and scientific problems. Prediction · 20 Sep 2019 AI capabilities
Unresolvable Prediction 20 Sep 2019 The ultimate AI systems will have the memory capabilities of machines rather than of people. Prediction · 20 Sep 2019 AI capabilities
Unresolvable Prediction 20 Sep 2019 Marcus said he expects machines will eventually be able to do world-class scientific reasoning, though they are nowhere near that now. Prediction · 20 Sep 2019 AI timelines and forecasting
Unresolvable Prediction 20 Sep 2019 Marcus said he thinks it is inevitable that society will adopt universal basic income, and that the open question is whether this happens gradually or through social unrest. Prediction · 20 Sep 2019 AI, the economy and work
Unresolvable Factual 16 Feb 2019 OpenAI's new system is state of the art on some question-answering tests but is no match for humans on story understanding. Factual · 16 Feb 2019 AI capabilities
Unresolvable Prediction 15 Jan 2019 William Barr may become the person who most subverts American democracy, more than Donald Trump. Prediction · 15 Jan 2019 AI policy and governance
Unresolvable Factual 9 Jan 2019 The Kindle edition of The Algebraic Mind: Integrating Connectionism and Cognitive Science is available as of 2019-01-09. Factual · 9 Jan 2019 Their own work or organisation
Unresolvable Prediction 2019 The deep learning approach to language would never work, as argued in a chapter of Rebooting AI. Prediction · 2019 Their own work or organisation
Unresolvable Factual 2017 Some AI problems might be too complex for individual labs and not of enough financial interest to large AI companies like Google and Meta, which he described as driven by profits rather than humanity. Factual · 2017 AI policy and governance
Back to the list

Gary Marcus

Open its page

Prediction AI capabilities

“People building things like virtual assistants and agents will find that they cannot reliably enough map user language onto user intentions.”

Gary Marcus, author 27 July 2025 What to Expect When You're Expecting … GPT-5 (Marcus on AI)

Developers building virtual assistants and agents on GPT-5 will find they cannot map user language onto user intentions reliably enough.

Unresolvable The public record could not settle it.

What would count as true or false

Judge over about a year after GPT-5's August 2025 release (to August 2026). True: credible evidence (developer reports, evaluations of GPT-5-based agents, benchmarks of agentic task success, industry surveys) shows that assistants and agents built on GPT-5 commonly misread user intent often enough that developers report it as a significant barrier to reliable deployment. Mostly true: intent-mapping failures are widely documented as a significant problem, but some substantial deployments report acceptable reliability. Mixed: the evidence is roughly split between reports of reliable intent understanding and reports of significant failures. Mostly false: most developers and evaluations find GPT-5 maps user language to intent reliably enough for production, with failures only in edge cases. False: GPT-5-based assistants and agents are broadly found to interpret user intentions reliably, and misinterpretation is not a notable barrier. Failures caused mainly by other factors (tool errors, cost, latency) do not count towards the claim.

Evidence

  1. Agentic AI in Industry: Adoption Level and Deployment Barriers arXiv · 31 January 2026
    “Greater task ownership also amplifies friction already visible in LLM-based tools: systems may omit aspects of developer intent, vary across equivalent prompts, hallucinate, or lose relevant information as context grows [13, 7].”
  2. Agentic AI in Industry: Adoption Level and Deployment Barriers arXiv · 31 January 2026
    “Human verification was therefore used to check both technical output and semantic intent.”
  3. Agentic AI in Industry: Adoption Level and Deployment Barriers arXiv · 31 January 2026
    “Across the cases, four previously identified barriers recurred: context management, performance on proprietary content, non-determinism and qualification, and data confidentiality.”
  4. Agentic AI in Industry: Adoption Level and Deployment Barriers arXiv · 31 January 2026
    “Narrow IDE- or CLI-based agentic processes remained ad hoc, requiring context and intent to be re-established for each use.”
  5. Zendesk AI + GPT-5: Setting the pace for the next generation of support Zendesk · 7 August 2025
    “GPT-5 clarified vague customer input more effectively, enabling better routing and increasing coverage of automated flows in over 65% of conversations.”
  6. Zendesk AI + GPT-5: Setting the pace for the next generation of support Zendesk · 7 August 2025
    “GPT-5 operates in conjunction with our intent classification and reasoning pipeline.”
  7. Zendesk reports 30% faster response, 95% reliability after GPT-5 integration VentureBeat · 8 September 2025
    “The company has found that, for most customers, agents powered by GPT-5 can solve more than 50% of tickets — and in some cases, even 80 to 90% of them.”
  8. Learning #4. AI agents: Promising, but not yet mainstream – 2025 Stack Overflow Developer Survey: A TL;DR for Leaders Stack Overflow · 26 October 2026
    “87% of survey respondents are concerned about the accuracy of AI agents.”

Reasoning

The industry study (E1–E4) covers agentic AI in general, not GPT-5 specifically. It notes that systems may leave out parts of developer intent and that intent had to be re-established or checked by people. Even so, misreading intent is not among the four barriers that recurred across its cases (E3). Zendesk reports that GPT-5 handled vague customer input better and resolved many tickets (E5, E7), but these are claims about one deployment, and intent there is also handled by a separate classification pipeline (E6). The survey (E8) shows only general concern about agent accuracy. None of this shows how often GPT-5-based assistants and agents broadly misread user intent, so the criteria cannot be settled either way.

Cite this claim

Gary Marcus, “Developers building virtual assistants and agents on GPT-5 will find they cannot map user language onto user intentions reliably enough.” (said 27 July 2025). Verdict: unresolvable. Reliability API, claim c_f0642744cc4a, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_f0642744cc4a

Claims without a verdict

Is a verdict here wrong, or do you speak for Gary Marcus? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.