ClaimsGary Marcus

“We have no way of guaranteeing that large language models will reliably stick to facts, a point so thoroughly established by now I don’t think it needs a reference.”

Gary Marcus, author of Marcus on AI 26 October 2023 A CERN for AI and the Global Governance of AI (Marcus on AI)

Factual AI capabilities

There is currently no way to guarantee that large language models will reliably stick to facts.

Not researched Checkable, but outside the sample that was researched.

Factual: Statements about the present or the past, checked against the record: did they hold up?

Cite this claim

Gary Marcus, “There is currently no way to guarantee that large language models will reliably stick to facts.” (said 26 October 2023). Verdict: not researched. Reliability API, claim c_38b1bc4df683, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_38b1bc4df683

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Gary Marcus, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Gary Marcus

  1. Mostly true Factual January 2026
    “Reviews by Joanna Stern and Marques Brownle of one early prototype were damning;”

    Reviews by Joanna Stern and Marques Brownlee of one early humanoid robot prototype were damning.

  2. Mostly true Factual January 2026
    “Many would agree we have reached a point of diminishing returns for scaling; faith in scaling as a route to AGI has dissipated.”

    Many would agree the AI field has reached a point of diminishing returns from scaling, and faith in scaling as a route to AGI has dissipated.

  3. Mostly true Factual January 2026
    “Despite all the hype, agents didn’t turn out to be reliable.”

    AI agents did not turn out to be reliable in 2025.

  4. Mixed Factual 2025
    “but the systems don’t have the knowledge graph to do that.”

    Current AI systems lack the knowledge graph needed to handle easy facts like those on the first page of Wikipedia.

  5. Resolved true Factual 2025
    “Hasn’t worked so far. That’s for sure.”

    Bolting extra components onto an LLM and scaling it up has so far not produced human-level AGI.

All of them

Verdicts are made automatically; how verdicts are made.