ClaimsGary Marcus

“In April, when I first saw direct empirical evidence that this moment had come, I wrote (and stand by):”

Gary Marcus, author April 2024 CONFIRMED: LLMs have indeed reached a point of diminishing returns (Marcus on AI) archived copy

Factual Their own work or organisation

Gary Marcus says that in April, when he first saw what he called direct empirical evidence that "this moment had come", he wrote a passage that he says he still stands by.

Unresolvable The public record could not settle it.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The second judge would not resolve this claim; the verdict shown is the first judge's.

The evidence is the person's or their organisation's own records.

What would count as true or false

A factual claim about Marcus's own writing. True: there is a piece Marcus published in April (of the year the source refers to, apparently 2024) that cites what he presents as direct empirical evidence that the moment he describes had arrived, and the quoted passage appears in it; his calling it 'stand by' is his own view and needs no further check. Mostly true: the passage exists and matches, but it was published slightly outside April (for example, early May) or with small wording differences. Mixed: a related piece exists, but the passage or framing differs substantially. Mostly false: the passage was written but at a clearly different time, or not in response to the evidence described. False: no such April piece exists; its absence must be shown by checking his dated Substack archive, not inferred from a failed search.

Set before the research began.

Evidence (1)

  1. E1 Evidence that LLMs are reaching a point of diminishing returns - and what that might mean Gary Marcus (Substack, Marcus on AI) · 13 April 2024 Own record

    “Instead, I see numerous signs that we have reached a period of diminishing returns.”

Reasoning

E1 shows that Marcus published a post on 2024-04-13 saying he sees signs that LLMs have reached a period of diminishing returns. The quoted E1 text does not contain the passage he says he stands by, so the evidence does not show whether that passage appears in an April piece, as the criteria require.

Cite this claim

Gary Marcus, “Gary Marcus says that in April, when he first saw what he called direct empirical evidence that "this moment had come", he wrote a passage that he says he still stands by.” (said April 2024). Verdict: unresolvable. Reliability API, claim c_cbd5791917ad, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_cbd5791917ad

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Gary Marcus, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Gary Marcus

  1. Resolved true Factual 9 November 2024
    “For years I have been warning that “scaling” — eeking out improvements in AI by adding more data and more compute, without making fundamental architectural changes — would not continue forever.”

    Gary Marcus has for years warned that AI scaling by adding data and compute without architectural changes would not continue forever.

  2. Mostly true Factual 31 March 2024
    “In early August, I wrote a piece called What if Generative AI turned out to be a Dud, picked up in the Financial Times and elsewhere.”

    In early August 2023 Gary Marcus wrote a piece titled 'What if Generative AI turned out to be a Dud', which was picked up by the Financial Times and other outlets.

  3. Resolved true Factual February 2024
    “Immediately after the February announcement of Sora, I noted Sora’s troubles with physics and predicted that they wouldn’t go away. They haven’t.”

    After Sora's February 2024 announcement, Marcus predicted its physics troubles would persist, and they have.

  4. Mostly true Factual 26 October 2023
    “So it was heartening to see many of the ideas that I have been pushing for a long time, including a CERN for AI and Global AI governance (which I emphasized in April in my TED talk and in The…”

    Gary Marcus emphasized a CERN for AI and global AI governance in April 2023 in his TED talk and in The Economist.

  5. Resolved true Factual 30 March 2023
    “It actually called for *more* research.”

    The FLI open letter called for more AI research.

All of them

Verdicts are made automatically; how verdicts are made.