ClaimsGary Marcus

“I wrote an entire book on this, in 2001 (The Algebraic Mind); so far its predictions have held true.”

Gary Marcus, author of the post 20 December 2021 Post by @GaryMarcus on X, 2021-12-20 (X)

Factual Their own work or organisation

Gary Marcus wrote the 2001 book The Algebraic Mind, and its predictions have so far held true.

Unresolvable The public record could not settle it.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The second judge would not resolve this claim; the verdict shown is the first judge's.

What would count as true or false

Two parts. (a) Authorship: Gary Marcus wrote The Algebraic Mind, published in 2001 (MIT Press). (b) The book's predictions had held true as of December 2021, for example its predictions that multilayer perceptron or neural-network models lacking explicit symbol manipulation would fail to generalise free abstract rules outside the training space. True: (a) holds, and assessments up to 2021 (research literature, reviews) show the book's main stated predictions were borne out, with no clear counterexample. Mostly true: (a) holds and the main predictions were largely borne out, but at least one is contested or only partly borne out. Mixed: (a) holds, but the record on the predictions is roughly evenly split or seriously contested in the literature. Mostly false: (a) holds, but the predictions had substantially failed by 2021 or were too vague to have been borne out as claimed. False: Marcus did not write the book or it was not published around 2001, or its predictions were clearly refuted. An exact year off by one (for example a 2001 vs 2002 printing) counts as a minor detail.

Set before the research began.

Evidence (4)

  1. E1 Pre-Wiring and Pre-Training: What Does a Neural Network Need to Learn Truly General Identity Rules? Journal of Artificial Intelligence Research · April 2018

    “We therefore confirm that the SRN does not reproduce the empirical findings.”
  2. E2 Pre-Wiring and Pre-Training: What Does a Neural Network Need to Learn Truly General Identity Rules? Journal of Artificial Intelligence Research · April 2018

    “Our study suggests that both the initial optimism about the generalization abilities of infants and the pessimism about neural networks were overstated.”
  3. E3 Analysing Mathematical Reasoning Abilities of Neural Models arXiv (ar5iv rendering)

    “Marcus (2003) Gary F Marcus. The algebraic mind: Integrating connectionism and cognitive science. MIT press, 2003.”
  4. E4 Analysing Mathematical Reasoning Abilities of Neural Models arXiv (ar5iv rendering)

    “Modules on which good extrapolation performance was obtained include rounding larger numbers than seen during training, comparing more numbers, and adding and subtracting larger numbers.”

Reasoning

E3 attributes The Algebraic Mind to Marcus but dates it 2003, two years after the stated 2001, and no item explains the gap. E1, E2 and E4 discuss what neural networks can and cannot do, but none of them refers to the book or assesses its predictions, so the evidence does not settle whether those predictions held true as of 2021.

Cite this claim

Gary Marcus, “Gary Marcus wrote the 2001 book The Algebraic Mind, and its predictions have so far held true.” (said 20 December 2021). Verdict: unresolvable. Reliability API, claim c_a386a09214ab, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_a386a09214ab

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Gary Marcus, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Gary Marcus

  1. Resolved true Factual 9 November 2024
    “For years I have been warning that “scaling” — eeking out improvements in AI by adding more data and more compute, without making fundamental architectural changes — would not continue forever.”

    Gary Marcus has for years warned that AI scaling by adding data and compute without architectural changes would not continue forever.

  2. Mostly true Factual 31 March 2024
    “In early August, I wrote a piece called What if Generative AI turned out to be a Dud, picked up in the Financial Times and elsewhere.”

    In early August 2023 Gary Marcus wrote a piece titled 'What if Generative AI turned out to be a Dud', which was picked up by the Financial Times and other outlets.

  3. Resolved true Factual February 2024
    “Immediately after the February announcement of Sora, I noted Sora’s troubles with physics and predicted that they wouldn’t go away. They haven’t.”

    After Sora's February 2024 announcement, Marcus predicted its physics troubles would persist, and they have.

  4. Mostly true Factual 26 October 2023
    “So it was heartening to see many of the ideas that I have been pushing for a long time, including a CERN for AI and Global AI governance (which I emphasized in April in my TED talk and in The…”

    Gary Marcus emphasized a CERN for AI and global AI governance in April 2023 in his TED talk and in The Economist.

  5. Resolved true Factual 30 March 2023
    “It actually called for *more* research.”

    The FLI open letter called for more AI research.

All of them

Verdicts are made automatically; how verdicts are made.