Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
79 72 85 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
80 72 88 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 1 promise resolved, 5 needed for a score.
All types combined: 79 (likely 74 to 84, high confidence), from 102 claims: 64 factual claims, 38 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Gary Marcus's claims
42 claims
“In my most notorious article, in March of 2022, I argued that “deep learning is hitting a wall”.”
Gary Marcus, author March 2022 CONFIRMED: LLMs have indeed reached a point of diminishing returns (Marcus on AI)
In March 2022 Gary Marcus published an article arguing that deep learning is hitting a wall.
Resolved true The record shows it happened or was so.
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
True if Gary Marcus published an article in March 2022 that argues deep learning is hitting a wall (for example one titled or framed as 'Deep Learning Is Hitting a Wall'), as shown by the publication's dated record. Mostly true if the article was published within a few days outside March 2022 (e.g. late February or early April) and makes that argument. Mixed if it was published in 2022 but more than a month from March, or the 'hitting a wall' argument is only a side point. Mostly false if such an article exists but was published in another year. False if Marcus published no article making that argument around that time.
Evidence
- Deep Learning Is Hitting a Wall - Nautilus Nautilus · 10 March 2022
“Indeed, we may already be running into scaling limits in deep learning, perhaps already approaching a point of diminishing returns.”
- Deep Learning Is Hitting a Wall - Nautilus Nautilus · 10 March 2022
“Gary Marcus is a scientist, best-selling author, and entrepreneur.”
- Gilbane Advisor — neurosymbolic hybrid, content understanding Gilbane Advisor (Frank Gilbane) · 30 March 2022
“Gary Marcus provides historical and recent context and makes a case for a neurosymbolic hybrid approach.”
- Has Sam Altman gone full Gary Marcus? Gary Marcus (Substack) · 16 November 2023 Own record
“On March 20, 2022 in Nautilus, in the essay I am perhaps most notorious for, I suggested that deep learning might be approaching a wall”
Reasoning
The Nautilus essay "Deep Learning Is Hitting a Wall" carries a publication date of 2022-03-10, which falls in March 2022 (E1). The essay argues that deep learning may be reaching scaling limits and diminishing returns (E1). Its author biography names Gary Marcus (E2). A Gilbane Advisor roundup dated 2022-03-30 independently mentions a Marcus essay from that period that makes the case for a neurosymbolic hybrid approach (E3). Marcus's own later post (E4) gives a slightly different date but agrees it was published in March 2022.
Cite this claim
Gary Marcus, “In March 2022 Gary Marcus published an article arguing that deep learning is hitting a wall.” (said March 2022). Verdict: resolved true. Reliability API, claim c_8f0a55c40e2b, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_8f0a55c40e2b
Claims without a verdict
Is a verdict here wrong, or do you speak for Gary Marcus? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.