Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
79 72 85 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
80 72 88 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 1 promise resolved, 5 needed for a score.
All types combined: 79 (likely 74 to 84, high confidence), from 102 claims: 64 factual claims, 38 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Gary Marcus's claims
5 claims
| Verdict | Kind | Said | Claim | Topic |
|---|---|---|---|---|
| Mixed | Factual | 2 Jun 2026 | Companies like Anthropic are ending their all-you-can-eat pricing, which will make many customers think twice. Factual · 2 Jun 2026 | Economics and markets |
| Mixed | Factual | 2 Jun 2026 | AI companies are building essentially the same technical solution with essentially the same data, so there is no moat. Factual · 2 Jun 2026 | Economics and markets |
| Mixed | Factual | 2025 | Current AI systems lack the knowledge graph needed to handle easy facts like those on the first page of Wikipedia. Factual · 2025 | AI capabilities |
| Mixed | Prediction | 26 Oct 2023 | With more than 60 elections around the world in 2024, the chance that at least one would be swayed by deepfakes is high. Prediction · 26 Oct 2023 | Other global risks |
| Mixed | Factual | 14 Nov 2019 | AI currently lacks a way of building reusable skills. Factual · 14 Nov 2019 | AI capabilities |
“what we lack right now is a way of building reusable skills.”
Gary Marcus, podcast guest 14 November 2019 EP25 Gary Marcus on Rebooting AI (The Jim Rutt Show)
AI currently lacks a way of building reusable skills.
Mixed Partly true and partly false in roughly equal measure.
What would count as true or false
Judged as of 2019-11-14. True: the research literature of that time shows that AI systems generally could not acquire skills that they could reliably reuse and combine across tasks, with transfer learning, meta-learning and hierarchical reinforcement learning still widely seen as unsolved for this purpose. Mostly true: this was the broad consensus, though there was some limited success (e.g. pretrained models fine-tuned for other tasks) that the claim glosses over. Mixed: substantial reuse already existed in some areas (e.g. ImageNet or BERT-style transfer) while it was clearly lacking in others, such as robotics and reasoning. Mostly false: methods for reusing skills were well established and widely used by 2019, and the claim turns real limits into a total absence. False: the evidence shows that reusable skill-building was a solved, standard capability by then.
Evidence
- Do Better ImageNet Models Transfer Better? CVPR 2019 (Open Access), Simon Kornblith, Jonathon Shlens and Quoc V. Le, Google Brain
“Together, our results show that ImageNet architectures generalize well across datasets, but ImageNet features are less general than previously suggested.”
- Do Better ImageNet Models Transfer Better? CVPR 2019 (Open Access), Simon Kornblith, Jonathon Shlens and Quoc V. Le, Google Brain
“ImageNet pretraining accelerates convergence and improves performance on many datasets, but its value diminishes with greater training time, more training data, and greater divergence from ImageNet labels.”
- A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithms arXiv (Kroemer, Niekum, Konidaris)
“However, despite access to these excellent generic machine learning methods, the challenges of learning robust and versatile manipulation skills are still far from being resolved.”
- AI Hasn’t Found Its Isaac Newton: Gary Marcus on Deep Learning Defects & ‘Frenemy’ Yann LeCun | Synced Synced · 15 February 2019 Own record
“Almost everything that anybody has ever written in AI is brittle and narrow — it works for the circumstances for which it was built, and it can't adapt.”
Reasoning
A 2019 CVPR paper by independent authors found that ImageNet pretraining speeds up convergence and improves performance on many datasets, and that ImageNet architectures generalize well across datasets, though the features are less general than previously suggested (E1, E2). So substantial reuse of learned representations existed in computer vision. A robot-learning review from the same period says that learning robust and versatile manipulation skills was still far from resolved (E3). Under the criteria, real transfer in some areas alongside clear gaps in others such as robotics fits "mixed".
Cite this claim
Gary Marcus, “AI currently lacks a way of building reusable skills.” (said 14 November 2019). Verdict: mixed. Reliability API, claim c_eb4f38164189, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_eb4f38164189
Claims without a verdict
Is a verdict here wrong, or do you speak for Gary Marcus? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.