The brain is much better than current artificial models at unsupervised learning.
Mostly true True in substance, wrong in a detail.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
Judge as of 2015-02-18. True: research and expert assessments from that time show that the brain learns useful representations from unlabelled sensory data far more effectively than the artificial unsupervised learning methods of 2015, and that those methods were broadly considered to lag well behind what biological learning does. Mostly true: the brain was clearly better, but 'much better' overstates the gap on some specific measures. Mixed: the brain had the advantage on some aspects of unsupervised learning, but artificial models matched or exceeded it on roughly as many others. Mostly false: artificial models were comparable on most measures and the brain led only narrowly. False: the evidence shows that artificial models of the time matched or exceeded the brain at unsupervised learning. If the evidence is consensus without direct measurement, that can support true or mostly true; only evidence contradicting the claim supports false.
Set before the research began.
Evidence (2)
-
E1 Perception Science in the Age of Deep Neural Networks PubMed Central (article from Frontiers in Perception Science) · 2 February 2017
“In contrast, humans can often learn without explicit supervision or “labels.” Unsupervised learning methods do exist for artificial neural networks, but they often give rise to a feature space that is insufficiently powerful and needs to be complemented by supervised fine-tuning in order to allow, for example, for accurate object recognition”
-
E2 Perception Science in the Age of Deep Neural Networks PubMed Central (article from Frontiers in Perception Science) · 2 February 2017
“Some of these methods can also learn features and representations from one or just a few exemplars, a form of “one-shot learning” on par with human capabilities (Anselmi et al., 2013; Rezende et al., 2016; Santoro et al., 2016).”
Reasoning
E1 is an independent perspective from 2017, after the judge-as-of date. It says humans can often learn without labels, while artificial unsupervised methods of that period often produced feature spaces too weak to use without supervised fine-tuning. That is consensus-style support for the brain having a clear advantage, which the criteria accept for true or mostly true. E2 notes that some methods reached human-level one-shot learning on certain tasks, but most of the work it cites dates from 2016, and one-shot learning is not strictly unsupervised learning. Neither source gives a direct measurement, so 'much better' is supported only by expert assessment, not quantified; the verdict is mostly true rather than true.
Cite this claim
Yann LeCun, “The brain is much better than current artificial models at unsupervised learning.” (said 18 February 2015). Verdict: mostly true. Reliability API, claim c_36b1955ea00c, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_36b1955ea00c
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Yann LeCun
-
Mostly true
“For starters, transformers are equivariant to permutations.”
Transformers are equivariant to permutations, as ConvNets are equivariant to translations.
-
Mostly true
“If it were the case, we would have AI systems that could teach themselves to drive a car in 20 hours of practice, like any 17 year-old.”
-
Mostly true
“The architecture is good, the architecture of the encoder is good, but the fact that you train the system to reconstruct images does not lead it to produce to long, good generic features of images.”
-
Mostly true
“LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world.”
-
Mostly true
“No, there’s one thing that autoregressive LLMs or that LLMs in general, not just the autoregressive one, but including the bird style bidirectional ones, are exploiting and its self supervised…”
Verdicts are made automatically; how verdicts are made.