ClaimsYann LeCun

“The bottom line is that the brain is much better than our model at doing unsupervised learning.”

Yann LeCun, interviewee 18 February 2015 Facebook AI Director Yann LeCun on His Quest to Unleash Deep Learning (IEEE Spectrum) archived copy

Factual AI capabilities

The brain is much better than current artificial models at unsupervised learning.

Mostly true True in substance, wrong in a detail.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The second judge would not resolve this claim; the verdict shown is the first judge's.

What would count as true or false

Judge as of 2015-02-18. True: research and expert assessments from that time show that the brain learns useful representations from unlabelled sensory data far more effectively than the artificial unsupervised learning methods of 2015, and that those methods were broadly considered to lag well behind what biological learning does. Mostly true: the brain was clearly better, but 'much better' overstates the gap on some specific measures. Mixed: the brain had the advantage on some aspects of unsupervised learning, but artificial models matched or exceeded it on roughly as many others. Mostly false: artificial models were comparable on most measures and the brain led only narrowly. False: the evidence shows that artificial models of the time matched or exceeded the brain at unsupervised learning. If the evidence is consensus without direct measurement, that can support true or mostly true; only evidence contradicting the claim supports false.

Set before the research began.

Evidence (2)

  1. E1 Perception Science in the Age of Deep Neural Networks PubMed Central (article from Frontiers in Perception Science) · 2 February 2017

    “In contrast, humans can often learn without explicit supervision or “labels.” Unsupervised learning methods do exist for artificial neural networks, but they often give rise to a feature space that is insufficiently powerful and needs to be complemented by supervised fine-tuning in order to allow, for example, for accurate object recognition”
  2. E2 Perception Science in the Age of Deep Neural Networks PubMed Central (article from Frontiers in Perception Science) · 2 February 2017

    “Some of these methods can also learn features and representations from one or just a few exemplars, a form of “one-shot learning” on par with human capabilities (Anselmi et al., 2013; Rezende et al., 2016; Santoro et al., 2016).”

Reasoning

E1 is an independent perspective from 2017, after the judge-as-of date. It says humans can often learn without labels, while artificial unsupervised methods of that period often produced feature spaces too weak to use without supervised fine-tuning. That is consensus-style support for the brain having a clear advantage, which the criteria accept for true or mostly true. E2 notes that some methods reached human-level one-shot learning on certain tasks, but most of the work it cites dates from 2016, and one-shot learning is not strictly unsupervised learning. Neither source gives a direct measurement, so 'much better' is supported only by expert assessment, not quantified; the verdict is mostly true rather than true.

Cite this claim

Yann LeCun, “The brain is much better than current artificial models at unsupervised learning.” (said 18 February 2015). Verdict: mostly true. Reliability API, claim c_36b1955ea00c, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_36b1955ea00c

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Yann LeCun, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Yann LeCun

  1. Mostly true Factual 18 March 2024
    “For starters, transformers are equivariant to permutations.”

    Transformers are equivariant to permutations, as ConvNets are equivariant to translations.

  2. Mostly true Factual 14 March 2024
    “If it were the case, we would have AI systems that could teach themselves to drive a car in 20 hours of practice, like any 17 year-old.”

    There are currently no AI systems that can teach themselves to drive a car in about 20 hours of practice, as a 17-year-old can.

  3. Mostly true Factual 8 March 2024
    “The architecture is good, the architecture of the encoder is good, but the fact that you train the system to reconstruct images does not lead it to produce to long, good generic features of images.”

    Training an encoder to reconstruct images does not lead it to produce good generic image features, though the encoder architecture is good.

  4. Mostly true Factual 8 March 2024
    “LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world.”

    Current LLMs can do none of understanding the physical world, persistent memory, reasoning and planning, or only in a very primitive way.

  5. Mostly true Factual 8 March 2024
    “No, there’s one thing that autoregressive LLMs or that LLMs in general, not just the autoregressive one, but including the bird style bidirectional ones, are exploiting and its self supervised…”

    LLMs, including BERT-style bidirectional ones, exploit self-supervised learning, and LeCun has been a very strong advocate of self-supervised learning for many years.

All of them

Verdicts are made automatically; how verdicts are made.