ClaimsYann LeCun

“The ConvNet architecture was loosely inspired by that of the ventral pathway in the visual cortex”

Yann LeCun, paper author 2019 ISSCC 2019 Plenary: Deep Learning Hardware: Past, Present and Future (yann.lecun.com)

Factual AI capabilities

The ConvNet architecture was loosely inspired by the ventral pathway in the visual cortex.

Mostly true True in substance, wrong in a detail.

Factual: Statements about the present or the past, checked against the record: did they hold up?

What would count as true or false

True if the historical and technical literature shows that the ConvNet architecture (local receptive fields, shared weights, alternating feature-extraction and pooling/subsampling layers) took its inspiration, directly or through the Neocognitron, from Hubel and Wiesel's simple/complex cell findings and the hierarchical ventral visual stream. The claim says only 'loosely inspired', so close biological fidelity is not required. Mostly true if the inspiration is documented but traces mainly to early visual cortex (V1 simple/complex cells) rather than the whole ventral pathway, which is a minor detail. Mostly false if any biological link is incidental or added afterwards, with the design actually coming from other sources such as signal-processing convolution. False if the evidence shows that visual cortex played no part in the architecture's design.

Set before the research began.

Evidence (4)

  1. E1 Neocognitron Scholarpedia (article by Kunihiko Fukushima) · 19 January 2007

    “S-cells work as feature-extracting cells. They resemble simple cells of the primary visual cortex in their response.”
  2. E2 Gradient-based learning applied to document recognition HAL (open archive copy of Proceedings of the IEEE, 1998, 86(11), pp. 2278-2324) · 1998 Own record

    “The convolution/subsampling combination, inspired by Hubel and Wiesel’s notions of “simple” and “complex” cells, was implemented in Fukushima’s Neocognitron [32],”
  3. E3 [PDF] Convolutional Neural Networks as a Model of the Visual System arXiv (review by Grace W. Lindsay, Gatsby Computational Unit, UCL; author's final version of a Journal of Cognitive Neuroscience article)

    “The convolutional neural network as we know it today comes from the field of computer vision yet the inspiration from the work of of Hubel and Wiesel is clearly visible in it (Figure 1) [10].”
  4. E4 Convolutional neural network - Wikipedia Wikipedia · 31 August 2013

    “Their paper replaced multiplication with convolution in time, inherently providing shift invariance, motivated by and connecting more directly to the signal-processing concept of a filter, and demonstrated it on a speech recognition task.”

Reasoning

An independent review, E3, says the inspiration from Hubel and Wiesel's work is "clearly visible" in the convolutional neural network. Fukushima's own account, E1, says the feature-extracting S-cells of the Neocognitron resemble simple cells of the primary visual cortex in their response. LeCun's 1998 paper, E2, traces the convolution/subsampling combination to Hubel and Wiesel's simple and complex cells by way of the Neocognitron. E4 notes a parallel line of work that took its motivation from signal-processing filters, and the documented inspiration points mainly to the simple and complex cells of early visual cortex (V1) rather than the whole ventral pathway, so the verdict is mostly true rather than true.

Cite this claim

Yann LeCun, “The ConvNet architecture was loosely inspired by the ventral pathway in the visual cortex.” (said 2019). Verdict: mostly true. Reliability API, claim c_b397b8df531f, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_b397b8df531f

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Yann LeCun, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Yann LeCun

  1. Mostly true Factual 18 March 2024
    “For starters, transformers are equivariant to permutations.”

    Transformers are equivariant to permutations, as ConvNets are equivariant to translations.

  2. Mostly true Factual 14 March 2024
    “If it were the case, we would have AI systems that could teach themselves to drive a car in 20 hours of practice, like any 17 year-old.”

    There are currently no AI systems that can teach themselves to drive a car in about 20 hours of practice, as a 17-year-old can.

  3. Mostly true Factual 8 March 2024
    “The architecture is good, the architecture of the encoder is good, but the fact that you train the system to reconstruct images does not lead it to produce to long, good generic features of images.”

    Training an encoder to reconstruct images does not lead it to produce good generic image features, though the encoder architecture is good.

  4. Mostly true Factual 8 March 2024
    “LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world.”

    Current LLMs can do none of understanding the physical world, persistent memory, reasoning and planning, or only in a very primitive way.

  5. Mostly true Factual 8 March 2024
    “No, there’s one thing that autoregressive LLMs or that LLMs in general, not just the autoregressive one, but including the bird style bidirectional ones, are exploiting and its self supervised…”

    LLMs, including BERT-style bidirectional ones, exploit self-supervised learning, and LeCun has been a very strong advocate of self-supervised learning for many years.

All of them

Verdicts are made automatically; how verdicts are made.