The ConvNet architecture was loosely inspired by the ventral pathway in the visual cortex.
Mostly true True in substance, wrong in a detail.
Factual: Statements about the present or the past, checked against the record: did they hold up?
What would count as true or false
True if the historical and technical literature shows that the ConvNet architecture (local receptive fields, shared weights, alternating feature-extraction and pooling/subsampling layers) took its inspiration, directly or through the Neocognitron, from Hubel and Wiesel's simple/complex cell findings and the hierarchical ventral visual stream. The claim says only 'loosely inspired', so close biological fidelity is not required. Mostly true if the inspiration is documented but traces mainly to early visual cortex (V1 simple/complex cells) rather than the whole ventral pathway, which is a minor detail. Mostly false if any biological link is incidental or added afterwards, with the design actually coming from other sources such as signal-processing convolution. False if the evidence shows that visual cortex played no part in the architecture's design.
Set before the research began.
Evidence (4)
-
E1 Neocognitron Scholarpedia (article by Kunihiko Fukushima) · 19 January 2007
“S-cells work as feature-extracting cells. They resemble simple cells of the primary visual cortex in their response.”
-
E2 Gradient-based learning applied to document recognition HAL (open archive copy of Proceedings of the IEEE, 1998, 86(11), pp. 2278-2324) · 1998 Own record
“The convolution/subsampling combination, inspired by Hubel and Wiesel’s notions of “simple” and “complex” cells, was implemented in Fukushima’s Neocognitron [32],”
-
E3 [PDF] Convolutional Neural Networks as a Model of the Visual System arXiv (review by Grace W. Lindsay, Gatsby Computational Unit, UCL; author's final version of a Journal of Cognitive Neuroscience article)
“The convolutional neural network as we know it today comes from the field of computer vision yet the inspiration from the work of of Hubel and Wiesel is clearly visible in it (Figure 1) [10].”
-
E4 Convolutional neural network - Wikipedia Wikipedia · 31 August 2013
“Their paper replaced multiplication with convolution in time, inherently providing shift invariance, motivated by and connecting more directly to the signal-processing concept of a filter, and demonstrated it on a speech recognition task.”
Reasoning
An independent review, E3, says the inspiration from Hubel and Wiesel's work is "clearly visible" in the convolutional neural network. Fukushima's own account, E1, says the feature-extracting S-cells of the Neocognitron resemble simple cells of the primary visual cortex in their response. LeCun's 1998 paper, E2, traces the convolution/subsampling combination to Hubel and Wiesel's simple and complex cells by way of the Neocognitron. E4 notes a parallel line of work that took its motivation from signal-processing filters, and the documented inspiration points mainly to the simple and complex cells of early visual cortex (V1) rather than the whole ventral pathway, so the verdict is mostly true rather than true.
Cite this claim
Yann LeCun, “The ConvNet architecture was loosely inspired by the ventral pathway in the visual cortex.” (said 2019). Verdict: mostly true. Reliability API, claim c_b397b8df531f, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_b397b8df531f
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Yann LeCun
-
Mostly true
“For starters, transformers are equivariant to permutations.”
Transformers are equivariant to permutations, as ConvNets are equivariant to translations.
-
Mostly true
“If it were the case, we would have AI systems that could teach themselves to drive a car in 20 hours of practice, like any 17 year-old.”
-
Mostly true
“The architecture is good, the architecture of the encoder is good, but the fact that you train the system to reconstruct images does not lead it to produce to long, good generic features of images.”
-
Mostly true
“LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world.”
-
Mostly true
“No, there’s one thing that autoregressive LLMs or that LLMs in general, not just the autoregressive one, but including the bird style bidirectional ones, are exploiting and its self supervised…”
Verdicts are made automatically; how verdicts are made.