It took decades before multi-layer neural nets demonstrated that Rosenblatt's view on layered perceptrons was right.
Resolved true The record shows it happened or was so.
Factual: Statements about the present or the past, checked against the record: did they hold up?
What would count as true or false
True: historical accounts show that the success of multi-layer neural networks in vindicating layered perceptrons came at least two decades after the early 1960s (e.g., backpropagation popularized in 1986, or the deep learning successes of the 2000s and 2010s), and that Rosenblatt had indeed advocated multi-layer or layered perceptrons. Mostly true: the multi-decade timing holds, but Rosenblatt's advocacy of layered networks is only partly documented. Mixed: the timing holds, but the evidence contradicts the claim that Rosenblatt held that view, or vice versa. Mostly false: multi-layer nets were demonstrated successfully within roughly a decade. False: they were demonstrated within a few years, or Rosenblatt clearly held no such view.
Set before the research began.
Evidence (4)
-
E1 Frank Rosenblatt vivarium.sh (wiki)
“Rosenblatt understood that the interesting computations required more than one adaptive layer, and chapter 13 of the 1962 book proposed heuristic rules for passing error signals back to hidden units, which he called the back-propagating error-correction procedure, together with layer-wise learning rates, bypass connections, and multimodal variants.”
-
E2 Principles of Neurodynamics · AI Evolution Atlas AI Evolution Atlas · 1962
“The book covers more than the single-layer case: Rosenblatt considers perceptrons with several layers and cross connections.”
-
E3 Frank Rosenblatt vivarium.sh (wiki)
“The multi-layer machines Rosenblatt could not train with the tools of the 1960s returned two decades later with backpropagation, and the perceptron is now recognized as the direct ancestor of the artificial neurons composing modern networks, from multi-layer feed-forward networks to the Transformers underlying today's large language models.”
-
E4 Frank Rosenblatt vivarium.sh (wiki)
“The heuristics did not work reliably: the step nonlinearity inherited from the threshold neuron had no usable gradient, and training networks with more than one adaptive layer remained open until Paul Werbos derived the reverse-mode gradient method in the early 1970s and David Rumelhart, Geoffrey Hinton, and Ronald Williams popularized it in 1986.”
Reasoning
E1 and E2 state that Rosenblatt's 1962 book discussed perceptrons with several layers and proposed rules for passing error signals back to hidden units. E3 and E4 state that his multi-layer heuristics did not work reliably. They also state that training multi-layer networks stayed unsolved until Werbos in the early 1970s and the popularization of backpropagation in 1986, about two decades later. This meets the criteria for both Rosenblatt's advocacy and the multi-decade timing, though the evidence comes from wiki-type secondary sources.
Cite this claim
Ray Kurzweil, “It took decades before multi-layer neural nets demonstrated that Rosenblatt's view on layered perceptrons was right.” (said March 2017). Verdict: resolved true. Reliability API, claim c_10fddf5a5442, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_10fddf5a5442
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Ray Kurzweil
-
Mostly false
“That was not true a year ago. But that’s true today.”
-
Mixed
“AI hallucinations are still there, but are becoming much less frequent.”
AI hallucinations persist but are becoming much less frequent.
-
Mostly true
“And it’s going very, very quickly — at an exponential rate”
AI progress is advancing very quickly, at an exponential rate.
-
Mostly true
“It was not quite as good, but you could recognize it as Mozart or as Chopin.”
-
Mostly true
“Yes, it was very much for AI.”
The prizes received by Geoffrey Hinton and by Demis Hassabis and John Jumper were very much for AI.
Verdicts are made automatically; how verdicts are made.