Training an image-recognition neural network typically involves showing it millions of labelled images with known ground truth.
Resolved true The record shows it happened or was so.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
Judged as of 2018-07-15, as a statement about typical practice. True: the technical literature shows that image-recognition deep networks of that era (e.g. those trained on ImageNet, about 1.2 million labelled images in ILSVRC) were typically trained on on the order of millions of labelled images with known ground truth. Mostly true: typical training sets were large and labelled but often in the hundreds of thousands, or relied on pretraining on million-image sets, so 'millions' is a slight overstatement. Mixed: practice varied widely, with roughly as many typical cases using far fewer images. Mostly false: million-image labelled training was the exception, not the typical case. False: image-recognition networks were not typically trained on labelled data at that scale.
Set before the research began.
Evidence (4)
-
E1 ImageNet Classification with Deep Convolutional Neural Networks NeurIPS Proceedings (Krizhevsky, Sutskever, Hinton, University of Toronto) · 2012
“We trained a large, deep convolutional neural network to classify the 1.2 million high-resolution images in the ImageNet LSVRC-2010 contest into the 1000 different classes.”
-
E2 ImageNet Classification with Deep Convolutional Neural Networks NeurIPS Proceedings (Krizhevsky, Sutskever, Hinton, University of Toronto) · 2012
“Until recently, datasets of labeled images were relatively small — on the order of tens of thousands of images”
-
E3 ImageNet Large Scale Visual Recognition Challenge arXiv (Russakovsky et al.; ar5iv rendering)
“There are 1000 object classes and approximately 1.2 million training images, 50 thousand validation images and 100 thousand test images.”
-
E4 ImageNet Large Scale Visual Recognition Challenge arXiv (Russakovsky et al.; ar5iv rendering)
“Caltech 101 (Fei-Fei et al., 2004) was among the first standardized datasets for multi-category image classification, with 101 object classes and commonly 15-30 training images per class.”
Reasoning
The 2012 Krizhevsky, Sutskever and Hinton paper trained a deep convolutional network on the 1.2 million labelled images of the ImageNet LSVRC-2010 contest, sorted into 1000 classes (E1). The ILSVRC benchmark paper confirms about 1.2 million labelled training images across 1000 classes (E3). This matches the resolution criteria's own example of training "on the order of millions" of labelled images with known ground truth. E2 and E4 show that labelled datasets were much smaller before ImageNet, but that was earlier practice, not the deep-network practice of the period the claim describes.
Cite this claim
Rodney Brooks, “Training an image-recognition neural network typically involves showing it millions of labelled images with known ground truth.” (said 15 July 2018). Verdict: resolved true. Reliability API, claim c_343bea0e2fef, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_343bea0e2fef
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Rodney Brooks
-
Mostly true
“But since 1991 I have made a distinction between two concepts where a machine, or creature can be either, neither, or both situated and embodied.”
-
Mostly true
“Once the pick orientation and vacuum gripper selection has been made it is really an open loop as all the work is done by the indiscriminate force of suction and the mutual compliance of the gripper…”
-
Mostly true
“Each column from bottom to top is a pure feed forward network, with no search, no iteration, no conventional algorithm at all.”
-
Mostly true
“By March of 2023, it was clear that the next big thing had arrived in AI, and that it was Large Language Models.”
By March 2023 it was clear that large language models were the next big thing in AI.
-
Resolved true
“@yejinchoinka is providing a “common sense” rebuttal on the @TED stage.”
Yejin Choi gave a "common sense" rebuttal on the TED stage in April 2023.
Verdicts are made automatically; how verdicts are made.