A trained classifier may also correctly classify cars and dogs it has never seen before.
Mostly true True in substance, wrong in a detail.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
The claim is hedged ("may") and says a trained image classifier can generalise to new examples of known classes. Judge it as of 2015-02-18. True: research or standard benchmark practice at the time shows trained classifiers (for example ConvNets on ImageNet) correctly classifying held-out test images of cars and dogs not in their training set at high rates. Mostly true: generalisation was shown but with notable limits (for example only for some classes or conditions) that the hedge covers. Mixed: evidence of generalisation was weak or inconsistent at the time. Mostly false: classifiers at the time mostly failed on unseen instances, with only narrow exceptions. False: the evidence shows trained classifiers could not correctly classify unseen images of those categories.
Set before the research began.
Evidence (3)
-
E1 ImageNet Classification with Deep Convolutional Neural ... NeurIPS proceedings (Advances in Neural Information Processing Systems) · 2012
“On the test data, we achieved top-1 and top-5 error rates of 37.5%”
-
E2 ImageNet Classification with Deep Convolutional Neural ... NeurIPS proceedings (Advances in Neural Information Processing Systems) · 2012
“ILSVRC-2012 competition and achieved a winning top-5 test error rate of 15.3%,”
-
E3 ImageNet Classification with Deep Convolutional Neural ... NeurIPS proceedings (Advances in Neural Information Processing Systems) · 2012
“Most of the top-5 labels appear reasonable.”
Reasoning
The 2012 AlexNet paper reports that a trained ConvNet won the ILSVRC-2012 competition with a top-5 test error rate of 15.3% on held-out test data (E2), and that most of its top-5 labels on test images appear reasonable (E3). This shows trained classifiers generalising to images they had not seen. The same paper reports a top-1 test error of 37.5% (E1), and none of the quotes give results for cars or dogs specifically. That is a notable limit, which the claim's hedged 'may' covers.
Cite this claim
Yann LeCun, “A trained classifier may also correctly classify cars and dogs it has never seen before.” (said 18 February 2015). Verdict: mostly true. Reliability API, claim c_be8b7a0fd45d, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_be8b7a0fd45d
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Yann LeCun
-
Mostly true
“For starters, transformers are equivariant to permutations.”
Transformers are equivariant to permutations, as ConvNets are equivariant to translations.
-
Mostly true
“If it were the case, we would have AI systems that could teach themselves to drive a car in 20 hours of practice, like any 17 year-old.”
-
Mostly true
“The architecture is good, the architecture of the encoder is good, but the fact that you train the system to reconstruct images does not lead it to produce to long, good generic features of images.”
-
Mostly true
“LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world.”
-
Mostly true
“No, there’s one thing that autoregressive LLMs or that LLMs in general, not just the autoregressive one, but including the bird style bidirectional ones, are exploiting and its self supervised…”
Verdicts are made automatically; how verdicts are made.