In many problems labeled data is scarce whereas unlabeled data is abundant.
Resolved true The record shows it happened or was so.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
Judge as of 2010. True: the machine learning literature of that time (for example, surveys of semi-supervised and unsupervised learning) widely recognises that in many practical problems labelled examples are costly and scarce, while unlabelled data is plentiful. Mostly true: this holds broadly, but 'many problems' slightly overstates how common it was. Mixed: the situation applied in some important domains but not in roughly as many others, so it is only half right as a general statement. Mostly false: it was true only in a few niche cases and is presented as general. False: the evidence shows that labelled data was generally not scarce compared with unlabelled data in the problems the field dealt with.
Set before the research began.
Evidence (4)
-
E1 Semi-supervised Learning Google Books (listing for Chapelle, Schölkopf, Zien)
“Interest in SSL has increased in recent years, particularly because of application domains in which unlabeled data are plentiful, such as images, text, and bioinformatics.”
-
E2 IR-Lab Project of Yanjun Qi (Fall 2004) Carnegie Mellon University (Yanjun Qi, IR-Lab project page) · 3 February 2004
“Large amounts of unlabeled data are available in many real-life data-mining tasks.”
-
E3 IR-Lab Project of Yanjun Qi (Fall 2004) Carnegie Mellon University (Yanjun Qi, IR-Lab project page) · 3 February 2004
“unlabeled data does not help classification when the unlabeled data distribution does not relate to the classification task”
-
E4 [PDF] Semisupervised learning - learning from labeled and unlabeled data Indian Statistical Institute, Bangalore (Saroj K. Meher slides)
“Labeled data are expensive and limited that motivates to use”
Reasoning
E2 is a 2004 literature review of semi-supervised learning. It states that large amounts of unlabeled data are available in many real-life data-mining tasks. E1, the Google Books description of the semi-supervised learning book by Chapelle, Schölkopf and Zien, ties growing interest in the field to application domains where unlabeled data are plentiful, such as images, text and bioinformatics. E4 says labeled data are expensive and limited, though it is undated and so carries less weight. Taken together, these independent sources support the claim that in many problems labeled data is expensive and limited while unlabeled data is plentiful [E1][E2][E4], though only E2 is dated before 2010. E3's caveat is about whether unlabeled data helps, not how scarce labeled data is.
Cite this claim
Yann LeCun, “In many problems labeled data is scarce whereas unlabeled data is abundant.” (said 2010). Verdict: resolved true. Reliability API, claim c_ef76e8af4793, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_ef76e8af4793
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Yann LeCun
-
Mostly true
“For starters, transformers are equivariant to permutations.”
Transformers are equivariant to permutations, as ConvNets are equivariant to translations.
-
Mostly true
“If it were the case, we would have AI systems that could teach themselves to drive a car in 20 hours of practice, like any 17 year-old.”
-
Mostly true
“The architecture is good, the architecture of the encoder is good, but the fact that you train the system to reconstruct images does not lead it to produce to long, good generic features of images.”
-
Mostly true
“LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world.”
-
Mostly true
“No, there’s one thing that autoregressive LLMs or that LLMs in general, not just the autoregressive one, but including the bird style bidirectional ones, are exploiting and its self supervised…”
Verdicts are made automatically; how verdicts are made.