ClaimsYann LeCun

“However in many problems labeled data is scarce whereas unlabeled data is abundant.”

Yann LeCun, co-author of paper 2010 Convolutional Networks and Applications in Vision (yann.lecun.com) archived copy

Factual AI capabilities

In many problems labeled data is scarce whereas unlabeled data is abundant.

Resolved true The record shows it happened or was so.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The second judge would not resolve this claim; the verdict shown is the first judge's.

What would count as true or false

Judge as of 2010. True: the machine learning literature of that time (for example, surveys of semi-supervised and unsupervised learning) widely recognises that in many practical problems labelled examples are costly and scarce, while unlabelled data is plentiful. Mostly true: this holds broadly, but 'many problems' slightly overstates how common it was. Mixed: the situation applied in some important domains but not in roughly as many others, so it is only half right as a general statement. Mostly false: it was true only in a few niche cases and is presented as general. False: the evidence shows that labelled data was generally not scarce compared with unlabelled data in the problems the field dealt with.

Set before the research began.

Evidence (4)

  1. E1 Semi-supervised Learning Google Books (listing for Chapelle, Schölkopf, Zien)

    “Interest in SSL has increased in recent years, particularly because of application domains in which unlabeled data are plentiful, such as images, text, and bioinformatics.”
  2. E2 IR-Lab Project of Yanjun Qi (Fall 2004) Carnegie Mellon University (Yanjun Qi, IR-Lab project page) · 3 February 2004

    “Large amounts of unlabeled data are available in many real-life data-mining tasks.”
  3. E3 IR-Lab Project of Yanjun Qi (Fall 2004) Carnegie Mellon University (Yanjun Qi, IR-Lab project page) · 3 February 2004

    “unlabeled data does not help classification when the unlabeled data distribution does not relate to the classification task”
  4. E4 [PDF] Semisupervised learning - learning from labeled and unlabeled data Indian Statistical Institute, Bangalore (Saroj K. Meher slides)

    “Labeled data are expensive and limited that motivates to use”

Reasoning

E2 is a 2004 literature review of semi-supervised learning. It states that large amounts of unlabeled data are available in many real-life data-mining tasks. E1, the Google Books description of the semi-supervised learning book by Chapelle, Schölkopf and Zien, ties growing interest in the field to application domains where unlabeled data are plentiful, such as images, text and bioinformatics. E4 says labeled data are expensive and limited, though it is undated and so carries less weight. Taken together, these independent sources support the claim that in many problems labeled data is expensive and limited while unlabeled data is plentiful [E1][E2][E4], though only E2 is dated before 2010. E3's caveat is about whether unlabeled data helps, not how scarce labeled data is.

Cite this claim

Yann LeCun, “In many problems labeled data is scarce whereas unlabeled data is abundant.” (said 2010). Verdict: resolved true. Reliability API, claim c_ef76e8af4793, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_ef76e8af4793

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Yann LeCun, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Yann LeCun

  1. Mostly true Factual 18 March 2024
    “For starters, transformers are equivariant to permutations.”

    Transformers are equivariant to permutations, as ConvNets are equivariant to translations.

  2. Mostly true Factual 14 March 2024
    “If it were the case, we would have AI systems that could teach themselves to drive a car in 20 hours of practice, like any 17 year-old.”

    There are currently no AI systems that can teach themselves to drive a car in about 20 hours of practice, as a 17-year-old can.

  3. Mostly true Factual 8 March 2024
    “The architecture is good, the architecture of the encoder is good, but the fact that you train the system to reconstruct images does not lead it to produce to long, good generic features of images.”

    Training an encoder to reconstruct images does not lead it to produce good generic image features, though the encoder architecture is good.

  4. Mostly true Factual 8 March 2024
    “LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world.”

    Current LLMs can do none of understanding the physical world, persistent memory, reasoning and planning, or only in a very primitive way.

  5. Mostly true Factual 8 March 2024
    “No, there’s one thing that autoregressive LLMs or that LLMs in general, not just the autoregressive one, but including the bird style bidirectional ones, are exploiting and its self supervised…”

    LLMs, including BERT-style bidirectional ones, exploit self-supervised learning, and LeCun has been a very strong advocate of self-supervised learning for many years.

All of them

Verdicts are made automatically; how verdicts are made.