ClaimsYann LeCun

“This loss function is a continuous approximation of the number of classification errors.”

Yann LeCun et al., tutorial authors 2006 A Tutorial on Energy-Based Learning (yann.lecun.com) archived copy

Factual AI capabilities

The LVQ2 loss is a continuous approximation of the number of classification errors.

Unresolvable The public record could not settle it.

Factual: Statements about the present or the past, checked against the record: did they hold up?

What would count as true or false

True if the LVQ2 loss as defined in the source (LeCun et al. 2006, 'A Tutorial on Energy-Based Learning') and the related literature is a continuous function approximating the count of misclassifications, as with a saturating, clipped ratio or difference of distances to the correct and nearest incorrect prototypes. Mostly true if it is described as an approximation of the error count but is only piecewise-continuous, or approximates errors only within a window. Mixed or mostly false if it relates to classification errors only loosely. False if it does not approximate the number of errors at all.

Set before the research began.

Evidence (4)

  1. E1 Minimum classification error rate methods for speech recognition IEEE Transactions on Speech and Audio Processing (authors Juang, Chou, Lee; hosted on SciSpace) · May 1997

    “is positive, it leads to a penalty which becomes essentially a classification/recognition error count.”
  2. E2 A Review of Learning Vector Quantization Classifiers arXiv (ar5iv rendering)

    “But this algorithm makes corrections that are dependent on error only, and present some instabilities.”
  3. E3 A Review of Learning Vector Quantization Classifiers arXiv (ar5iv rendering)

    “The original LVQ algorithm does not have an associated cost function to ensure convergence. Some improvements such as LVQ2.1, LVQ3 or OLVQ Kohonen 1990 aim at achieving higher convergence speed or better approximation of the Bayesian borders. All these LVQ versions are based on Hebbian learning, i.e., are heuristic.”
  4. E4 A Review of Learning Vector Quantization Classifiers arXiv (ar5iv rendering)

    “This is because LVQ 2.1 does not have a associated functional and it is very sensitive to the initial condition of the prototypes.”

Reasoning

None of the evidence quotes the LVQ2 loss as LeCun et al. (2006) define it, so the claimed properties cannot be checked against that definition. E1 is about minimum classification error methods, where a smoothed penalty becomes essentially an error count, but it does not mention LVQ2. E3 says the original LVQ algorithm has no associated cost function and that LVQ versions such as LVQ2.1, LVQ3 and OLVQ are heuristic. E4 says LVQ 2.1 has no associated functional. E2 says only that an LVQ algorithm makes corrections that depend on error only and shows some instabilities. That describes Kohonen's update rules, not the loss formulation in the tutorial, so it neither confirms nor refutes the claim.

Cite this claim

Yann LeCun, “The LVQ2 loss is a continuous approximation of the number of classification errors.” (said 2006). Verdict: unresolvable. Reliability API, claim c_ae7b8f708c78, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_ae7b8f708c78

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Yann LeCun, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Yann LeCun

  1. Mostly true Factual 18 March 2024
    “For starters, transformers are equivariant to permutations.”

    Transformers are equivariant to permutations, as ConvNets are equivariant to translations.

  2. Mostly true Factual 14 March 2024
    “If it were the case, we would have AI systems that could teach themselves to drive a car in 20 hours of practice, like any 17 year-old.”

    There are currently no AI systems that can teach themselves to drive a car in about 20 hours of practice, as a 17-year-old can.

  3. Mostly true Factual 8 March 2024
    “The architecture is good, the architecture of the encoder is good, but the fact that you train the system to reconstruct images does not lead it to produce to long, good generic features of images.”

    Training an encoder to reconstruct images does not lead it to produce good generic image features, though the encoder architecture is good.

  4. Mostly true Factual 8 March 2024
    “LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world.”

    Current LLMs can do none of understanding the physical world, persistent memory, reasoning and planning, or only in a very primitive way.

  5. Mostly true Factual 8 March 2024
    “No, there’s one thing that autoregressive LLMs or that LLMs in general, not just the autoregressive one, but including the bird style bidirectional ones, are exploiting and its self supervised…”

    LLMs, including BERT-style bidirectional ones, exploit self-supervised learning, and LeCun has been a very strong advocate of self-supervised learning for many years.

All of them

Verdicts are made automatically; how verdicts are made.