ClaimsYann LeCun

“Using this loss with GW (X) = W T X and a regularizer of the form ||W ||2 gives the familiar linear support vector machine.”

LeCun et al., tutorial authors 2006 A Tutorial on Energy-Based Learning (yann.lecun.com) archived copy

Factual AI capabilities

The hinge loss with G_W(X)=W^T X and a ||W||^2 regularizer gives the linear support vector machine.

Mostly true True in substance, wrong in a detail.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The second judge would not resolve this claim; the verdict shown is the first judge's.

The evidence is the person's or their organisation's own records.

What would count as true or false

Judge as a mathematical fact. True: minimising the hinge loss on a linear score W^T X (using the margin or label formulation in LeCun et al.'s 2006 energy-based learning tutorial) plus an L2 penalty ||W||^2 gives the standard soft-margin linear SVM objective. Mostly true: the equivalence holds up to minor details (a bias term, scaling constants, or a margin parameter). Mixed: it holds only under substantial extra assumptions. Mostly false: the resulting objective differs materially from the SVM. False: the formulation does not correspond to a linear SVM.

Set before the research began.

Evidence (3)

  1. E1 Yann LeCun NYU Courant Institute (talk slides, author's own) Own record

    “Linear Model + Margin Loss + Regularization = SVM”
  2. E2 Yann LeCun NYU Courant Institute (talk slides, author's own) Own record

    “Minimize the Regularization term: Make W as short as possible.”
  3. E3 Yann LeCun NYU Courant Institute (talk slides, author's own) Own record

    “You get a Support Vector Machine.”

Reasoning

The criteria ask for a judgement on the mathematics. Minimising the hinge loss max(0, m − Y·WᵀX) summed over samples, plus λ||W||², is the soft-margin linear SVM objective up to how the constants are scaled. The match is not exact because G_W(X)=WᵀX has no separate bias term, which the standard SVM includes. Under the criteria that is a minor detail, so the verdict is mostly true rather than true. LeCun's own slides (E1, E2, E3) say the same thing ("Linear Model + Margin Loss + Regularization = SVM"), but they are not independent, so the verdict rests on checking the mathematics, not on the slides.

Cite this claim

Yann LeCun, “The hinge loss with G_W(X)=W^T X and a ||W||^2 regularizer gives the linear support vector machine.” (said 2006). Verdict: mostly true. Reliability API, claim c_28b6f7d1d2e2, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_28b6f7d1d2e2

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Yann LeCun, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Yann LeCun

  1. Mostly true Factual 18 March 2024
    “For starters, transformers are equivariant to permutations.”

    Transformers are equivariant to permutations, as ConvNets are equivariant to translations.

  2. Mostly true Factual 14 March 2024
    “If it were the case, we would have AI systems that could teach themselves to drive a car in 20 hours of practice, like any 17 year-old.”

    There are currently no AI systems that can teach themselves to drive a car in about 20 hours of practice, as a 17-year-old can.

  3. Mostly true Factual 8 March 2024
    “The architecture is good, the architecture of the encoder is good, but the fact that you train the system to reconstruct images does not lead it to produce to long, good generic features of images.”

    Training an encoder to reconstruct images does not lead it to produce good generic image features, though the encoder architecture is good.

  4. Mostly true Factual 8 March 2024
    “LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world.”

    Current LLMs can do none of understanding the physical world, persistent memory, reasoning and planning, or only in a very primitive way.

  5. Mostly true Factual 8 March 2024
    “No, there’s one thing that autoregressive LLMs or that LLMs in general, not just the autoregressive one, but including the bird style bidirectional ones, are exploiting and its self supervised…”

    LLMs, including BERT-style bidirectional ones, exploit self-supervised learning, and LeCun has been a very strong advocate of self-supervised learning for many years.

All of them

Verdicts are made automatically; how verdicts are made.