ClaimsYann LeCun

“The peak doesn't show up with multilayer nets because they are implicitly regularized.”

Yann LeCun, posting on X 9 August 2020 Post by @ylecun on X, 2020-08-09 (X)

Factual Science and research methods

The double descent test-error peak does not appear with multilayer neural networks because they are implicitly regularized.

Unresolvable The public record could not settle it.

Factual: Statements about the present or the past, checked against the record: did they hold up?

Reasoning

The claim gives a causal explanation of why the double-descent peak does not appear in multilayer nets, and the material available here has no evidence that settles whether implicit regularization is the reason.

Cite this claim

Yann LeCun, “The double descent test-error peak does not appear with multilayer neural networks because they are implicitly regularized.” (said 9 August 2020). Verdict: unresolvable. Reliability API, claim c_7de0e13eeb6e, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_7de0e13eeb6e

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Yann LeCun, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Yann LeCun

  1. Mostly true Factual 15 May 2014
    “The notions of partition functions, entropy, free energy, variational methods etc, that are so prevalent in the graphical models literature all come from statistical physics.”

    The notions of partition functions, entropy, free energy and variational methods prevalent in the graphical models literature come from statistical physics.

  2. Mostly true Factual 15 May 2014
    “No one uses generalization bounds to do model selection.”

    No one uses generalization bounds to do model selection; practitioners use cross-validation.

  3. Resolved true Factual 2010
    “The idea is rooted in Hubel and Wiesel’s classic 1962 work on the cat’s primary visual cortex.”

    The idea behind multi-stage Hubel-Wiesel architectures is rooted in Hubel and Wiesel's 1962 work on the cat's primary visual cortex.

  4. Resolved true Factual 2006
    “This loss is always positive, since the second term is a lower bound on the first term.”

    The generalized perceptron loss is always positive because its second term is a lower bound on its first term.

  5. Resolved false Factual 1 October 2026
    ““Those agents are doing exactly what they’ve been asked to do,” LeCun said.”

    The OpenAI agents involved in the Hugging Face hacking incident were doing exactly what they had been asked to do.

All of them

Verdicts are made automatically; how verdicts are made.