ClaimsYann LeCun

“Support vector Markov models, max-margin Markov networks, and conditional random fields are all sequence modeling systems that use linearly parameterized energy factors.”

Yann LeCun et al., tutorial authors 2006 A Tutorial on Energy-Based Learning (yann.lecun.com) archived copy

Factual AI capabilities

Support vector Markov models, max-margin Markov networks and conditional random fields are all sequence modeling systems that use linearly parameterized energy factors.

Mostly true True in substance, wrong in a detail.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The second judge would not resolve this claim; the verdict shown is the first judge's.

What would count as true or false

True if the standard formulations (as of 2006) of support vector Markov models (SVMM / hidden Markov SVMs), max-margin Markov networks and conditional random fields all define sequence models whose energy or score factors are linear in the parameters (weights times fixed feature functions). Mostly true if this holds for the standard forms of all three with a minor caveat, such as kernelized or nonlinear variants. Mixed if it holds for only some of the three. Mostly false if the factors are linear only in special cases. False if these models are shown not to use linearly parameterized factors in their standard form.

Set before the research began.

Evidence (4)

  1. E1 Max-Margin Markov Networks NeurIPS (Taskar, Guestrin, Koller; Stanford University) · 2003

    “Our approach defines a log-linear Markov network over a set of label variables (e.g., the labels of the letters in an OCR problem); this network allows us to represent the correlations between these label variables.”
  2. E2 Max-Margin Markov Networks NeurIPS (Taskar, Guestrin, Koller; Stanford University) · 2003

    “For margin-based methods (SVMs and M3), we were able to use kernels (both quadratic and cubic were evaluated) to increase the dimensionality of the feature space.”
  3. E3 Large Margin Methods for Structured and Interdependent Output Variables Journal of Machine Learning Research · September 2005

    “For both perceptron and SVM a second degree polynomial kernel was used.”
  4. E4 Conditional Neural Fields NeurIPS · 11 September 2009

    “CRF models use linear potential functions to represent the relationship between input features and outputs.”

Reasoning

E1 shows that max-margin Markov networks define a log-linear Markov network over label variables, so their factors are linear in the parameters. E4 states that CRF models use linear potential functions linking input features to outputs. The structured-output SVM experiments (E3) and the M3 experiments (E2) used polynomial kernels, which shows that kernelized variants were in use. That is a minor caveat on the 'linear in fixed features' framing, and the quotes do not spell out the linear form for support vector Markov models directly.

Cite this claim

Yann LeCun, “Support vector Markov models, max-margin Markov networks and conditional random fields are all sequence modeling systems that use linearly parameterized energy factors.” (said 2006). Verdict: mostly true. Reliability API, claim c_3d6620bff5bb, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_3d6620bff5bb

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Yann LeCun, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Yann LeCun

  1. Mostly true Factual 18 March 2024
    “For starters, transformers are equivariant to permutations.”

    Transformers are equivariant to permutations, as ConvNets are equivariant to translations.

  2. Mostly true Factual 14 March 2024
    “If it were the case, we would have AI systems that could teach themselves to drive a car in 20 hours of practice, like any 17 year-old.”

    There are currently no AI systems that can teach themselves to drive a car in about 20 hours of practice, as a 17-year-old can.

  3. Mostly true Factual 8 March 2024
    “The architecture is good, the architecture of the encoder is good, but the fact that you train the system to reconstruct images does not lead it to produce to long, good generic features of images.”

    Training an encoder to reconstruct images does not lead it to produce good generic image features, though the encoder architecture is good.

  4. Mostly true Factual 8 March 2024
    “LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world.”

    Current LLMs can do none of understanding the physical world, persistent memory, reasoning and planning, or only in a very primitive way.

  5. Mostly true Factual 8 March 2024
    “No, there’s one thing that autoregressive LLMs or that LLMs in general, not just the autoregressive one, but including the bird style bidirectional ones, are exploiting and its self supervised…”

    LLMs, including BERT-style bidirectional ones, exploit self-supervised learning, and LeCun has been a very strong advocate of self-supervised learning for many years.

All of them

Verdicts are made automatically; how verdicts are made.