The notions of partition functions, entropy, free energy and variational methods prevalent in the graphical models literature come from statistical physics.
Mostly true True in substance, wrong in a detail.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
True if the history of science shows that partition functions, entropy, free energy and variational methods, as used in graphical models, came from statistical physics (Gibbs/Boltzmann distributions, mean-field and variational free energy, Bethe approximations). Mostly true if most of these came from statistical physics but one has a significant partly separate lineage, for example entropy through Shannon's information theory or variational methods through the calculus of variations, as long as the statistical-physics origin of the concepts as used in graphical models still holds. Mixed if only about half of the listed notions can be traced to statistical physics. Mostly false if most of them came mainly from other fields. False if none did.
Set before the research began.
Evidence (4)
-
E1 Advances in Variational Inference arXiv (ar5iv rendering), authors from Microsoft Research, KTH, UC Irvine
“The origins of VI date back to the 1980s. Mean field methods, for instance, have their origins in statistical physics, where they played a prominent role in the statistical mechanics of spin glasses [121, 147].”
-
E2 An Introduction to Variational Methods for Graphical Models Machine Learning journal (Kluwer), by Jordan, Ghahramani, Jaakkola, Saul · 1999
“In keeping with statistical mechanical terminology we will refer to this sum as a “partition function.””
-
E3 An Introduction to Variational Methods for Graphical Models Machine Learning journal (Kluwer), by Jordan, Ghahramani, Jaakkola, Saul · 1999
“The terminology comes from the roots of the techniques in the calculus of variations.”
-
E4 Entropy in thermodynamics and information theory - Wikipedia Wikipedia · 5 December 2005
“Because the mathematical expressions for information theory developed by Claude Shannon and Ralph Hartley in the 1940s are similar to the mathematics of statistical thermodynamics worked out by Ludwig Boltzmann and J. Willard Gibbs in the 1870s, in which the concept of entropy is central, Shannon was persuaded to employ the same term 'entropy' for his measure of uncertainty.”
Reasoning
E2 says the "partition function" in graphical models is named in keeping with statistical-mechanics terminology. E1 says mean-field methods have their origins in statistical physics, where they played a prominent role in the statistical mechanics of spin glasses. Two notions also have partly separate lineages. E3 says the variational terminology comes from the calculus of variations, and E4 says information-theoretic entropy was developed by Shannon, who borrowed the name from Boltzmann–Gibbs thermodynamics. No item speaks directly to free energy, but the evidence still mostly supports a statistical-physics origin, which fits the criteria for mostly true.
Cite this claim
Yann LeCun, “The notions of partition functions, entropy, free energy and variational methods prevalent in the graphical models literature come from statistical physics.” (said 15 May 2014). Verdict: mostly true. Reliability API, claim c_0d5a68991312, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_0d5a68991312
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Yann LeCun
-
Mostly true
“No one uses generalization bounds to do model selection.”
No one uses generalization bounds to do model selection; practitioners use cross-validation.
-
Resolved true
“The idea is rooted in Hubel and Wiesel’s classic 1962 work on the cat’s primary visual cortex.”
-
Resolved true
“This loss is always positive, since the second term is a lower bound on the first term.”
-
Resolved false
““Those agents are doing exactly what they’ve been asked to do,” LeCun said.”
-
Resolved true
““It’s AI for the physical world, so it’s not language-related,” LeCun said.”
AMI Labs' work is AI for the physical world and is not language-related.
Verdicts are made automatically; how verdicts are made.