All modules of the proposed architecture are fully differentiable.
Mostly true True in substance, wrong in a detail.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
Identify the architecture proposed in the June 2023 source document (likely the modular autonomous-intelligence / latent-variable energy-based architecture described in LeCun's work). TRUE: every module the document describes (e.g., perception, world model, cost, critic, actor, configurator) is a differentiable function, so gradients can flow through all of them. MOSTLY TRUE: all core modules are differentiable and only a minor or optional component is not, or needs a standard relaxation. MIXED: several named modules are differentiable and several are not. MOSTLY FALSE: the core design depends on non-differentiable steps (e.g., discrete search or discrete latent variables) for key modules, though some modules are differentiable. FALSE: the architecture as described has mainly non-differentiable modules.
Set before the research began.
Evidence (4)
-
E1 Yann LeCun on a vision to make AI systems learn and reason like animals and humans Meta AI · 23 February 2022 Own record
“LeCun proposes an architecture composed of six separate modules. Each is assumed to be differentiable, in that it can easily compute gradient estimates of some objective function with respect to its own input and propagate the gradient information to upstream modules.”
-
E2 Safety Implications of LeCun's path to machine intelligence — LessWrong LessWrong (post by Ivan Vendrov) · 15 July 2022
“With the exception of the Actor and the Intrinsic Cost (see below) they are all deep neural networks trained with gradient descent.”
-
E3 Yann LeCun on a vision to make AI systems learn and reason like animals and humans Meta AI · 23 February 2022 Own record
“Additionally, the information content of the latent variable is minimized by making it discrete, low-dimensional, sparse, or noisy.”
-
E4 Yann LeCun on a vision to make AI systems learn and reason like animals and humans Meta AI · 23 February 2022 Own record
“But many other aspects of the architecture are still to be defined, including how precisely to train the critic, how to construct and train the configurator”
Reasoning
Meta AI's summary of LeCun's six-module architecture says that each module is assumed to be differentiable and can pass gradient estimates to upstream modules (E1). The independent LessWrong summary says that every module except the Actor and the Intrinsic Cost is a deep neural network trained with gradient descent (E2). That marks those two modules as not learned networks, but it does not say they are non-differentiable. Two qualifications apply: the latent variable may be made discrete, which would need a relaxation (E3), and the configurator and critic training had not yet been worked out (E4). So the design treats the core modules as differentiable, but full differentiability of every component is not fully established.
Cite this claim
Yann LeCun, “All modules of the proposed architecture are fully differentiable.” (said June 2023). Verdict: mostly true. Reliability API, claim c_ee2bd11bd1f6, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_ee2bd11bd1f6
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Yann LeCun
-
Mostly true
“For starters, transformers are equivariant to permutations.”
Transformers are equivariant to permutations, as ConvNets are equivariant to translations.
-
Mostly true
“If it were the case, we would have AI systems that could teach themselves to drive a car in 20 hours of practice, like any 17 year-old.”
-
Mostly true
“The architecture is good, the architecture of the encoder is good, but the fact that you train the system to reconstruct images does not lead it to produce to long, good generic features of images.”
-
Mostly true
“LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world.”
-
Mostly true
“No, there’s one thing that autoregressive LLMs or that LLMs in general, not just the autoregressive one, but including the bird style bidirectional ones, are exploiting and its self supervised…”
Verdicts are made automatically; how verdicts are made.