Claims

2,653 claims by 33 public figures and organisations, checked against the public record. Each has its quote, source, verdict and evidence. Read them without a key; browse by person.

28,548 claims, sorted by newest said. Choose a claim to read it in full.
VerdictPersonKindSaidClaimTopic
Not researched Yann LeCun Factual 8 Mar 2024 The Ottoman Empire banned the printing press for 200 years, only for Arabic-language printing. Yann LeCun · Factual · 8 Mar 2024 Philosophy, ethics and society
Unresolvable Yann LeCun Prediction 8 Mar 2024 In future, people will interact with persuasive bad actors through their own AI assistants, which will be as smart as the actors' systems. Yann LeCun · Prediction · 8 Mar 2024 AI safety and alignment
Unresolvable Yann LeCun Prediction 8 Mar 2024 LeCun said there is ample evidence that generative models will not be able to learn good representations of the real world. Yann LeCun · Prediction · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 So it’s going to be impossible to produce systems that are unbiased for everyone. Yann LeCun · Not checkable · 8 Mar 2024
Not researched Yann LeCun Factual 8 Mar 2024 Meta's business model is to offer services financed either through ads or through business customers. Yann LeCun · Factual · 8 Mar 2024 Economics and markets
Not researched Yann LeCun Factual 8 Mar 2024 As of March 2024, LLMs with vision extensions don't really understand intuitive physics. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not researched Yann LeCun Factual 8 Mar 2024 Large language models are trained purely from text. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 I haven’t been that excited about the direction of machine learning and AI since 10 years ago when Fairway was started. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 I just think that most of the information of this type that we have accumulated when we were babies, it’s just not present in text, in any… Yann LeCun · Not checkable · 8 Mar 2024
Not researched Yann LeCun Factual 8 Mar 2024 Government and military organizations are not particularly innovative in AI and are far behind industry. Yann LeCun · Factual · 8 Mar 2024 AI policy and governance
Not checkable Yann LeCun Not checkable 8 Mar 2024 So it’s much better to do an optimization in continuous space where you can do gradient and descent as opposed to generate tons of things… Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 So LLMs or vision systems that are trained by reconstruction generate the inputs. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 So I share that feeling, I think people are fundamentally good. Yann LeCun · Not checkable · 8 Mar 2024
Unresolvable Yann LeCun Prediction 8 Mar 2024 Without world models that let systems learn how the world works, there will be no significant progress in robotics. Yann LeCun · Prediction · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 I thought it was because the rulers just wanted to preserve the control over the population and the religious dogma and everything. Yann LeCun · Not checkable · 8 Mar 2024
Mostly true Yann LeCun Factual 8 Mar 2024 Current LLMs can do none of understanding the physical world, persistent memory, reasoning and planning, or only in a very primitive way. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 we cannot afford those systems to come from a handful of companies on the west coast of the US because those systems will constitute the… Yann LeCun · Not checkable · 8 Mar 2024
Not researched Yann LeCun Factual 8 Mar 2024 With contrastive methods, if the output space is large, the number of contrasting samples needed is gigantic. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not researched Yann LeCun Factual 8 Mar 2024 LeCun said that LLMs can be thought of as doing a very simple form of optimization in the discrete space of possible token sequences. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Unresolvable Yann LeCun Prediction 8 Mar 2024 AI safety guardrails will be developed through a progressive, iterative design process. Yann LeCun · Prediction · 8 Mar 2024 AI safety and alignment
Not checkable Yann LeCun Not checkable 8 Mar 2024 If we eventually have systems that are built with this blueprint, we can put guardrails in those systems that guarantee that there is a… Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 But objectively-driven AI, so systems that derive their answers by optimization of an objective means they have to optimize this objective… Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 I see the danger of this concentration of power through proprietary AI systems as a much bigger danger than everything else. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 So it’s essentially impossible for systems like this that can inevitably formulate political opinions, and opinions about various things… Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 And so the proper way to train a system is to first have it learn good representations of the world and world models from mostly… Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 And some of that work has been incredibly successful. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 It doesn’t think about its answer really. It retrieves it because it’s accumulated a lot of knowledge. Yann LeCun · Not checkable · 8 Mar 2024
Unresolvable Yann LeCun Prediction 8 Mar 2024 Training on large data sets may turn out to be necessary for world-model systems to have emergent properties like LLMs. Yann LeCun · Prediction · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 So the only way you’re going to have an AI industry, the only way you’re going to have AI systems that are not uniquely biased is if you… Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 I think it should not be abandoned completely, but I think it’s use should be minimized because it’s incredibly inefficient in terms of… Yann LeCun · Not checkable · 8 Mar 2024
Not researched Yann LeCun Factual 8 Mar 2024 LLMs predict tokens, which are subword units, rather than whole words. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not researched Yann LeCun Factual 8 Mar 2024 In the last three to four years, non-contrastive self-supervised methods that do not require negative contrastive samples have been developed. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 I would argue most of our knowledge is derived from that interaction with the physical world. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 So the short answer is no Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 There is an abstract representation of imagining the reaction of a reader to that text. Yann LeCun · Not checkable · 8 Mar 2024
Not researched Yann LeCun Factual 8 Mar 2024 Through sensory input humans take in far more information than through language (about 10^15 bytes for a four-year-old versus 2x10^13 bytes for 170,000 years of reading). Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not researched Yann LeCun Factual 8 Mar 2024 If token errors are independent, the probability of staying within correct answers decreases exponentially with each token produced. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 They’re not going to be able to plan for situations where that they never encountered before. Yann LeCun · Not checkable · 8 Mar 2024
Not researched Yann LeCun Factual 8 Mar 2024 LeCun's team could not get pixel-predicting generative models to learn good representations of images. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 So making people smarter, we just can only be better. Yann LeCun · Not checkable · 8 Mar 2024
Not researched Yann LeCun Factual 8 Mar 2024 DINO and I-JEPA were developed at FAIR and work well for learning image representations. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 But there are limitations to those contrastive methods. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 Alan Turing would decide that a Turing test is a really bad test, okay? Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 The design is all about safety, because a better turbojet is also a safer turbojet, so a more reliable one. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 That’s just not acceptable, it’s a danger to democracy regardless of how well-intentioned those companies are, and it’s also a danger to… Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 Well, that’s exactly why we need open source platforms. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 I’m clearly in the camp that yes, intelligence cannot appear without some grounding in some reality. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 So that, I think, is an essential component of an intelligent system. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 Don’t think it’s just Moravec’s paradox. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 So now you can do what LMS cannot do, which is planning what you’re going to do. Yann LeCun · Not checkable · 8 Mar 2024
Not researched Yann LeCun Factual 8 Mar 2024 As of March 2024, nobody knows how to train an AI system to learn multiple levels of representation for hierarchical planning. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not researched Yann LeCun Factual 8 Mar 2024 Meta developed Wav2Vec, a joint embedding architecture trained with contrastive learning, which achieved success in speech recognition. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 Well, there’s a lot of situations that might be difficult to, for a purely language based system to know. Yann LeCun · Not checkable · 8 Mar 2024
Unresolvable Yann LeCun Prediction 8 Mar 2024 World models for predicting how the world evolves cannot be built with generative models. Yann LeCun · Prediction · 8 Mar 2024 AI capabilities
Not researched Yann LeCun Factual 8 Mar 2024 A growing number of studies indicate that LLMs do not help people design or build bioweapons or chemical weapons beyond what search engines and libraries provide. Yann LeCun · Factual · 8 Mar 2024 Biosecurity
Unresolvable Yann LeCun Prediction 8 Mar 2024 Future AI systems that can plan and reason will not rely on "regressive prediction of tokens" but on something "more akin to inference of little variables" in what used to be called probabilistic or graphical models. Yann LeCun · Prediction · 8 Mar 2024 AI capabilities
Not researched Yann LeCun Factual 8 Mar 2024 LLaMA 2 has had millions of downloads and thousands of people have contributed ideas to improve it. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 No, it’s basically a struggle against the curse of dimensionality. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 A lot of it is similar, and LLMs don’t have that. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 There is another set of methods which are non-contrastive, and I prefer those Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 So certainly LLMs are going to be able to do this, but then how you link this from the low level of actions, that needs to be done with… Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 So having machines that are smarter than us, that assist us in all of our tasks, our daily lives, whether it’s professional or personal, I… Yann LeCun · Not checkable · 8 Mar 2024
Not researched Yann LeCun Factual 8 Mar 2024 Image features learned by self-supervised reconstruction of corrupted images are not good; supervised training with text descriptions gives better recognition performance. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 I don’t think anyone today would say that the invention of the printing press had a overall negative effect despite the fact that it… Yann LeCun · Not checkable · 8 Mar 2024
Not researched Yann LeCun Factual 8 Mar 2024 LLMs don't really have persistent memory. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 Big companies are really careful about not producing things of this type because they don’t want to hurt anyone, first of all, and then… Yann LeCun · Not checkable · 8 Mar 2024
Unresolvable Yann LeCun Prediction 8 Mar 2024 Human-level AI (AGI) will not arrive as a single discrete event. Yann LeCun · Prediction · 8 Mar 2024 AI timelines and forecasting
Not researched Yann LeCun Factual 8 Mar 2024 Current LLMs cannot do deliberate planning using an internal world model (system two). Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 And we’re talking about inference, we’re not talking about training, the system has been trained already. Yann LeCun · Not checkable · 8 Mar 2024
Unresolvable Yann LeCun Prediction 8 Mar 2024 Before reaching human-level AI, we will first have systems with the characteristics of human-level intelligence but at the intelligence level of a cat or parrot. Yann LeCun · Prediction · 8 Mar 2024 AI timelines and forecasting
Not checkable Yann LeCun Not checkable 8 Mar 2024 No, I don’t think the issue has to do with the political leaning of the people designing those systems. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 So we can’t just only model everything at the lowest level. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 We specify what the proper levels of abstraction, the representation at each level of abstraction have to be. Yann LeCun · Not checkable · 8 Mar 2024
Mostly true Yann LeCun Factual 8 Mar 2024 LLMs, including BERT-style bidirectional ones, exploit self-supervised learning, and LeCun has been a very strong advocate of self-supervised learning for many years. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 But it’s not a question of being impressed or not, it’s the question of knowing what the limit of those systems can do. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 science makes progress when people disagree and they come up with an answer and consensus forms Yann LeCun · Not checkable · 8 Mar 2024
Unresolvable Yann LeCun Prediction 8 Mar 2024 The French government will not accept its citizens' digital information diet being controlled by three US west coast companies. Yann LeCun · Prediction · 8 Mar 2024 AI policy and governance
Not checkable Yann LeCun Not checkable 8 Mar 2024 That’s one of the reasons you need experience of the physical world, which is much higher bandwidth than what you can express in words, in… Yann LeCun · Not checkable · 8 Mar 2024
Not researched Yann LeCun Factual 8 Mar 2024 It took decades to fine-tune the design of turbojets so that they were safe, rather than deriving a general safety principle. Yann LeCun · Factual · 8 Mar 2024 AI safety and alignment
Unresolvable Yann LeCun Prediction 8 Mar 2024 Every interaction people have with the digital world will be mediated by AI systems and AI assistants. Yann LeCun · Prediction · 8 Mar 2024 AI capabilities
Not researched Yann LeCun Factual 8 Mar 2024 It is not known how to represent distributions over high-dimensional, continuous spaces in useful ways. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 Even if you have a team of 50 engineers that are really experienced building it, you’re still going to have to blow up a dozen of them… Yann LeCun · Not checkable · 8 Mar 2024
Unresolvable Yann LeCun Prediction 8 Mar 2024 Whenever an AI breakthrough occurs, it will be widely disseminated very quickly. Yann LeCun · Prediction · 8 Mar 2024 AI timelines and forecasting
Not checkable Yann LeCun Not checkable 8 Mar 2024 There’s a few breakthroughs that we have to basically go through before we can get there, but you’ll be able to monitor our progress… Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 if you expect the system to become intelligent just without having the possibility of doing those things, you’re making a mistake. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 I don’t hate reinforcement learning Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 It doesn’t need to be physical reality. It could be simulated, but the environment is just much richer than what you can express in… Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 And the answer is the same answer that we found in liberal democracy about the press, the press needs to be free and diverse. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 I think people are fundamentally good and in fact, a lot of doomers are doomers because they don’t think that people are fundamentally good. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 but there is a lot of things they cannot do, and we have to realize what they cannot do and then figure out how we get there. Yann LeCun · Not checkable · 8 Mar 2024
Resolved true Eliezer Yudkowsky Factual 8 Mar 2024 A social media company added a feature allowing easy phone calls to Congress. Eliezer Yudkowsky · Factual · 8 Mar 2024 Technology
Not researched Yann LeCun Factual 8 Mar 2024 LLMs can't really reason and certainly can't plan. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Unresolvable Yann LeCun Prediction 8 Mar 2024 The vast majority of AI systems will be built on top of open source platforms. Yann LeCun · Prediction · 8 Mar 2024 AI policy and governance
Not researched Yann LeCun Factual 8 Mar 2024 LLMs implicitly prevent collapse by giving low probability to other words when a word gets high probability, since probabilities sum to one. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Not checkable Yann LeCun Not checkable 8 Mar 2024 And if some of those top systems are open source, anybody can use them, anybody can fine tune them. Yann LeCun · Not checkable · 8 Mar 2024
Unresolvable Yann LeCun Prediction 8 Mar 2024 If some AI goes rogue, well-controlled AI systems will be used against it. Yann LeCun · Prediction · 8 Mar 2024 AI safety and alignment
Not checkable Yann LeCun Not checkable 8 Mar 2024 And so you cannot have an unbiased system, that’s just an impossibility. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 So what you want is your encoder to basically eliminate all those details. Yann LeCun · Not checkable · 8 Mar 2024
Not checkable Yann LeCun Not checkable 8 Mar 2024 The kind of thinking you’re doing has absolutely nothing to do with language really. Yann LeCun · Not checkable · 8 Mar 2024
Not researched Yann LeCun Factual 8 Mar 2024 Text is discrete, whereas video is high-dimensional and continuous. Yann LeCun · Factual · 8 Mar 2024 AI capabilities
Back to the list

Yann LeCun

Open its page

Factual AI capabilities

“The problem with this is, if the space of Y is large, the number of such contrasting samples are going to have to show is gigantic.”

Yann LeCun, interviewee 8 March 2024 Transcript for Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI (Lex Fridman Podcast)

With contrastive methods, if the output space is large, the number of contrasting samples needed is gigantic.

Not researched Checkable, but outside the sample that was researched.

Cite this claim

Yann LeCun, “With contrastive methods, if the output space is large, the number of contrasting samples needed is gigantic.” (said 8 March 2024). Verdict: not researched. Reliability API, claim c_86d76ce6b28f, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_86d76ce6b28f

Verdicts are made automatically; how verdicts and scores are made. The same data is on Hugging Face under CC BY 4.0.