| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
We can make humanity smarter with AI.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So hierarchical planning is absolutely necessary if you want to plan complex actions.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So the first thing is LLMs will be able to answer some of those questions down to some level of abstraction, under the condition that…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
I mean certainly LLM would be able to solve that problem if you fine tune it for it.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
that’s basically in the realm of RL, this is what RL deals with to some extent, so adjust your word model.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
They can plan really complex actions and imagine the result of a bunch of actions.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Well, IQ can measure approximately something for humans, but because humans come in relatively uniform form, right?
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
No, I agree with what you just said, which is that to be able to do high level common sense, to have high level common sense, you need to…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
We’re really fooled by it.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Well, there is a natural fear of new technology and the impact it can have in society.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
you cannot compare two things as to whether one is more intelligent than the other.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
it’s because bias is in the eye of the beholder.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Then the fine-tuning that people will add or the additional guardrails that people will add will cater to their community, whatever it is.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
The system cannot predict what’s going to be in the room as the camera is panning.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
intrinsically and even social networks are a good thing if you run them properly.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So learning representation is really the thing.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Eliezer Yudkowsky | Not checkable |
8 Mar 2024 |
People who assert otherwise are confabulating at best.
Eliezer Yudkowsky · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
History of the world is whenever there is a progress someplace, there is a countermeasure and it’s a cat and mouse game.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
if you want those systems to be useful, they will necessarily have to offend a number of people inevitably.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Again, I think the answer to this is open source platforms and then enabling a widely diverse set of people to build AI assistance that…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
LLMs are not controllable,
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
I love that question.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Certainly, scale is necessary but not sufficient.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Because intelligence is the commodity that is most in demand.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
They don’t have language and they understand the world much better than any LLM.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
And what works against this is people who think that for reasons of security, we should keep the AI systems under lock and key because it’s…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
The professions that are going to be hot 10 or 15 years from now, we have no idea today what they’re going to be.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
It’s the same difference as the difference between what psychologists call system one and system two in humans
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
They basically are going to have to regurgitate the template that they’ve been trained on.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
We’re basically cheating. We’re using language as a crutch to help the deficiencies of our vision systems to learn good representations…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
I knew they were wrong when they were saying it.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
That is not to say that autoregressive LLMs are not useful.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Well, so no, you will have to build a specific architecture to allow for hierarchical planning.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
is a lot of underlying reality, which is not expressed in language.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So that’s what we’re missing from current AI systems.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
If you’re really interested in human level AI, abandon the idea of generative AI.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
And in language, we can get away without doing this because language is already to some level abstract and already has eliminated a lot of…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
But if you want to go down to how you climb down the stairs or just stand up from your chair in terms of words, you can’t do it.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
When you and I talk, you and I are bilingual, we think about what we’re going to say, and it’s relatively independent of the language in…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Language is a very approximate representation or percepts and/or mental models.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
We just assume that if a system is fluent in manipulating language, then it has all the characteristics of human intelligence, but that…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Well, not really, only in a very simple way.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Yes.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So it’s going to be impossible to produce systems that are unbiased for everyone.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
I haven’t been that excited about the direction of machine learning and AI since 10 years ago when Fairway was started.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
I just think that most of the information of this type that we have accumulated when we were babies, it’s just not present in text, in any…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So it’s much better to do an optimization in continuous space where you can do gradient and descent as opposed to generate tons of things…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So LLMs or vision systems that are trained by reconstruction generate the inputs.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So I share that feeling, I think people are fundamentally good.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
I thought it was because the rulers just wanted to preserve the control over the population and the religious dogma and everything.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
we cannot afford those systems to come from a handful of companies on the west coast of the US because those systems will constitute the…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
If we eventually have systems that are built with this blueprint, we can put guardrails in those systems that guarantee that there is a…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
But objectively-driven AI, so systems that derive their answers by optimization of an objective means they have to optimize this objective…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
I see the danger of this concentration of power through proprietary AI systems as a much bigger danger than everything else.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So it’s essentially impossible for systems like this that can inevitably formulate political opinions, and opinions about various things…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
And so the proper way to train a system is to first have it learn good representations of the world and world models from mostly…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
And some of that work has been incredibly successful.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
It doesn’t think about its answer really. It retrieves it because it’s accumulated a lot of knowledge.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So the only way you’re going to have an AI industry, the only way you’re going to have AI systems that are not uniquely biased is if you…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
I think it should not be abandoned completely, but I think it’s use should be minimized because it’s incredibly inefficient in terms of…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
I would argue most of our knowledge is derived from that interaction with the physical world.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So the short answer is no
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
There is an abstract representation of imagining the reaction of a reader to that text.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
They’re not going to be able to plan for situations where that they never encountered before.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So making people smarter, we just can only be better.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
But there are limitations to those contrastive methods.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Alan Turing would decide that a Turing test is a really bad test, okay?
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
The design is all about safety, because a better turbojet is also a safer turbojet, so a more reliable one.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
That’s just not acceptable, it’s a danger to democracy regardless of how well-intentioned those companies are, and it’s also a danger to…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Well, that’s exactly why we need open source platforms.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
I’m clearly in the camp that yes, intelligence cannot appear without some grounding in some reality.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So that, I think, is an essential component of an intelligent system.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Don’t think it’s just Moravec’s paradox.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So now you can do what LMS cannot do, which is planning what you’re going to do.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Well, there’s a lot of situations that might be difficult to, for a purely language based system to know.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
No, it’s basically a struggle against the curse of dimensionality.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
A lot of it is similar, and LLMs don’t have that.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
There is another set of methods which are non-contrastive, and I prefer those
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So certainly LLMs are going to be able to do this, but then how you link this from the low level of actions, that needs to be done with…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So having machines that are smarter than us, that assist us in all of our tasks, our daily lives, whether it’s professional or personal, I…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
I don’t think anyone today would say that the invention of the printing press had a overall negative effect despite the fact that it…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Big companies are really careful about not producing things of this type because they don’t want to hurt anyone, first of all, and then…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
And we’re talking about inference, we’re not talking about training, the system has been trained already.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
No, I don’t think the issue has to do with the political leaning of the people designing those systems.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So we can’t just only model everything at the lowest level.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
We specify what the proper levels of abstraction, the representation at each level of abstraction have to be.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
But it’s not a question of being impressed or not, it’s the question of knowing what the limit of those systems can do.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
science makes progress when people disagree and they come up with an answer and consensus forms
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
That’s one of the reasons you need experience of the physical world, which is much higher bandwidth than what you can express in words, in…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
Even if you have a team of 50 engineers that are really experienced building it, you’re still going to have to blow up a dozen of them…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
There’s a few breakthroughs that we have to basically go through before we can get there, but you’ll be able to monitor our progress…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
if you expect the system to become intelligent just without having the possibility of doing those things, you’re making a mistake.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
I don’t hate reinforcement learning
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
It doesn’t need to be physical reality. It could be simulated, but the environment is just much richer than what you can express in…
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
And the answer is the same answer that we found in liberal democracy about the press, the press needs to be free and diverse.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
I think people are fundamentally good and in fact, a lot of doomers are doomers because they don’t think that people are fundamentally good.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
but there is a lot of things they cannot do, and we have to realize what they cannot do and then figure out how we get there.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
And if some of those top systems are open source, anybody can use them, anybody can fine tune them.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
And so you cannot have an unbiased system, that’s just an impossibility.
Yann LeCun · Not checkable · 8 Mar 2024 |
|
| Not checkable |
Yann LeCun | Not checkable |
8 Mar 2024 |
So what you want is your encoder to basically eliminate all those details.
Yann LeCun · Not checkable · 8 Mar 2024 |
|