| Not checkable |
Not checkable |
23 Jul 2025 |
So you’ve got to continually monitor this increasingly larger and larger suite of benchmarks.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
But in my world, they’d be related because it would be an open world simulated game as realistic as possible.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think they operate over different timescales and they’re equally important to address.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
Of course, you can’t create infinite amounts of game assets.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
But of course it’s very hard to program open world games.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And we’re not that nobody’s there yet, in my opinion.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
You need them, but it’s important that you don’t overfit to them.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And we’re continually fighting and cutting away bureaucracy to allow the research culture and the relentless shipping culture to flourish.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think he would’ve loved where we are today
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
Well look, of course there’s a strategy that Meta is taking right now.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
So I think political philosophy and political science is going to be key to that.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And probably a system being able to do several of those things for it to be very general, not just one domain.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
Basically polynomial times, so tractable by a classical system, which a neural network is.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
generally I’m in huge favor of open science and open source
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
technology, I’ve always seen technology as the enabler, the tools that enable us to flourish and to understand more about the world.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think there probably needs to be 10 times more effort of that than there is now as we are getting closer and closer to the AGI line.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think they’re most likely in the past, if you read that book of how unlikely to go have any life at all.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
So actually I think it’s an example of very promising directions where you combine LLMs or foundation models with other computational…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And if they can’t, then I think you can be pretty confident we have a fully general system.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And I think we haven’t really even sort of scratched the surface yet of what classical systems so-called could do.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
It’s almost like cutting edge part of psychology research or personality research.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
No, it won’t solve all problems because there’s still other human foibles that will still exist, but it will at least remove one, I think…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
Yes, the mastery. There’s nothing more satisfying in a way.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think to the extent that it can predict the next frames in a coherent way, that is a form of understanding
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
But at the moment these are more incremental improvements, sort of small iterations.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
It’s all good for humanity in the end if you cure terrible diseases and you come up with an incredible cure, this is net win for humanity.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I hope not. I think that would be very dangerous to do.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And that research base means that if some new breakthrough is required, like an AlphaGo or Transformers, I would back us to be the place…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And I think that shows that it has some notion of at least intuitive physics, how things are supposed to work intuitively
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
But with an AI that’s on silicon, we won’t be able to rely on the second part, even if it exhibits the first part
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think it would imply a level of precision that is not there.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think information is primary, information is the most sort of fundamental unit of the universe, more fundamental than energy and matter.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
Our brains are general systems, intelligent systems, so I think it’s almost limitless what we can potentially do with them.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think that’s what separates the great scientists from the good scientists.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
It’s difficult with the current geopolitical climate, I think, to see cooperation, but things can change.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
So I think most emergent systems, cellular automata, things like that could be model-able by a classical system.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
So I often say it’s harder to come up with a conjecture, a really good conjecture than it is to solve it.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
We’re trying to build general systems that are good across the board, and you try and make no-regret improvements.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
But yeah, I’m on good terms I hope with pretty much all of them.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
So whatever your trade-off is that you want as an individual user or as a developer, you should find one of our models satisfies that…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And that’s why projects like AlphaFold are so important to me.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
So they can be efficiently rediscovered or recovered because nature’s not random.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
games is a kind of safe environment, repeatable environment where you can get better at your decision-making process
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think so, for several reasons. I think compute, there’s the amount of compute you have for training, often it needs to be co-located, so…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I try to pride myself in being collaborative.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
Yeah, I know. It’s funny. If you live on X and Twitter and I mean it’s sort of at least my feed, it’s all AI.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
Yeah, we’re quite addicted to this sort of, these numbers going up.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I read a lot of books for that time as well, Chronicle Time and some brilliant people involved.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think it’s telling us something quite fundamental about how the universe is structured in my opinion.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
There’s no other media, entertainment media, where you do that, where you as the audience actually co-create the story.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
We as a team were inspired by Lee Sedol’s brilliance and nobleness.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And it’s amazing, which is a relatively simple algorithm, right?
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
and I’d probably start with a yeast cell.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I’m with Feynman on this, and he used to always talk about science and art being companions.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I sometimes call it survival of the stablest or something like that
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
Well, it’s interesting that programming, and it’s again counterintuitive to what we thought years ago, maybe that some of the skills that…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
One way to do it would be kind of brute force test of tens of thousands of cognitive tasks that we know that humans can do.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And if that’s true, I think that’s potentially learnable by a neural network.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think really the problem there is batteries and transmission.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
So perhaps there is some kind of lower dimensional manifold that can be learned if we actually fully understood what’s going on under the…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
So probably for a cell I would hope that would be the protein level, and that one wouldn’t have to go down to the atomic level.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
That’s maybe true of most of reality.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And I think the reason that’s possible is that in nature, natural systems have structure because they were subject to evolutionary…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I don’t see the boundaries really between arts and sciences, or product and research. It’s a continuum for me.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
it’s not some kind of deep philosophical understanding of what’s going on, I don’t think these systems have that
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I don’t have a P-Doom number.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think they can all be converted into each other, but I think of the universe as a kind of informational system.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think a lot of researchers that I see in our field are a little bit too narrow and only understand the technology.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And if that’s true, then you can maybe learn what that structure is.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
So these are all just new problems in product space that I don’t think I’ve ever really been tackled before, but we’re going to rapidly…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
the only rational, sensible approach is to proceed with cautious optimism.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I’m very supportive of things like the AI summits that will happen and governments understanding it.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
You can learn something kind of equally valuable from an experiment that doesn’t work.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think it’s one of the most fundamental questions actually if you think of physics as informational and the answer to that, I think it’s…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And I was expecting this because more and more people are finally realizing, leaders of companies, what I’ve always known for 30 plus years…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And then other things that are even more esoteric come into play, like the style of the persona of the system
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
picking the right question is the hardest part of science and making the right hypothesis.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
in the end, I always imagine that building AI, a kind of intelligent artifact, and then comparing that to the human mind and seeing what…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
It isn’t kind of a jagged intelligence where some things, it’s really good at, like today’s systems, but other things it’s really flawed at.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
What you want to be able to do is potentially anything in that game environment.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
Yes. If it was just incremental improvements, that’s how it would look.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think the only way you can do that is to have generated systems, systems that will generate that on the fly.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
So we know our brains are pretty much general Turing machines approximate, and of course we created incredible modern civilization with our…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think winning is the wrong way to look at it given how important and consequential what it is we’re building.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
But it seems like you can understand it through passive observation, which is pretty surprising to me.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think that has to be at the heart of the endeavor.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
really the whole of what I do today, it’s still a follow on from those early more hard coded ways of doing the AI to now fully general…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And yet we still can’t answer that clearly in a simple way.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I hope we’ll end up with something more collaborative if needed, more like a CERN project where it’s research-focused and the best minds in…
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
We weren’t just making games, we felt we were creating a new entertainment medium that never existed before.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
the thing I’m most impressed with and fascinated by is the physics behavior, the lighting and materials and liquids.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think it’s fantastic.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And I suspect there probably is
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
But the question is then I think we’re going to have to confront the question again of what is the fundamental nature of reality?
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
But they could explain why afterwards that move made sense.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
So everything that was pushing computing forward in the nineties was due to gaming.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
It’s not about really beating the other person, it’s about maximizing your own potential.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
And so it was really a reflection of the way you played it.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
Well, my favorite one of all time is Civilization, I have to say.
Not checkable · 23 Jul 2025 |
|
| Not checkable |
Not checkable |
23 Jul 2025 |
I think it does channel a lot of those energies into which I think is a kind of human need to belong to some group, but into a fun way, a…
Not checkable · 23 Jul 2025 |
|