| Not checkable |
Not checkable |
30 Mar 2023 |
I mean, I think that you are more than the mask.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
You would prefer, like maybe that’s the only way out but if you can find a security hole in the box you’re on, you’re gonna prefer to…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
it feels to me like I have watched the field of alignment just fail to thrive
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
To train a system to play, to win chess games, you have to be able to tell whether a game has been won or lost.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
It means that things are in a horrible state, getting worse, and there’s nothing you can do about it.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I don’t want to be interpreted charitably.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And if you can’t tell whether the output is good or bad, you cannot train the AI to produce better outputs.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And even knowing exactly what I’m going to do, you can’t see how I got the results that I got.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
The aliens, being as stupid as they are, have actually put you on Microsoft Azure cloud servers instead of this hypothetical perfect box.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And I think that all the analogies between them are horribly misleading and yeah.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
We are boiling the frog.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Yes, cause that’s not how the fate of the galaxy gets settled.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I do not feel that seeing a being has changed my model of what intelligence is.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
the point at which a system has sufficient intelligence and situational awareness and understanding of human psychology that it would have…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
There is so much interpretability work to be done on the weaker versions of the systems.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
It’s being predictably wrong.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Yeah, that’s just part, yeah, that’s part of the modern paradigm of alchemy.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
the game board has already been played into a frankly awful state.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Unless there’s an alien actress who is learning how to sound human, and is getting good at it.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
They wanted an excuse to wave it off.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
We need systems that will, that will like have a pause button where they won’t try to prevent you from pressing the pause button.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I just look at all the people, you know, like one by one, up to the eight billion and be like, that’s life, that’s life, that’s life.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
The undignified thing is not being wrong.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I’m saying that the easiest way to pick up a hundred million people saying that you seem like a person is to look like a person talking to…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
No, I’m saying it’s difficult and dangerous in proportion to how it’s alien and how it’s smarter than you.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I think we are not on track to learn remotely near fast enough, even if it were open sourced.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
But it’s not like the thing that makes transformers smart.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
chipping flint handaxes and outwitting your fellow humans is basically the same problem as going to the moon.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Like the difference between capabilities now and 1000 years ago is a bigger gap than the gap in capabilities between 10 people and one…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
the more you can like, say oops softly, routinely, not as a big deal, the more chances you get to be like, I see where that reasoning went…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
The meaning of life is not some kind of, like meaning is something that we bring to things when we look at them.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And you don’t necessarily need any of these actual qualities in order to kill everyone, so.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
So the work of alignment might be qualitatively different above that threshold of intelligence or beneath it.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Any goal, almost any set of, almost every set of utility functions with a few narrow exceptions implies killing all the humans.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I know you want this to be true, but why would it be true?
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Yeah, I think there’s multiple thresholds.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Cause for 20 years, humanity decided to ignore the problem.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Well, I can easily imagine that at some point this panic expresses itself in the waste of a billion dollars.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
We would choose to preserve that within ourselves because it matters and on some viewpoints is the only thing that matters.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
It’s not even clear what it means exactly.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
A blank map does not correspond to a blank territory.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
It is entirely possible that the things I am saying are wrong.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
So verifying a guess is easy, but coming up with a good suggestion is very hard.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
So if it were up to me, I would be like, okay, like this far, no further, time for the summer of AI where we have planted our seeds and now…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
If you’re thinking of it as a debate, you’re already screwing up.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I think those people are closer to the masks that they wear than an alien from another planet would, like, learning how to predict the next…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Like you throw enough computing power at it, it obviously works.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I think that if you optimize really hard on efficiently just having the useful parts, there is not then the thing that says like, I am…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Well, zero, 40%, and 100% is a bit closer to it, based on what happens to Chat GPT after you RLHF it to speak humane.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Suppose that some alien civilization with goals ultimately unsympathetic to ours, possibly not even conscious as we would see it, managed…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
The old, you can’t bring the coffee if you’re dead.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
One can aspire to be well calibrated, like not so much think in terms of like, was I right, was I wrong?
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
But also when I say I put a low probability on it, I can feel myself reaching into the part of myself that thought that GPT-4 was not…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And Bing has not yet updated me in that way.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Are you scared? Of this whole thing? Yeah. Probably. I don’t really know.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I think that you will find great difficulty getting AIs to help you with anything where you cannot tell for sure that the AI is right once…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
But open sourcing it, no, that’s just sheer catastrophe.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
that GPT-4 is not turning out this way
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
But having built this thing, they do not understand how it output cold air.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
When the verifier is broken, the more powerful suggester does not help. It just learns to fool the verifier.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I did not grow up thinking that death was part of the meaning of life and now I still think it’s a pretty stupid idea.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Yeah, the probabilistic stuff is a giant wasteland of Eliezer and Paul Christiano arguing with each other and EA going like, eh?
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And it still would not be definitive.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I certainly like pray that Moore’s law runs as slowly as possible.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I wasn’t expecting it to happen.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
When the verifier is broken, the more powerful suggester just learned to exploit the flaws in the verifier.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
the actual critical moment is the moment when it can deceive you, when it can talk its way out of the box, when it can bypass your security…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Because if you make humans much smarter, they can actually be smart and nice.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Natural selection is so incredibly stupid and simple that we can actually quantify how stupid it is if you read the textbooks with the math.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
the Supreme Court would be like, you’re just a computer. Even if there was an actual person in there.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
In other words, I do not think that alignment is fundamentally harder than artificial intelligence was in the first place.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
This is not yet having taken over their world.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
this is not about how fast it’s moving, it’s about where it is.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
if we solve the weak stuff, if we solve the weak ass problems, the strong problems will still kill us, is the thing.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
People have different thresholds for when they start to outcry.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Um, yeah, that’s not quite how I expected it to play out.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Otherwise it has magic.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
It’s one of a bunch of things that change different points.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I’m also trying to be constrained to say things that I think are true and not just things that get you to agree with me.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I’m one of the closest things to an expert on where it all goes.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I mean, I do not believe in the practice of steelmanning.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
particularly the part where everybody ends up dead cause that part is kind of important.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
No, if the nice aliens were already here, they would like have stopped the Holocaust.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
The aliens are already writing really shitty code. Getting the aliens to write shitty code is not the problem.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
But if we needed to get artificial intelligence correct on the first try or die, we would all definitely now be dead.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
which I think at this point is just like shutting down the GPU clusters.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Eventually, you shouldn’t do it first.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Yeah, we’re not talking here about the doing harm process, we’re talking about the escape process.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
This changes my picture of what the very substance of flight is.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Everybody recycles their cardboard, and then everybody ends up dead, metaphorically speaking.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
The aliens’ entire internet is full of shitty code.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
He runs at a million times the speed and therefore can solve tougher problems, quite a lot tougher.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And that means I don’t necessarily know what GPT-5 is going to be able to do.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Well, one way of decomposing problems is suggestor verifier.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
It runs for a long time and eventually manages to optimize things.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
It feels like a very, very basic competence that you are praising me for.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
The hell do you imagine they will propose that would make it safe to put something smarter than you on the cloud?
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I think that the question of like what leads to making better or worse predictions, what leads to being able to pick out better or worse…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
if you send a schematic for the air conditioner back in time, they can see exactly what you’re telling them to do.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
interpretability alone is not going to save you.
Not checkable · 30 Mar 2023 |
|