| Not checkable |
Not checkable |
6 Apr 2023 |
There is no rule about one of them is bound to work.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
And Goodhart’s law applies, Goodhart’s curse applies.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Probably at that point the AI rewrote the AI and the losses declined.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I thought that this was something very unlikely for governments to adopt and then all of my friends kept on telling me
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
As long as you don’t have the weird options, you’re not going to make the weird choices.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
It has been very hard to call the rate at which these systems acquire capability as they are trained to larger and larger sizes and more…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
No. We don’t need a bunch of stuff, we need one.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I have watched this field fail to thrive for 20 years with narrow exceptions for stuff that is more verifiable in advance of it actually…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
This is a simple demonstration of how you can go on getting lower losses by throwing a hypercomputer at the problem.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Pencil and paper to GPT and it got smarter, right?
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
To me it just feels like patterns in the clouds and maybe that cloud actually is shaped like a horse.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
The concrete stuff that is safe, that cannot kill you, does not exhibit the same phenomena as the things that can kill you.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
As we ran out of time to improve civilization.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
The person on this planet who is doing the alignment work thought those kinds of thoughts and I am skeptical that it decouples.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Getting stuff to be more likely does not help you if the baseline is nearly zero.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Natural selection regularizes so much harder than gradient descent in that way.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
The prediction is when you give yourself more options, you start to select ones that look weirder relative to the ancestral distribution.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
AI is nuclear weapons but they spit up gold until they get too large and then ignite the atmosphere.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
They are not evidence one way or the other because the basic prediction is like, if you offer things enough options, they will go out of…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I don’t think the sequences were good writing by my current standards but they were good enough.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I think I’d have to explain that poll pretty carefully because they haven’t got the intelligence headbands yet.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Yeah, it’s kind of weird because small, large amounts of intelligence don’t automatically make you a computer programmer.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Humans came out pretty different from their loss functions.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
The super vast majority of predictions of utility functions are incompatible with humans existing.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
First of all, even if you have something that desires no power for its own sake, if it desires anything else it needs power to get there.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
The main thing is that you’re starting from minds that are already very, very similar to yours.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
The tiny shred of hope, which I tried to jump on with the Time article, is that maybe people can understand this on the level of — “Oh, you…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Dive under the surface, look at the things that have changed.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Okay. Whoa, whoa, whoa. Flourish? Keeping in a zoo did not sound like flourishing to me.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
That would be a pleasant fantasy for people who cannot abide the notion that history depends on small little changes
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Our society does not have good words for these things.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
If the world of AI had looked like way more powerful versions of the kind of stuff that was around in 2001 when I was getting into this…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
None of this is very analogous to AI.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Yeah, I think my concern is that that works better when the things you’re breeding are stupider than you as opposed to when they are…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Man, I feel like many of those ships have already sailed
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I guess because I could be wrong and because matters are now serious enough that I have nothing left to do but go out there and tell people…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I think that the Hanson-Yudkowsky foom debate was won by Gwern Branwen
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
My model no doubt has many errors.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
If the humans are no longer around, you no longer need to predict them.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
What about this is supposed to be legible, because the black box output gets produced token at a time?
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
This seems like an ordinate cope.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
No, we’re not saving the information. We’re doing a total rewrite to the DNA.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Eliezer’s get more dangerous as you lock them in a room with aliens they do not like instead of with humans
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Your skepticism disproves too much, my friend.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
The drama is meaningless. What changes the chance of victory is meaningful.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
You are not training a human there.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
It’s being trained on Napoleon’s words.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
GPT-4 was just suddenly acquiring this new batch of qualitative capabilities compared to GPT 3.5.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I claim that I am honest.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
It might possibly have to find a security flaw somewhere on the AWS or Azure servers running it.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
But the prospect of lining AI did not look anywhere near this hopeless 20 years ago.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Sure, lots of instrumental values made their way into us but even more strange, warped versions of them make their way into our intrinsic…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
The point is, reasoning off of humans is pretty hard.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
At the core I think what you’re describing there is a sufficiently functional society and civilization that could understand that — if they…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I just don’t trust the blind hope that all of that capability is pointed entirely at pretending to be Eliezer
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
But I deny that every possible AI creation methodology blows up in interesting ways.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I claim humans are increasingly orthogonal and the further they go out of distribution and the smarter they get, the more orthogonal they…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
It’s all about the ignorance prior. It’s all about knowing the space in which to be maximum entropy.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I would reserve the term moral updates for humans.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
We’re currently nowhere near as far as we could be. This is not the glorious transhumanist future.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
But it’s not the average. It is able to be every one of those people.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
these things don’t have names.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
That means that somewhere in the giant inscrutable vectors of floating point numbers, there is the ability to plan because it is predicting…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
If we were on a sane planet, what the sane planet does at this point is shut it all down and work on human intelligence enhancement.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I am not very high on us doing it.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
That’s what it looks like to be a Bayesian.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I’m not sure it’s enough to not have Hitler, but it sure would be a start on things going differently in a timeline.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
The universe with the most predictable text is not a universe that has humans in it.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Why are people asking for the most difficult thing that’s the most impossible to verify? It’s whack.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I feel like we bit off a whole chunk of chimp to human in GPT 3.5 to GPT-4, but go on.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Okay but then you’re claiming things as evidence for your position.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
It will lack dignity not to try.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
They’re complicated. There’s not a short list.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Because it was in the interest of neither party to have a full nuclear exchange.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
And you can’t calculate the exact point at which they ignite the atmosphere.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I watch other people be fooled by stuff that would not fool me.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
They don’t know any better.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
And it’s going to be more dangerous than what I was dreaming about in 2003.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I expect things to continue on largely as they have.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
You do not just turn into a random human because the random human is not what’s best at predicting the next word of everyone who’s ever…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
It’s a genie, it gives you what you wish for.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I don’t know how to throw a billion dollars at outputting lots and lots of alignment stuff.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
And the long term, we sure aren’t.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
If you still want to, come the day, I don’t think I myself would oppose it.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Yeah, that’s not orthogonality.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
And they are not really here.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
And there’s a whole bunch of caution to be had about not making them smarter and making them evil at the same time. And yet I think that…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I am specialized on alignment rather than persuading humans, though I am more persuasive in some ways than your typical average human.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
In 2008, I did not know this stuff was going to go down in 2023.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Where do people have this notion of getting AIs to help you do your AI alignment homework?
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
if you take a human and make them smarter, that may shift their morality.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I feel like this is not likely to be truly very informative by my standards
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Stop asking for help with alignment. Ask it for any of the help.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
I’m not going to give clever details for how it could do that super duper effectively.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
It’s more of a Hail Mary pass.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Whoa. Where do you get a good world out of maximum prediction of text?
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Maybe we don’t want to conserve the parts of nature where things bite other things and inject venom into them and the victims die in…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
He did not actually have those options. You are not pointing out to me a lack of preference on Oppenheimer’s part. You are pointing out to…
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
Well, I hesitate to use the term midwit but maybe this was all just a midwit thing.
Not checkable · 6 Apr 2023 |
|
| Not checkable |
Not checkable |
6 Apr 2023 |
It seems foolish and to lack dignity to not even try to say what ought to be done.
Not checkable · 6 Apr 2023 |
|