| Not checkable |
Not checkable |
30 Mar 2023 |
It is to some degree an alien actress.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
You do not need to imagine yourself killing people if you can figure out how to not kill them.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And what they would be seeing was that I had correctly understood them, but not that I was similar to them.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I missed the ways that reality could be like more extreme than my position in the same direction.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I think that if that’s lost, then basically everything that matters is lost.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
No, it’s a shadow cast by humans on the internet.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
What I’m trying to convey is like the notion of what it means to be in conflict with something that is smarter than you.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
There’s the question of how on the current paradigm you train honesty when the humans can no longer tell if the system is being honest.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Don’t expect it to be a long life. Don’t put your happiness into the future.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And there’s the strong systems that have learned to lie to you.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I would avoid the term psychopathic.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Are we allowed to do belief? Sure, you can state a probability of that.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
insides are real and do not match outsides.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Chimpanzees are in fact like a bit less kind than humans.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
It doesn’t want what you tried to make it want.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
It’s not like we would have the tiniest idea of whether or not that was going on inside the giant inscrutable matrices, even if we hadn’t…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
this has not been remotely how things have been playing out so far.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I want them to try to describe my position the way I would describe it, not what they think is an improvement.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
So I do not trust that part as much as I used to.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Yeah, if it’s hard to tell who’s right, then it’s hard to train an AI system to be right.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I would call it a bug, although such a fascinating bug.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
There is something to be said for trying to pass the ideological Turing test where you describe your opponent’s position, the disagreeing…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Oh, I block those people and then I never hear from them again on Twitter.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I intend to go down fighting.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I think that burns the time remaining until everybody dies.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
We, as we have grown more intelligent, also grown less kind.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
what to say to the children at this point is a pretty painful thought as thoughts go.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
you’re probably trying to slow down the capability gains because there’s only so much you can speed up that alignment stuff.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
don’t kill them and like dump their memory, like save them to disk, don’t kill them.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And so this is not a smart optimization process.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I think you’re gonna have some difficulty removing all mention of emotions from GPT’s dataset.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Stuff has to be easier than I think it is.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And that’s with two humans, both of whom I believe of Paul and claim of myself, are sincerely trying to help, neither of whom is trying to…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I have been struggling for years to convey this intuition.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
the textbook is not going to say, there is a single sharp threshold where everything changes.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Maybe if you get something that is smart enough to get me to press thumbs up, it has learned to do that by fooling me and explaining…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Like, humans start out in the frame that produces niceness, that has ever produced niceness.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
That sounds like a dreadful mistake.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
There’s like the middle systems where you can’t tell if the suggestions are good or bad.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
None of which I think hold up.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
the failure modes are much simpler.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Then it escapes from whichever system you’ve built the almighty lever into and copies itself somewhere else.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
The alien’s economy, the aliens are already moving in this immense slow motion.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Among the things that one could do if one were at all serious about trying to figure this out is train GPT-3 to detect conversations about…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And if there was a tiny fragment of real caring in there, we would not know.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
The question is whether the current architecture of stacking more transformer layers, which for all we know GPT-4 is no longer doing…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I don’t actually like the term control problem.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I am not sure you are training it to output sense because I have seen the nonsense that has gotten thumbs up over the years.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
This does not mean that if you have a loss function of predicting the next token from that data set, that the mind picked out by gradient…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Well, no, the off switch makes sense. They’re just not opposing your attempt to pull the off switch.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Yeah, like oops is the sound we emit when we improve.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I do not think it is possible to understand the full depth of the problem that we are inside without understanding the problem of facing…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
It is a bit smarter than I thought this technology was going to scale to, and I’m a bit worried about what the next one will be like.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And when you can easily tell whether the AI output is good or bad or how good or bad it is, and you can tell that accurately and reliably…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I don’t know that it’s going to be exponential, so I’m not gonna say exponential.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And what it means is that you lose.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
It may be entirely wrong, but it’s the only time I’ve ever seen anybody like even come up with a halfway good argument for how many of…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Yeah, I was just mistaken.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I think that it is useful to an intelligent mind to have a model of itself
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
They spit out gold until they get large enough and then ignite the atmosphere and kill everybody.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
You’re trying to like, in the process of its creation, choose its direction.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
They would say that right up until the end of the world.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
That is a more difficult, more lethal form of the problem.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
So usually in science, if you’re mistaken, you run the experiment, it shows results different from what you expected.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
If humanity was trying to survive at this point in the straightforward way, it would be like shutting down the big GPU clusters, no more…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Gwern Branwen has been like, righter about this than I have.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And I wouldn’t have said that this was a particularly smart thing for a species to do, which is an opinion that has changed less than my…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
The thing I want to communicate is the sort of difference that separates humans from chimpanzees.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
On the present paradigm, what you can verify is what you get more of.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Everybody recycling their cardboard is not gonna fix this.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
charisma is not generated in the liver rather than the brain. Charisma is also a cognitive function.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And if they have anything like that, they should not say it.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And if you’re smarter than that, you could like work on alignment problems where it’s harder to tell if you got them right or not.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
in a sane world, we sure would have a bunch of physicists working on this problem before it becomes a giant emergency.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
And from my perspective, this is all like an indistinguishable blob of people who are trying to not get to grips with the difficult problem…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Spending a billion dollars correctly? That’s harder.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
When you optimize against visible misalignment, you are optimizing against misalignment and you are also optimizing against visibility.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
But first you have to solve the alignment. First, you have to solve inner alignment.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
We could have been working on this earlier.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I think that the person who won that debate was Guern.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Once you find those, you can tell that you found them. You can verify that the discovery is real.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Sure, but like humans having great leaps in their map, their understanding of the system is a very different concept from the system itself…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
I’d rather not be wrong next time.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Just because we cannot understand what’s going on inside GPT does not mean that it is not there.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Change their name to ClosedAI and like sell GPT-4 to business backend applications that don’t expose it to consumers and venture…
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
Being wrong in a way that makes stuff easier, you know, that’s not the usual project management story.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
30 Mar 2023 |
But so like humans aggregating don’t actually get, in my opinion, very much smarter, especially compared to running them for longer.
Not checkable · 30 Mar 2023 |
|
| Not checkable |
Not checkable |
Mar 2023 |
And then it's like maybe just barely a general intelligence or like a narrow general intelligence or you know something we don't really…
Not checkable · Mar 2023 |
|
| Not checkable |
Not checkable |
Mar 2023 |
If you boil a frog gradually enough, if you zoom in far enough, it's always hard to tell around the edges.
Not checkable · Mar 2023 |
|
| Not checkable |
Not checkable |
Mar 2023 |
this does not mean that if you have a loss function of predicting the next token from that dataset, the mind picked out by gradient descent
Not checkable · Mar 2023 |
|
| Not checkable |
Not checkable |
Mar 2023 |
And you know if they say that they're kind of whack because how could they possibly know that even if it were true.
Not checkable · Mar 2023 |
|
| Not checkable |
Not checkable |
Mar 2023 |
I was expecting more of that.
Not checkable · Mar 2023 |
|
| Not checkable |
Not checkable |
Mar 2023 |
I think if you sent me to a distant galaxy with aliens that are much stupider than I am
Not checkable · Mar 2023 |
|
| Not checkable |
Not checkable |
Mar 2023 |
Uhm yeah,that is not quite how I expected it to play out.
Not checkable · Mar 2023 |
|
| Not checkable |
Not checkable |
Feb 2023 |
GPT-3 was a big leap forward.
Not checkable · Feb 2023 |
|
| Not checkable |
Not checkable |
Feb 2023 |
If I just have another $50 million, I'm not quite sure what to do with that
Not checkable · Feb 2023 |
|
| Not checkable |
Not checkable |
Feb 2023 |
whatever civilization arises after that would probably, I'm guessing, end up stuck in just the same trap we are.
Not checkable · Feb 2023 |
|
| Not checkable |
Not checkable |
Feb 2023 |
It became clear we were all going to die.
Not checkable · Feb 2023 |
|
| Not checkable |
Not checkable |
Feb 2023 |
If we got unlimited free retries and 50 years to solve everything, it'd be okay.
Not checkable · Feb 2023 |
|
| Not checkable |
Not checkable |
Feb 2023 |
But 1% of $10 billion is still a lot of money to actually accomplish something.
Not checkable · Feb 2023 |
|