| Not checkable |
Not checkable |
Sep 2025 |
The production of systematic correlations between map and territory, is one way of being more specific about what the word rationality…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Oh, there are technological developments where you can see ways that they would end poorly. It's not every technology that ends up well.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
If you're running the AI that can build the AI that builds that AI and you're not stopping, that's also it.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
It's not clear that all the pieces are in place and we just need to pile up more of the same stuff.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
So if you imagine that there's just like generic apocalypses coming at you out of nowhere with a fixed frequency, the longer the history…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Those AIs, probably all agree, trees are made of atoms.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
These things are dangerous to the extent that they are planning in the real world and can roll out their own technologies from scratch, or…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
But as long as they find it convincing to say, yeah, somebody else will do it anyway, they are going to do it.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
It's this color over here.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
I now think that this is actually mistaken, and that's not a vibe shift.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Conversation seems like a much harder problem than writing code, and I would've been wrong.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
I wish that it were under better circumstances and I wish the book title were an exaggeration.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
They're like, oh, somebody else will press it.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
The part where humans need to do philosophy in advance is when there's more than one reflective fix point or self approving…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
There is no physical bar to building a tree that buds off mosquitoes.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
if your virus isn't clever enough, you just need to seed it with more packages.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
If you say that somebody else is gonna press it, instead, let them kill everyone.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
And at least, so far, it seems like in a lot of ways, the person on the street is wiser.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Once you've set the bottom line, once you if you imagine a sheet of paper and then you write at the bottom of the sheet of the paper…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
I would normally ask you for a specific example at this point, but probably your viewers have already seen many specific examples, and so I…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Trying to do it inside a human brain is playing on hard mode.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Excellent concrete example.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
I realized that my original model of reality had been mistaken.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
You can have things that steer the galaxy toward happily ever after for all life forms.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Here's the thing, this is not that hard.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
It helps discriminate, distinguish. It doesn't nail it down perfectly, but it shifts the probability.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
there is no canonical objection to why we're all going to die.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
There's, try to say more narrowly which things count or don't count under your theory.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
I mean, everybody literally actually dead as in ceasing to breathe.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
It doesn't matter what you write above the bottom line afterwards, it's already true or already false.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Yes, you should.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Still pro building a whole lot of nuclear power plants.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Yep, and I stand by that today as well.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
All correct views of cognitive science, computer science are the same.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
I do not quickly expect that we will die before this video releases.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
So your brain is in the middle of a hurricane being buffeted about by many forces that are echoes of past forces.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
They reach around for a reason to say that they can keep going.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
In fact, I'm surprised that there isn't more automatic translation already and have been for a while.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
If you have reason to believe that they're only telling you some of the evidence or even that they're only telling you some of the…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
15 May 2025 |
And this is — not quite MIRI’s last desperate hope — but probably the best of the desperate hopes remaining that you can do anything about…
Not checkable · 15 May 2025 |
|
| Not checkable |
Not checkable |
29 Mar 2024 |
apparently this battle is not quite over yet
Not checkable · 29 Mar 2024 |
|
| Not checkable |
Not checkable |
28 Mar 2024 |
Interesting bounty format.
Not checkable · 28 Mar 2024 |
|
| Not checkable |
Not checkable |
27 Mar 2024 |
The current setup is simply not competent to do that safely or validly.
Not checkable · 27 Mar 2024 |
|
| Not checkable |
Not checkable |
27 Mar 2024 |
I think that given the vast distance between the modern-day bureaucracy trying to handle this, and the ways of thinking required to…
Not checkable · 27 Mar 2024 |
|
| Not checkable |
Not checkable |
27 Mar 2024 |
There are only people who know enough of alignment to say, "If we don't back off, we will die."
Not checkable · 27 Mar 2024 |
|
| Not checkable |
Not checkable |
27 Mar 2024 |
Because Science the way we know it does need empiricism.
Not checkable · 27 Mar 2024 |
|
| Not checkable |
Not checkable |
27 Mar 2024 |
Humans augmented far enough to stop being idiots, smart enough that they never put faith in a step that will not hold, as do not exist in…
Not checkable · 27 Mar 2024 |
|
| Not checkable |
Not checkable |
27 Mar 2024 |
Only by then, of course, everyone is dead.
Not checkable · 27 Mar 2024 |
|
| Not checkable |
Not checkable |
27 Mar 2024 |
A gap like that cannot be crossed by appointing a prestigious committee of the same scientists who told you 10 years ago that there was no…
Not checkable · 27 Mar 2024 |
|
| Not checkable |
Not checkable |
26 Mar 2024 |
What we want is a universal ban on anything that might turn into a superintelligence.
Not checkable · 26 Mar 2024 |
|
| Not checkable |
Not checkable |
25 Mar 2024 |
The reasoning is locally valid as a matter of economics, but you need a rather different "regulation" to prevent ASIs from just illegally…
Not checkable · 25 Mar 2024 |
|
| Not checkable |
Not checkable |
24 Mar 2024 |
"Doomers" are the anti-doom faction
Not checkable · 24 Mar 2024 |
|
| Not checkable |
Not checkable |
23 Mar 2024 |
Please just sign up for cryonics instead of killing everyone on Earth in a mad quest for immortality.
Not checkable · 23 Mar 2024 |
|
| Not checkable |
Not checkable |
23 Mar 2024 |
I think a major problem with explaining what superintelligences can (very probably) do is that people think that literally this here video…
Not checkable · 23 Mar 2024 |
|
| Not checkable |
Not checkable |
23 Mar 2024 |
This wasn't even an original argument for the world needing a cryonics option, because nobody who founded Alcor imagined that ANYONE WOULD…
Not checkable · 23 Mar 2024 |
|
| Not checkable |
Not checkable |
23 Mar 2024 |
It being hard to stop them, does not mean that an omnicide machine won't kill everyone.
Not checkable · 23 Mar 2024 |
|
| Not checkable |
Not checkable |
23 Mar 2024 |
I wonder if it's the case that there's been negligible overlap between chess Masters (and above), and people who ask, "But how could an…
Not checkable · 23 Mar 2024 |
|
| Not checkable |
Not checkable |
23 Mar 2024 |
I don't like it when things I say hurt people.
Not checkable · 23 Mar 2024 |
|
| Not checkable |
Not checkable |
23 Mar 2024 |
Regardless of whether it's true, it's not a valid counterargument.
Not checkable · 23 Mar 2024 |
|
| Not checkable |
Not checkable |
22 Mar 2024 |
Would you buy a bridge from an engineering firm that dismissed all warnings about bridges falling down as the work of "doomers"?
Not checkable · 22 Mar 2024 |
|
| Not checkable |
Not checkable |
22 Mar 2024 |
At best, "safety testing" asks OpenAI to stop, and then Altman else Microsoft else Google else Meta destroys Earth anyways.
Not checkable · 22 Mar 2024 |
|
| Not checkable |
Not checkable |
21 Mar 2024 |
Self-models are not self-reality but they have a very large amount of influence over self-reality.
Not checkable · 21 Mar 2024 |
|
| Not checkable |
Not checkable |
21 Mar 2024 |
Mirror test.
Not checkable · 21 Mar 2024 |
|
| Not checkable |
Not checkable |
21 Mar 2024 |
Your character can be smarter than you, if you think stupid (irrational, insane, invalid, etc) thoughts that you know are stupid.
Not checkable · 21 Mar 2024 |
|
| Not checkable |
Not checkable |
21 Mar 2024 |
My least favorite thing about some video games, many of which I think I might otherwise have been able to enjoy, is walking-dominated…
Not checkable · 21 Mar 2024 |
|
| Not checkable |
Not checkable |
21 Mar 2024 |
To this day, very few people understand most of what he wrote.
Not checkable · 21 Mar 2024 |
|
| Not checkable |
Not checkable |
21 Mar 2024 |
This is one of the few exceptions to Vinge's Law, that fictional characters can't be truly deeply smarter than authors.
Not checkable · 21 Mar 2024 |
|
| Not checkable |
Not checkable |
21 Mar 2024 |
When I was a young man, I gained some amount of my intelligence in this way, by trying to write smart characters in fiction.
Not checkable · 21 Mar 2024 |
|
| Not checkable |
Not checkable |
21 Mar 2024 |
We often think what we predict ourselves to think.
Not checkable · 21 Mar 2024 |
|
| Not checkable |
Not checkable |
21 Mar 2024 |
To write intelligent fictional characters, you must learn to notice what I call "stupidity assertions" -- the part of yourself that (maybe…
Not checkable · 21 Mar 2024 |
|
| Not checkable |
Not checkable |
21 Mar 2024 |
RIP Vernor Vinge.
Not checkable · 21 Mar 2024 |
|
| Not checkable |
Not checkable |
18 Mar 2024 |
I don't know they're not conscious.
Not checkable · 18 Mar 2024 |
|
| Not checkable |
Not checkable |
18 Mar 2024 |
nobody on Earth knows what cognition goes on inside.
Not checkable · 18 Mar 2024 |
|
| Not checkable |
Not checkable |
18 Mar 2024 |
I think I know more about consciousness.
Not checkable · 18 Mar 2024 |
|
| Not checkable |
Not checkable |
17 Mar 2024 |
Anytime you see a nutritional study that affirms conventional wisdom, just remember: everything that doesn't conform gets fucking buried.
Not checkable · 17 Mar 2024 |
|
| Not checkable |
Not checkable |
16 Mar 2024 |
I sometimes think about starting one of the forthcoming personal-relationship-AI companies (as if I don't have anything better to do while…
Not checkable · 16 Mar 2024 |
|
| Not checkable |
Not checkable |
16 Mar 2024 |
I don't even know whether my own brain works like this.
Not checkable · 16 Mar 2024 |
|
| Not checkable |
Not checkable |
16 Mar 2024 |
Eat a single jellybean to congratulate yourself at the instant of starting work in the morning -- after writing the first word, say, if…
Not checkable · 16 Mar 2024 |
|
| Not checkable |
Not checkable |
16 Mar 2024 |
It's that the banana-grabbers literally don't understand what the relationship AIs they build might do to human users; and they're not…
Not checkable · 16 Mar 2024 |
|
| Not checkable |
Not checkable |
15 Mar 2024 |
The larger story here is that ML developments post-2020 are blowing up assumptions that hopesters once touted as protective.
Not checkable · 15 Mar 2024 |
|
| Not checkable |
Not checkable |
15 Mar 2024 |
And hopesters don't say, or care, or notice, that their old safety assumption was violated.
Not checkable · 15 Mar 2024 |
|
| Not checkable |
Not checkable |
15 Mar 2024 |
Our safety model made a load-bearing assumption that future ASI would be solely trained to imitate human outputs
Not checkable · 15 Mar 2024 |
|
| Not checkable |
Not checkable |
13 Mar 2024 |
To be clear, the correct action is "Shut it down worldwide" and other actions don't matter; I'm not interested in who tries to regulate it…
Not checkable · 13 Mar 2024 |
|
| Not checkable |
Not checkable |
13 Mar 2024 |
I can imagine work like this fitting somewhere into some vaguely defensible strategy to prevent the destruction of Earth, but somebody…
Not checkable · 13 Mar 2024 |
|
| Not checkable |
Not checkable |
11 Mar 2024 |
My takeaway, alas, is that the OpenPhil worldwiew -- "experts" were all referred to them by OP, no MIRIans -- is unpersuasive.
Not checkable · 11 Mar 2024 |
|
| Not checkable |
Not checkable |
11 Mar 2024 |
Don't "regulate" it, prohibit it.
Not checkable · 11 Mar 2024 |
|
| Not checkable |
Not checkable |
10 Mar 2024 |
You should only praise your guesses with the lofty title of "the outside view" if (1) there's only one defensible choice of reference…
Not checkable · 10 Mar 2024 |
|
| Not checkable |
Not checkable |
9 Mar 2024 |
One issue with safety-critical AI like robotic cars, is that if deployed at scale, all AIs may all make the same mistake, possibly at the…
Not checkable · 9 Mar 2024 |
|
| Not checkable |
Not checkable |
8 Mar 2024 |
But I can see how this would be too scary in the USA, such that China did it first.
Not checkable · 8 Mar 2024 |
|
| Not checkable |
Not checkable |
8 Mar 2024 |
People who assert otherwise are confabulating at best.
Not checkable · 8 Mar 2024 |
|
| Not checkable |
Not checkable |
7 Mar 2024 |
Less pretty than conversations about difficulty reading weird letters; this *looks* like an intelligence test.
Not checkable · 7 Mar 2024 |
|
| Not checkable |
Not checkable |
7 Mar 2024 |
Even this incredibly disastrous chemistry company was vastly more on the ball than current AI developers are on about aligning…
Not checkable · 7 Mar 2024 |
|
| Not checkable |
Not checkable |
5 Mar 2024 |
It's not cool to compete on general intelligence level.
Not checkable · 5 Mar 2024 |
|
| Not checkable |
Not checkable |
5 Mar 2024 |
It's on the capability side of the alignment/capability divide.
Not checkable · 5 Mar 2024 |
|
| Not checkable |
Not checkable |
5 Mar 2024 |
Suppose an AI passes the unrestricted text-based Turing Test for IQ 100, but not IQ 115.
Not checkable · 5 Mar 2024 |
|
| Not checkable |
Not checkable |
3 Mar 2024 |
To understand the user interfaces on microwave ovens, you need to understand that microwave UI designers are aliens.
Not checkable · 3 Mar 2024 |
|
| Not checkable |
Not checkable |
3 Mar 2024 |
There's only so much real estate in a microwave control panel; it's much more important to have an inscrutable button that says "Potato"…
Not checkable · 3 Mar 2024 |
|
| Not checkable |
Not checkable |
3 Mar 2024 |
Nobody knows why they insist on hollowing out and inhabiting human appliance designers in particular.
Not checkable · 3 Mar 2024 |
|
| Not checkable |
Not checkable |
4 Jan 2024 |
We can hope there’s a miracle that violates some aspect of my background model, and we can try to prepare for that unknown miracle
Not checkable · 4 Jan 2024 |
|
| Not checkable |
Not checkable |
4 Jan 2024 |
I consider the present gameboard to look incredibly grim, and I don’t actually see a way out through hard work alone.
Not checkable · 4 Jan 2024 |
|