| Not checkable |
Not checkable |
Sep 2025 |
For one thing, if you have rapid manufacturing capability, among the things you could potentially rapidly manufacture is nuclear weapons…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
There are things you get for free if you just optimize your AI very hard on capabilities.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Backing way up for a second, there's a saying, all happy families are the same, but every unhappy family is unhappy in its own way.
Not checkable · Sep 2025 |
|
| Not researched |
Factual |
Sep 2025 |
GPT-4 is not an AI whose building would cause everyone to die.
Factual · Sep 2025 |
AI capabilities |
| Unresolvable |
Prediction |
Sep 2025 |
While discussing wide timeline intervals, Yudkowsky said that two decades "does start to feel like it's pushing it."
Prediction · Sep 2025 |
AI timelines and forecasting |
| Not checkable |
Not checkable |
Sep 2025 |
There's a sense in which truth is an accidental byproduct, and there are many pressures besides truth, especially when we get into all the…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Just go build it.
Not checkable · Sep 2025 |
|
| Unresolvable |
Prediction |
Sep 2025 |
A superintelligence would not need new physics to build weapons of unstoppable deadliness.
Prediction · Sep 2025 |
AI safety and alignment |
| Resolved true |
Factual |
Sep 2025 |
No AI has yet been shown to redesign a tree and build a much smarter AI that builds a still smarter AI; that scenario has not occurred.
Factual · Sep 2025 |
AI capabilities |
| Unresolvable |
Prediction |
Sep 2025 |
He said it feels like the better AI systems get at coding and science research reports, the more it looks like another breakthrough is not needed.
Prediction · Sep 2025 |
AI capabilities |
| Not checkable |
Not checkable |
Sep 2025 |
You don't even know whether they wrote down the reasons first and the line afterwards.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Yep. It sure does lead to a different approach in terms of looking over what's already been done and asking yourself, does it compile?
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
I don't know off the top of my head, but you can't trust what the AI tell you.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Do what you can to try to bring the world around to where the buttons have been disassembled and nobody is allowed to press the button.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
In multiple manifestations, there's try to be more concrete. Give a particular example. Don't just stay high up on the ladder of…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
But the key to successful futurism is that some problems in futurism are easy and some problems require a bunch of background knowledge and…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
I wouldn't be helping.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Shit has always been real. Shit is now getting proximate.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
And it's also not clear that it's not right.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
You follow the process. You end up wherever and then you say, all right, now that I figured out what I'm going to argue for, here's the…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
There's trying to stay close to the world of sensory detail, like describing what you see and not merely what is true.
Not checkable · Sep 2025 |
|
| Not researched |
Factual |
Sep 2025 |
Most proteins in biological tissue are held together by relatively weak forces.
Factual · Sep 2025 |
Science and research methods |
| Not researched |
Factual |
Sep 2025 |
There are many historical cases of people who had an early grasp of a scientific principle and correctly predicted where it would eventually lead.
Factual · Sep 2025 |
Science and research methods |
| Not checkable |
Not checkable |
Sep 2025 |
Well, that society is not going to get very far in its public debates.
Not checkable · Sep 2025 |
|
| Mostly true |
Factual |
Sep 2025 |
Yudkowsky said that, as far as he knows, he was the person who originally made that argument.
Factual · Sep 2025 |
Their own work or organisation |
| Not researched |
Factual |
Sep 2025 |
Starting in 2000, Eliezer Yudkowsky obtained enough funding to work full-time on AI alignment.
Factual · Sep 2025 |
Their own work or organisation |
| Not researched |
Factual |
Sep 2025 |
Eliezer Yudkowsky has sometimes said that the keynote question of rationality is what do you think you know, and how do you think you know it.
Factual · Sep 2025 |
Field building and careers |
| Not checkable |
Not checkable |
Sep 2025 |
There's the object level and the meta level, and the object level is, well, if the button's going to kill you, don't press it.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
By default, super intelligences end up wanting to hurt us and it's hard to make them not do that was missing on your list.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
And that's the point where you need to do philosophy in advance that compiles.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
The production of systematic correlations between map and territory, is one way of being more specific about what the word rationality…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Oh, there are technological developments where you can see ways that they would end poorly. It's not every technology that ends up well.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
If you're running the AI that can build the AI that builds that AI and you're not stopping, that's also it.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
It's not clear that all the pieces are in place and we just need to pile up more of the same stuff.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
So if you imagine that there's just like generic apocalypses coming at you out of nowhere with a fixed frequency, the longer the history…
Not checkable · Sep 2025 |
|
| Not researched |
Factual |
Sep 2025 |
In 2000 Eliezer Yudkowsky believed that a very smart AI would automatically end up very nice.
Factual · Sep 2025 |
Their own work or organisation |
| Not checkable |
Not checkable |
Sep 2025 |
Those AIs, probably all agree, trees are made of atoms.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
These things are dangerous to the extent that they are planning in the real world and can roll out their own technologies from scratch, or…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
But as long as they find it convincing to say, yeah, somebody else will do it anyway, they are going to do it.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
It's this color over here.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
I now think that this is actually mistaken, and that's not a vibe shift.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Conversation seems like a much harder problem than writing code, and I would've been wrong.
Not checkable · Sep 2025 |
|
| Not researched |
Factual |
Sep 2025 |
AI systems that are very good at chess have not destroyed the world.
Factual · Sep 2025 |
AI capabilities |
| Not researched |
Factual |
Sep 2025 |
The written book does not cover all objections to its argument; some additional objections are considered in an online supplement.
Factual · Sep 2025 |
Their own work or organisation |
| Not checkable |
Not checkable |
Sep 2025 |
I wish that it were under better circumstances and I wish the book title were an exaggeration.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
They're like, oh, somebody else will press it.
Not checkable · Sep 2025 |
|
| Not researched |
Factual |
Sep 2025 |
The speaker says that the person he is describing, who "saw through from there to nuclear weapons", saw that he should not publish his idea because it was a bit dangerous.
Factual · Sep 2025 |
Science and research methods |
| Not checkable |
Not checkable |
Sep 2025 |
The part where humans need to do philosophy in advance is when there's more than one reflective fix point or self approving…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
There is no physical bar to building a tree that buds off mosquitoes.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
if your virus isn't clever enough, you just need to seed it with more packages.
Not checkable · Sep 2025 |
|
| Not researched |
Factual |
Sep 2025 |
Yudkowsky said the very first place he carved out an exception to a general view of his was in the discussion about nanotechnology; the surrounding text does not say what that view was.
Factual · Sep 2025 |
Their own work or organisation |
| Not researched |
Factual |
Sep 2025 |
A delayed-critical nuclear reactor receiving 0.65% more neutrons would literally explode, not just melt down.
Factual · Sep 2025 |
Other global risks |
| Not checkable |
Not checkable |
Sep 2025 |
If you say that somebody else is gonna press it, instead, let them kill everyone.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
And at least, so far, it seems like in a lot of ways, the person on the street is wiser.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Once you've set the bottom line, once you if you imagine a sheet of paper and then you write at the bottom of the sheet of the paper…
Not checkable · Sep 2025 |
|
| Not researched |
Factual |
Sep 2025 |
AI has been used to optimize social media algorithms for outrage and clicks, and arguably contributed to political shifts involving a collapse of the use of expertise in government institutions.
Factual · Sep 2025 |
AI policy and governance |
| Not checkable |
Not checkable |
Sep 2025 |
I would normally ask you for a specific example at this point, but probably your viewers have already seen many specific examples, and so I…
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Trying to do it inside a human brain is playing on hard mode.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Excellent concrete example.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
I realized that my original model of reality had been mistaken.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
You can have things that steer the galaxy toward happily ever after for all life forms.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Here's the thing, this is not that hard.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
It helps discriminate, distinguish. It doesn't nail it down perfectly, but it shifts the probability.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
there is no canonical objection to why we're all going to die.
Not checkable · Sep 2025 |
|
| Not researched |
Factual |
Sep 2025 |
Leo Szilard foresaw that Hitler was likely to be a problem.
Factual · Sep 2025 |
Science and research methods |
| Not checkable |
Not checkable |
Sep 2025 |
There's, try to say more narrowly which things count or don't count under your theory.
Not checkable · Sep 2025 |
|
| Mostly true |
Factual |
Sep 2025 |
The conservation of mass was one of the first hints that things are rearranged rather than created or destroyed.
Factual · Sep 2025 |
Science and research methods |
| Not checkable |
Not checkable |
Sep 2025 |
I mean, everybody literally actually dead as in ceasing to breathe.
Not checkable · Sep 2025 |
|
| Not researched |
Factual |
Sep 2025 |
Leo Szilard did not foresee that the first atomic bomb would be dropped in August 1945.
Factual · Sep 2025 |
Science and research methods |
| Not checkable |
Not checkable |
Sep 2025 |
It doesn't matter what you write above the bottom line afterwards, it's already true or already false.
Not checkable · Sep 2025 |
|
| Not researched |
Factual |
Sep 2025 |
Diamond is made out of carbon.
Factual · Sep 2025 |
Science and research methods |
| Not checkable |
Not checkable |
Sep 2025 |
Yes, you should.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Still pro building a whole lot of nuclear power plants.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
Yep, and I stand by that today as well.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
All correct views of cognitive science, computer science are the same.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
I do not quickly expect that we will die before this video releases.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
So your brain is in the middle of a hurricane being buffeted about by many forces that are echoes of past forces.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
They reach around for a reason to say that they can keep going.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
In fact, I'm surprised that there isn't more automatic translation already and have been for a while.
Not checkable · Sep 2025 |
|
| Not checkable |
Not checkable |
Sep 2025 |
If you have reason to believe that they're only telling you some of the evidence or even that they're only telling you some of the…
Not checkable · Sep 2025 |
|
| Resolved true |
Factual |
Sep 2025 |
Burning a substance inside a sealed glass vessel does not change the total weight.
Factual · Sep 2025 |
Science and research methods |
| Not checkable |
Not checkable |
15 May 2025 |
And this is — not quite MIRI’s last desperate hope — but probably the best of the desperate hopes remaining that you can do anything about…
Not checkable · 15 May 2025 |
|
| Not checkable |
Not checkable |
29 Mar 2024 |
apparently this battle is not quite over yet
Not checkable · 29 Mar 2024 |
|
| Unresolvable |
Factual |
29 Mar 2024 |
Current AIs are roughly as generally intelligent, as dangerous and as controllable as human 4-year-olds.
Factual · 29 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
29 Mar 2024 |
If Yudkowsky's policy proposals are not adopted and a distorted version is used to justify government takeover, a government rather than a private company might kill everyone on Earth.
Prediction · 29 Mar 2024 |
AI policy and governance |
| Not checkable |
Not checkable |
28 Mar 2024 |
Interesting bounty format.
Not checkable · 28 Mar 2024 |
|
| Not checkable |
Not checkable |
27 Mar 2024 |
The current setup is simply not competent to do that safely or validly.
Not checkable · 27 Mar 2024 |
|
| Not checkable |
Not checkable |
27 Mar 2024 |
I think that given the vast distance between the modern-day bureaucracy trying to handle this, and the ways of thinking required to…
Not checkable · 27 Mar 2024 |
|
| Unresolvable |
Prediction |
27 Mar 2024 |
Civilization must back off from building artificial superintelligence or it will die; there is no other outcome.
Prediction · 27 Mar 2024 |
AI policy and governance |
| Not checkable |
Not checkable |
27 Mar 2024 |
There are only people who know enough of alignment to say, "If we don't back off, we will die."
Not checkable · 27 Mar 2024 |
|
| Unresolvable |
Prediction |
27 Mar 2024 |
No institution on Earth can solve AI alignment in time, and extremely likely none can solve it at all.
Prediction · 27 Mar 2024 |
AI safety and alignment |
| Not checkable |
Not checkable |
27 Mar 2024 |
Because Science the way we know it does need empiricism.
Not checkable · 27 Mar 2024 |
|
| Unresolvable |
Prediction |
27 Mar 2024 |
If today's civilization is allowed to build superintelligence, everyone will die.
Prediction · 27 Mar 2024 |
AI safety and alignment |
| Not checkable |
Not checkable |
27 Mar 2024 |
Humans augmented far enough to stop being idiots, smart enough that they never put faith in a step that will not hold, as do not exist in…
Not checkable · 27 Mar 2024 |
|
| Not checkable |
Not checkable |
27 Mar 2024 |
Only by then, of course, everyone is dead.
Not checkable · 27 Mar 2024 |
|
| Not checkable |
Not checkable |
27 Mar 2024 |
A gap like that cannot be crossed by appointing a prestigious committee of the same scientists who told you 10 years ago that there was no…
Not checkable · 27 Mar 2024 |
|
| Unresolvable |
Prediction |
26 Mar 2024 |
If a government's privileged-access AI turns into an artificial superintelligence, humanity will be killed.
Prediction · 26 Mar 2024 |
AI safety and alignment |
| Not checkable |
Not checkable |
26 Mar 2024 |
What we want is a universal ban on anything that might turn into a superintelligence.
Not checkable · 26 Mar 2024 |
|
| Not checkable |
Not checkable |
25 Mar 2024 |
The reasoning is locally valid as a matter of economics, but you need a rather different "regulation" to prevent ASIs from just illegally…
Not checkable · 25 Mar 2024 |
|
| Mostly true |
Factual |
25 Mar 2024 |
Yudkowsky was unpleasantly surprised by how well transformers scaled, having believed the human brain is not homogeneous.
Factual · 25 Mar 2024 |
AI capabilities |