| Not checkable |
Not checkable |
10 Jun 2022 |
I have several times failed to write up a well-organized list of reasons why AGI will kill you.
Not checkable · 10 Jun 2022 |
|
| Not checkable |
Not checkable |
10 Jun 2022 |
If you perfectly learn and perfectly maximize the referent of rewards assigned by human operators, that kills them.
Not checkable · 10 Jun 2022 |
|
| Not checkable |
Not checkable |
10 Jun 2022 |
Surviving worlds, by this point, and in fact several decades earlier, have a plan for how to survive.
Not checkable · 10 Jun 2022 |
|
| Not checkable |
Not checkable |
10 Jun 2022 |
And become that cynical old veteran right away, before reality whaps you upside the head in the form of everybody dying and you not getting…
Not checkable · 10 Jun 2022 |
|
| Not checkable |
Not checkable |
10 Jun 2022 |
All of these kill you if optimized-over by a sufficiently powerful intelligence
Not checkable · 10 Jun 2022 |
|
| Not checkable |
Not checkable |
10 Jun 2022 |
The best and easiest-found-by-optimization algorithms for solving problems we want an AI to solve, readily generalize to problems we’d…
Not checkable · 10 Jun 2022 |
|
| Not checkable |
Not checkable |
10 Jun 2022 |
There is no pivotal output of an AGI that is humanly checkable and can be used to safely save the world but only after checking it
Not checkable · 10 Jun 2022 |
|
| Not checkable |
Not checkable |
10 Jun 2022 |
We’ve got no idea what’s actually going on inside the giant inscrutable matrices and tensors of floating-point numbers.
Not checkable · 10 Jun 2022 |
|
| Not checkable |
Not checkable |
10 Jun 2022 |
The big ask from AGI alignment, the basic challenge I am saying is too difficult, is to obtain by any strategy whatsoever a significant…
Not checkable · 10 Jun 2022 |
|
| Not checkable |
Not checkable |
10 Jun 2022 |
I do not know how to train it into others.
Not checkable · 10 Jun 2022 |
|
| Not checkable |
Not checkable |
10 Jun 2022 |
Therefore, capabilities generalize further out-of-distribution than alignment, once they start to generalize at all.
Not checkable · 10 Jun 2022 |
|
| Not checkable |
Not checkable |
10 Jun 2022 |
This general problem is a fact about the territory, not the map
Not checkable · 10 Jun 2022 |
|
| Not checkable |
Not checkable |
10 Jun 2022 |
They probably do not know where the real difficulties are, they probably do not understand what needs to be done, they cannot tell the…
Not checkable · 10 Jun 2022 |
|
| Not checkable |
Not checkable |
25 Dec 2021 |
English may seem like a terrible language now, but imagine aliens running across it and trying to infer back human society based on the…
Not checkable · 25 Dec 2021 |
|
| Not checkable |
Not checkable |
23 Dec 2021 |
I really really really hope that they did warn him and Biden is just lying, because the alternative is that everyone in or near the White…
Not checkable · 23 Dec 2021 |
|
| Not checkable |
Not checkable |
21 Dec 2021 |
Yeah, see, the problem is, if you die in that science-fiction movie, you die in real life.
Not checkable · 21 Dec 2021 |
|
| Not checkable |
Not checkable |
16 Dec 2021 |
look I am not judging you I am comparing your performance unfavorably to that of an ideal agent and that's totally different
Not checkable · 16 Dec 2021 |
|
| Not checkable |
Not checkable |
5 Dec 2021 |
Directly challenges alignment; doesn't significantly burn the capability commons that I noticed; doesn't overstate the accomplishment and…
Not checkable · 5 Dec 2021 |
|
| Not checkable |
Not checkable |
5 Dec 2021 |
I'm slightly cheerful about this paper; it caused me to mildly positively update on @AnthropicAI.
Not checkable · 5 Dec 2021 |
|
| Not checkable |
Not checkable |
3 Dec 2021 |
(Interesting theory on a subject that continues to interest me.)
Not checkable · 3 Dec 2021 |
|
| Not checkable |
Not checkable |
29 Nov 2021 |
if you don't want to create needless public panic and plunge us all into the overt appearance of a scifi catastrophe flick, don't name…
Not checkable · 29 Nov 2021 |
|
| Not checkable |
Not checkable |
25 Nov 2021 |
At the rate we're going through the Greek alphabet, we don't have much time left to vaccinate the world before we face the Omega Variant.
Not checkable · 25 Nov 2021 |
|
| Not checkable |
Not checkable |
23 Nov 2021 |
FDA plans to kill 50,000 Americans over the next month - over 16X the direct casualties from 2001/9/11 - by keeping it illegal for doctors…
Not checkable · 23 Nov 2021 |
|
| Not checkable |
Not checkable |
23 Nov 2021 |
Lots of small weird stuff still underfunded IMO, and this is where non-billionaires get their chance to shine.
Not checkable · 23 Nov 2021 |
|
| Not checkable |
Not checkable |
22 Nov 2021 |
If he's representing the state of knowledge accurately, this is the point where I call it for artificial origin of SARS-COV-2.
Not checkable · 22 Nov 2021 |
|
| Not checkable |
Not checkable |
22 Nov 2021 |
Matt Ridley is on the very short list of journalists I would answer if they emailed me.
Not checkable · 22 Nov 2021 |
|
| Not checkable |
Not checkable |
19 Nov 2021 |
Having built up dath ilan a bit, I'm surprised in retrospect that I can't think of any other science fiction set in a World of Nerds.
Not checkable · 19 Nov 2021 |
|
| Not checkable |
Not checkable |
17 Nov 2021 |
I am being sooo very good right now.
Not checkable · 17 Nov 2021 |
|
| Not checkable |
Not checkable |
17 Nov 2021 |
Today there was an antisemitic tweet mentioning me that has over 1K Likes, and I'm doing the right thing and *not* screenshotting it to…
Not checkable · 17 Nov 2021 |
|
| Not checkable |
Not checkable |
16 Nov 2021 |
I notice that I am confused about how any human being discovered smelting ore for the first time.
Not checkable · 16 Nov 2021 |
|
| Not checkable |
Not checkable |
12 Nov 2021 |
remember, anything over 70% cacao is not technically "chocolate" but a kind of edible dirt from which all the fun has been extracted
Not checkable · 12 Nov 2021 |
|
| Not checkable |
Not checkable |
12 Nov 2021 |
The dath ilani equivalent of the 4th of July is the annual Oops It's Time To Overthrow The Government Festival, in which citizens rehearse…
Not checkable · 12 Nov 2021 |
|
| Not checkable |
Not checkable |
12 Nov 2021 |
The stereotype I have for venture capital says that they will tend to fund 7 companies that all claim they'll have 20% of the sprocket…
Not checkable · 12 Nov 2021 |
|
| Not checkable |
Not checkable |
10 Nov 2021 |
This is not a universal fact, but a circumstantial one.
Not checkable · 10 Nov 2021 |
|
| Not checkable |
Not checkable |
10 Nov 2021 |
Let me now be clear, in case anyone who matters happens to be listening, that the Fed should tighten more, right away.
Not checkable · 10 Nov 2021 |
|
| Not checkable |
Not checkable |
9 Nov 2021 |
If you're going to cheat at all, cheat recursively.
Not checkable · 9 Nov 2021 |
|
| Not checkable |
Not checkable |
8 Nov 2021 |
Okay, honestly I'm a bit happy about living in a world where the richest openly-rich person on the planet just renamed himself to "Lorde…
Not checkable · 8 Nov 2021 |
|
| Not checkable |
Not checkable |
7 Nov 2021 |
Just imagine if each Bitcoin had been one-trillionth of the maximum total supply, by a universal convention which all coins adopted…
Not checkable · 7 Nov 2021 |
|
| Not checkable |
Not checkable |
7 Nov 2021 |
That this never happened says something basic about humanity.
Not checkable · 7 Nov 2021 |
|
| Not checkable |
Not checkable |
6 Nov 2021 |
Keep the "fall back" where we set the clock an hour earlier, but ditch the "spring forward" when we set the clock an hour later.
Not checkable · 6 Nov 2021 |
|
| Not checkable |
Not checkable |
6 Nov 2021 |
Be suspicious when you witness a debate where the pessimists have lots of concrete examples and scenarios and the optimists are speaking…
Not checkable · 6 Nov 2021 |
|
| Not checkable |
Not checkable |
3 Nov 2021 |
If EMH wasn't true about almost-all prices relative to you, you could trade arbitrary assets and go up 10% per day.
Not checkable · 3 Nov 2021 |
|
| Not checkable |
Not checkable |
3 Nov 2021 |
The only serious debate is whether the Efficient Markets Hypothesis is true about *all* asset prices *all* of the time for you, or merely…
Not checkable · 3 Nov 2021 |
|
| Not checkable |
Not checkable |
31 Dec 2020 |
_Screwtape Letters_ is close enough to being Good and True that I'm having trouble reading it
Not checkable · 31 Dec 2020 |
|
| Not checkable |
Not checkable |
31 Dec 2020 |
Savor the last day of 2020 while you can.
Not checkable · 31 Dec 2020 |
|
| Not checkable |
Not checkable |
30 Dec 2020 |
This is practically an AU Sequence.
Not checkable · 30 Dec 2020 |
|
| Not checkable |
Not checkable |
28 Dec 2020 |
White chocolate is best chocolate
Not checkable · 28 Dec 2020 |
|
| Not checkable |
Not checkable |
28 Dec 2020 |
they have chosen to professionally specialize in fact-insensitive Frowning In Concern At Things.
Not checkable · 28 Dec 2020 |
|
| Not checkable |
Not checkable |
22 Dec 2020 |
are just Trans-Exclusionary Radical Humanists.
Not checkable · 22 Dec 2020 |
|
| Not checkable |
Not checkable |
20 Dec 2020 |
why would I want to become a vampire and see in the dark when I could, instead, just cover everything around me in glow-in-the-dark stickers
Not checkable · 20 Dec 2020 |
|
| Not checkable |
Not checkable |
20 Dec 2020 |
I'm pretty sure they've already been given some info, and that info is all wrong
Not checkable · 20 Dec 2020 |
|
| Not checkable |
Not checkable |
19 Dec 2020 |
A person who needs to feel ironically superior to something, and somehow manages to pick fucking probability theory
Not checkable · 19 Dec 2020 |
|
| Not checkable |
Not checkable |
17 Dec 2020 |
Lawful good: Base 10
Not checkable · 17 Dec 2020 |
|
| Not checkable |
Not checkable |
16 Dec 2020 |
I kept expecting this to happen and wondering why it wasn't already happening
Not checkable · 16 Dec 2020 |
|
| Not checkable |
Not checkable |
12 Dec 2020 |
I worry about dividing the United States because I currently estimate that if you take the center of all blue US states, plus the center of…
Not checkable · 12 Dec 2020 |
|
| Not checkable |
Not checkable |
11 Dec 2020 |
Vote for good epistemics.
Not checkable · 11 Dec 2020 |
|
| Not checkable |
Not checkable |
7 Dec 2020 |
How strange it is that modern US politics has become completely devoid of both liberalism and conservatism
Not checkable · 7 Dec 2020 |
|
| Not checkable |
Not checkable |
2 Dec 2020 |
Looks like all our tweeting has had an effect
Not checkable · 2 Dec 2020 |
|
| Not checkable |
Not checkable |
30 Nov 2020 |
It was silly that people tried to argue with that massively overdetermined step, but they did.
Not checkable · 30 Nov 2020 |
|
| Not checkable |
Not checkable |
25 Nov 2020 |
2000 was the most consequential election if you were alive then.
Not checkable · 25 Nov 2020 |
|
| Not checkable |
Not checkable |
25 Nov 2020 |
We need a Wikipedia-like group that can duly investigate such allegations of journalistic malfeasance
Not checkable · 25 Nov 2020 |
|
| Not checkable |
Not checkable |
20 Nov 2020 |
Those effect sizes seem large for people who were already selected to be salespeople in the first place.
Not checkable · 20 Nov 2020 |
|
| Not checkable |
Not checkable |
20 Nov 2020 |
It's disconcerting how much online advertising seems to be centered around an absolute denial of agency to the viewers.
Not checkable · 20 Nov 2020 |
|
| Not checkable |
Not checkable |
13 Nov 2020 |
Maybe the best way to fight fake news is to create so much of it that people give up and check Wikipedia.
Not checkable · 13 Nov 2020 |
|
| Not checkable |
Not checkable |
9 Nov 2020 |
Though technically I'd say this is Optimizer's Curse, not Winner's Curse.
Not checkable · 9 Nov 2020 |
|
| Not checkable |
Not checkable |
7 Nov 2020 |
I don't think that's how the system should work
Not checkable · 7 Nov 2020 |
|
| Not checkable |
Not checkable |
6 Nov 2020 |
So many memes, so few that are truly important.
Not checkable · 6 Nov 2020 |
|
| Not checkable |
Not checkable |
4 Nov 2020 |
I can't ever remember seeing a big-money betting market doing anything like this.
Not checkable · 4 Nov 2020 |
|
| Not checkable |
Not checkable |
4 Nov 2020 |
I think the timelines are literally diverging right now!
Not checkable · 4 Nov 2020 |
|
| Not checkable |
Not checkable |
3 Nov 2020 |
There's so many different sad jokes I could make about this that I'm going to leave them as a reader exercise.
Not checkable · 3 Nov 2020 |
|
| Not checkable |
Not checkable |
28 Oct 2020 |
I wonder if there's any correlation between modern sanity losses, and discoveries in science no longer being named after individuals.
Not checkable · 28 Oct 2020 |
|
| Not checkable |
Not checkable |
23 Oct 2020 |
the Democratic Party will keep running candidates so awful that ~half the population
Not checkable · 23 Oct 2020 |
|
| Not checkable |
Not checkable |
21 Oct 2020 |
I feel that I should get credit for turning out even *this* normal
Not checkable · 21 Oct 2020 |
|
| Not checkable |
Not checkable |
17 Oct 2020 |
So many Onion articles have become reality that I now feel scared that this, too, will become real
Not checkable · 17 Oct 2020 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
I think that a lot of people in the field would agree that human-level AI, defined as “literally at the human level, neither above nor…
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
A conman who just wants money and gets no innate kick out of you believing false things will cause you to believe false things in order to…
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
I’m concerned that the sloppy version can be built two years earlier and that there is no non-sloppy version to defend us from it.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
Whereas endless dystopias don’t seem to me to have any use to a paperclip maximizer.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
Because I’m not sure I believe you.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
You are in a terrible, terrible situation.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
Our current methods of alignment do not scale, and I think that all of the actual technical difficulty that is actually going to shoot down…
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
More toward the fairy tale.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
the unknowable is a concept you have to be very careful with.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
our only competitor in terms of general optimization—where “optimization” is that sort of narrowing of the future that I talked about—is…
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
And this is the kind of thinking that does not enable you to save civilization.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
deceiving the humans into thinking that you are friendly is a very generic strategy across a wide range of utility functions.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
The first thing I’d want to say is this is an empirical question.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
The thing I’m worried about is that it’s going to end up with a randomly rolled utility function whose maximum happens to be a particular…
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
I think that that example might be unconvincing to somebody who’s coming in with a suspicion that intelligence and values are correlated.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
I don’t want to put absolute faith, because there is the replication crisis
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
Now that’s not human general, but it’s a step forward in generality of the sort that we’re talking about.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
They’re looking in the wrong direction and ignoring the thing that’s actually going to kill them.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
Then my guess would be something like Kickstarter, but much better, that turned out to enable people in large groups to move forward when…
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
Nothing can prepare you for Robin Hanson!
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
it is okay for us to reason about aligned (or even unaligned) artificial general intelligences of sufficient power as if they’re trying to…
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
Maybe AlphaZero is the sort of thing that happens five years before the end of the world across most planets in the universe.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
Which means that it’s not the case that as you scale intelligence, it gets harder and harder to buy.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
That’s the little big problem, which is still a very large problem.
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
I think the model of the world is wrong. I think they’re factually wrong about what happens when you take a random AI and make it much…
Not checkable · 28 Feb 2018 |
|
| Not checkable |
Not checkable |
28 Feb 2018 |
humans are not secure software.
Not checkable · 28 Feb 2018 |
|