Claims

2,653 claims by 33 public figures and organisations, checked against the public record. Each has its quote, source, verdict and evidence. Read them without a key; browse by person.

28,548 claims, sorted by newest said. Choose a claim to read it in full.
VerdictPersonKindSaidClaimTopic
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The first thing I’d want to say is this is an empirical question. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The thing I’m worried about is that it’s going to end up with a randomly rolled utility function whose maximum happens to be a particular… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I think that that example might be unconvincing to somebody who’s coming in with a suspicion that intelligence and values are correlated. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I don’t want to put absolute faith, because there is the replication crisis Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Now that’s not human general, but it’s a step forward in generality of the sort that we’re talking about. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 They’re looking in the wrong direction and ignoring the thing that’s actually going to kill them. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Then my guess would be something like Kickstarter, but much better, that turned out to enable people in large groups to move forward when… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Mostly true Eliezer Yudkowsky Factual 28 Feb 2018 One condition of the AI-box experiment was that no one would ever say what went on inside it. Eliezer Yudkowsky · Factual · 28 Feb 2018 AI safety and alignment
Own records only Eliezer Yudkowsky Factual 28 Feb 2018 At the time of the interview, Eliezer Yudkowsky said he did not remember whether the person being discussed, apparently Robin, had yet replied to a particular point. Eliezer Yudkowsky · Factual · 28 Feb 2018 Their own work or organisation
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Nothing can prepare you for Robin Hanson! Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 it is okay for us to reason about aligned (or even unaligned) artificial general intelligences of sufficient power as if they’re trying to… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Maybe AlphaZero is the sort of thing that happens five years before the end of the world across most planets in the universe. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Which means that it’s not the case that as you scale intelligence, it gets harder and harder to buy. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 That’s the little big problem, which is still a very large problem. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Mostly true Eliezer Yudkowsky Factual 28 Feb 2018 Even most scientists in the field had no idea how to build a nuclear bomb until the Hiroshima headlines. Eliezer Yudkowsky · Factual · 28 Feb 2018 Other global risks
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I think the model of the world is wrong. I think they’re factually wrong about what happens when you take a random AI and make it much… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 humans are not secure software. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 These two questions together form a paperclip maximizer. You don’t need anything else. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 the idea that human minds are secure is loony. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 That’s what the AI-box experiment illustrates. You don’t know what went on in there, and that’s exactly the position you’d be in with… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 You only get oughts from other oughts. That’s the Hume version of the thesis. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not researched Eliezer Yudkowsky Factual 28 Feb 2018 AlphaZero does not need to first completely rewrite itself to do powerful things, making it more plausible that AIs could do dangerous or useful things without prior complete self-rewrites. Eliezer Yudkowsky · Factual · 28 Feb 2018 AI capabilities
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I would describe myself as a decision theorist. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I’m worried that it’s not happening fast enough Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Parenthetically, I do want to be slightly careful about using the word “rational” to describe the behavior of people stuck in the system… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Collectively. Like, if people who slow down and do things right finish their work two years after the universe has been destroyed, that’s… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 the way I would phrase it is that it’s not that the paperclip maximizer has a different set of oughts, but that we can see it as running… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 all of the ones who are not utter idiots are past the point where they would deliberately enact Hollywood movie plots. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 We know humans are conscious, so the computations that you run to build very accurate predictive models of humans are among the parts that… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Unresolvable Eliezer Yudkowsky Prediction 28 Feb 2018 Very powerful and smart AI systems will redesign and improve themselves unless prevented for some reason. Eliezer Yudkowsky · Prediction · 28 Feb 2018 AI safety and alignment
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 And I would say this is a computer science issue. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 So, one way to look at the book is that it’s about how you can get crazy, stupid, evil large systems without any of the people inside them… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 paperclips are not one of those things. No matter how long you stare at a paperclip, it still seems pretty pointless from our perspective. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The original “orthogonal” means “at right angles.” Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 And I find that convincing, but other people may want additional details. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I’d say that Neil de Grasse Tyson is failing to respect the AI’s intelligence to the point of asking what he would do if he were inside a… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I’d say this is a thesis of capability gain. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Resolved true Eliezer Yudkowsky Factual 28 Feb 2018 Nobody currently knows how to build a safe, friendly ("nice") AI. Eliezer Yudkowsky · Factual · 28 Feb 2018 AI safety and alignment
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I don’t think we’re looking at an economic problem. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 A coordination problem is where there’s a better way to do it, but you have to change more than one thing at a time. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 They’re not imagining enough changing simultaneously. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I don’t think that’s true, but I’m worried about the sentiment behind it. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 It could be 50 years away. It could be two years away. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Unresolvable Eliezer Yudkowsky Prediction 28 Feb 2018 No AI development will ever look like a socially agreed, undeniable fire alarm for AGI. Eliezer Yudkowsky · Prediction · 28 Feb 2018 AI timelines and forecasting
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The people at Google are not dumb enough to build an AI and tell it to make paperclips. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 that pursues arbitrary tractable goals. Including, for example, making paperclips. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 you can have arbitrarily powerful intelligence, with no defects of that intelligence Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I wouldn’t say disparagement. These are just initial reactions. These are people we haven’t been talking to yet. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The main way in which I would be worried about conscious systems emerging within the system without that happening on purpose would be if… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 But the three laws, I mean, they’re deontology. Decision theory requires quantitative weights on your goals. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I would mostly say intelligence.org. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not researched Eliezer Yudkowsky Factual 28 Feb 2018 Yudkowsky said the position he defends was named the orthogonality thesis by somebody he thought was Nick Bostrom. Eliezer Yudkowsky · Factual · 28 Feb 2018 AI safety and alignment
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Instrumental convergence! Which means that a lot of times, across a very broad range of final goals, there are similar strategies (we… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 We aren’t smart enough to treat the brain as something that from our perspective is a mechanical system and just navigate it to where you… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 It’s more about how to predict which parts of society will perform poorly to the point where you as an individual can manage to do better… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 And if you don’t have a business plan for this sort of thing, then you’re obviously just using it as an excuse. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 AlphaZero seems to me like a genuine case in point. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 We’re still on the same map. I agree with most of it. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 It is certainly possible to have agents such that as they get smarter, what they would report as their utility functions will change. A… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Unresolvable Eliezer Yudkowsky Prediction 28 Feb 2018 Once artificial general intelligence capabilities exist, something like AlphaZero going "from 0 to 120 mph in four hours or a day" is not out of the question. Eliezer Yudkowsky · Prediction · 28 Feb 2018 AI timelines and forecasting
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I didn’t have any super-secret special trick that makes it all make sense in retrospect. I just did it the hard way. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I mean, sort of crowdfunding, I guess, although the hammer currently isn’t very large. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 But this is a fairy tale. This is not a prediction. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 there seems to have been a very sharp jump in generality between chimpanzees and humans. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The thing I’m worried about is that the way that natural selection does it—it’s not stable. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The sentiments behind this are something that I have a great deal of sympathy for. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 But broadly speaking, it’s an AI where you can say what it’s trying to do. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Those are plot devices. If they worked, Asimov would have had no stories. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 And that in turn is an example that refutes another thesis about how artificial general intelligence develops slowly and gradually Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 they couldn’t all jump to the new system because they couldn’t jump one at a time. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The thing that makes something smarter than you dangerous is you cannot foresee everything it might try. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Mostly true Eliezer Yudkowsky Factual 28 Feb 2018 Thanks mostly to the cryptocurrency boom, MIRI is no longer short of funds and is instead short of engineering talent. Eliezer Yudkowsky · Factual · 28 Feb 2018 Field building and careers
Unresolvable Eliezer Yudkowsky Factual 28 Feb 2018 Yudkowsky said he was pretty sure he was not the one who invented the term under discussion. Eliezer Yudkowsky · Factual · 28 Feb 2018 Other
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I’m not concerned that you’re going to teach the AI to deceive humans. I’m concerned that someone somewhere is going to get to the point of… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 the real story wasn’t in how AlphaGo beat human Go players. It’s in how AlphaZero beat human Go system programmers and human chess system… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The system didn’t fit me that well, and I’m good at self-teaching. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 This is the special case of the system that is smart in the way that you are smart and that mice are not smart. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not researched Eliezer Yudkowsky Factual 28 Feb 2018 Asked whether the thought experiment originated with Bostrom, Eliezer Yudkowsky said that, as far as he knew, it originated with him. Eliezer Yudkowsky · Factual · 28 Feb 2018 Their own work or organisation
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The problem I’m worried about is that it’s technically difficult to get the AI to have a particular goal set and keep that goal set and… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The way I would rephrase the fact/values thing is: We all know about David Hume and Hume’s Razor Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not researched Eliezer Yudkowsky Factual 28 Feb 2018 AI researchers who forecast AGI about 30 years off have not argued that, once reached, AGI will develop much more slowly than AlphaZero did. Eliezer Yudkowsky · Factual · 28 Feb 2018 AI timelines and forecasting
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Okay, what changes your mind short of the world actually ending? Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 This is not here to fit into some kind of grand moral lesson that I have for you about how civilization ought to work. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Yeah, that’s not going to save you from something that’s significantly smarter than you are. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 then the feeling of something being far away because you don’t know how to do it yet is just not very informative. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 the key to that is our ability to learn things that natural selection did not preprogram us with; so learning is the key to generality. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 But the more complicated the system is and the less you understand the system, the more something smarter than you may have what is simply… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 That’s actually a surprisingly good plot Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Own records only Eliezer Yudkowsky Factual 28 Feb 2018 MIRI has some communication with DeepMind's upper people, though the bandwidth is not optimal. Eliezer Yudkowsky · Factual · 28 Feb 2018 Their own work or organisation
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 One is: “by definition”? We don’t care what’s true by definition here. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 It doesn’t scale. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not researched Eliezer Yudkowsky Factual 28 Feb 2018 Economists already know about market failures and have that concept. Eliezer Yudkowsky · Factual · 28 Feb 2018 Economics and markets
Unresolvable Eliezer Yudkowsky Prediction 28 Feb 2018 An AI built narrowly enough to be understood will not be able to defend against arbitrary unrestrained superintelligences. Eliezer Yudkowsky · Prediction · 28 Feb 2018 AI safety and alignment
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 So the orthogonality thesis is that an intelligence that pursues paperclips for their own sake, because that’s what its utility function… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not researched Eliezer Yudkowsky Factual 28 Feb 2018 MIRI is the original AI alignment organization and today works primarily on the technical parts of the alignment problem. Eliezer Yudkowsky · Factual · 28 Feb 2018 Their own work or organisation
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 That’s one of the fundamental foundational ways that systems can get stuck. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I think that the main thing you should be trying to do with the first artificial general intelligence ever built is a very narrow… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 If there was a way to make an enormous profit by knowing this, the profit would probably already be taken. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I think, by the way, that that’s a pretty terrible term. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 if alignment is technically difficult, if it is easy to screw up, if it requires a bunch of additional effort Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Back to the list

Not checkable

“The thing I’m worried about is that the way that natural selection does it—it’s not stable.”

Eliezer Yudkowsky 28 February 2018 Sam Harris and Eliezer Yudkowsky on "AI: Racing Toward the Brink" (MIRI)

The thing I’m worried about is that the way that natural selection does it—it’s not stable.

Not checkable An opinion, value judgement or statement with nothing to check.

Cite this claim

Eliezer Yudkowsky, “The thing I’m worried about is that the way that natural selection does it—it’s not stable.” (said 28 February 2018). Verdict: not checkable. Reliability API, claim c_7010094cd22f, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_7010094cd22f

Verdicts are made automatically; how verdicts and scores are made. The same data is on Hugging Face under CC BY 4.0.