Claims

2,653 claims by 33 public figures and organisations, checked against the public record. Each has its quote, source, verdict and evidence. Read them without a key; browse by person.

18,133 claims · page 139 of 182

18,133 claims, sorted by newest said. Choose a claim to read it in full.
VerdictPersonKindSaidClaimTopic
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Then my guess would be something like Kickstarter, but much better, that turned out to enable people in large groups to move forward when… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Nothing can prepare you for Robin Hanson! Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 it is okay for us to reason about aligned (or even unaligned) artificial general intelligences of sufficient power as if they’re trying to… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Maybe AlphaZero is the sort of thing that happens five years before the end of the world across most planets in the universe. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Which means that it’s not the case that as you scale intelligence, it gets harder and harder to buy. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 That’s the little big problem, which is still a very large problem. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I think the model of the world is wrong. I think they’re factually wrong about what happens when you take a random AI and make it much… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 humans are not secure software. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 These two questions together form a paperclip maximizer. You don’t need anything else. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 the idea that human minds are secure is loony. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 That’s what the AI-box experiment illustrates. You don’t know what went on in there, and that’s exactly the position you’d be in with… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 You only get oughts from other oughts. That’s the Hume version of the thesis. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I would describe myself as a decision theorist. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I’m worried that it’s not happening fast enough Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Parenthetically, I do want to be slightly careful about using the word “rational” to describe the behavior of people stuck in the system… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Collectively. Like, if people who slow down and do things right finish their work two years after the universe has been destroyed, that’s… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 the way I would phrase it is that it’s not that the paperclip maximizer has a different set of oughts, but that we can see it as running… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 all of the ones who are not utter idiots are past the point where they would deliberately enact Hollywood movie plots. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 We know humans are conscious, so the computations that you run to build very accurate predictive models of humans are among the parts that… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 And I would say this is a computer science issue. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 So, one way to look at the book is that it’s about how you can get crazy, stupid, evil large systems without any of the people inside them… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 paperclips are not one of those things. No matter how long you stare at a paperclip, it still seems pretty pointless from our perspective. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The original “orthogonal” means “at right angles.” Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 And I find that convincing, but other people may want additional details. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I’d say that Neil de Grasse Tyson is failing to respect the AI’s intelligence to the point of asking what he would do if he were inside a… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I’d say this is a thesis of capability gain. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I don’t think we’re looking at an economic problem. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 A coordination problem is where there’s a better way to do it, but you have to change more than one thing at a time. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 They’re not imagining enough changing simultaneously. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I don’t think that’s true, but I’m worried about the sentiment behind it. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 It could be 50 years away. It could be two years away. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The people at Google are not dumb enough to build an AI and tell it to make paperclips. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 that pursues arbitrary tractable goals. Including, for example, making paperclips. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 you can have arbitrarily powerful intelligence, with no defects of that intelligence Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I wouldn’t say disparagement. These are just initial reactions. These are people we haven’t been talking to yet. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The main way in which I would be worried about conscious systems emerging within the system without that happening on purpose would be if… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 But the three laws, I mean, they’re deontology. Decision theory requires quantitative weights on your goals. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I would mostly say intelligence.org. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Instrumental convergence! Which means that a lot of times, across a very broad range of final goals, there are similar strategies (we… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 We aren’t smart enough to treat the brain as something that from our perspective is a mechanical system and just navigate it to where you… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 It’s more about how to predict which parts of society will perform poorly to the point where you as an individual can manage to do better… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 And if you don’t have a business plan for this sort of thing, then you’re obviously just using it as an excuse. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 AlphaZero seems to me like a genuine case in point. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 We’re still on the same map. I agree with most of it. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 It is certainly possible to have agents such that as they get smarter, what they would report as their utility functions will change. A… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I didn’t have any super-secret special trick that makes it all make sense in retrospect. I just did it the hard way. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I mean, sort of crowdfunding, I guess, although the hammer currently isn’t very large. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 But this is a fairy tale. This is not a prediction. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 there seems to have been a very sharp jump in generality between chimpanzees and humans. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The thing I’m worried about is that the way that natural selection does it—it’s not stable. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The sentiments behind this are something that I have a great deal of sympathy for. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 But broadly speaking, it’s an AI where you can say what it’s trying to do. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Those are plot devices. If they worked, Asimov would have had no stories. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 And that in turn is an example that refutes another thesis about how artificial general intelligence develops slowly and gradually Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 they couldn’t all jump to the new system because they couldn’t jump one at a time. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The thing that makes something smarter than you dangerous is you cannot foresee everything it might try. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I’m not concerned that you’re going to teach the AI to deceive humans. I’m concerned that someone somewhere is going to get to the point of… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 the real story wasn’t in how AlphaGo beat human Go players. It’s in how AlphaZero beat human Go system programmers and human chess system… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The system didn’t fit me that well, and I’m good at self-teaching. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 This is the special case of the system that is smart in the way that you are smart and that mice are not smart. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The problem I’m worried about is that it’s technically difficult to get the AI to have a particular goal set and keep that goal set and… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The way I would rephrase the fact/values thing is: We all know about David Hume and Hume’s Razor Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Okay, what changes your mind short of the world actually ending? Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 This is not here to fit into some kind of grand moral lesson that I have for you about how civilization ought to work. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Yeah, that’s not going to save you from something that’s significantly smarter than you are. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 then the feeling of something being far away because you don’t know how to do it yet is just not very informative. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 the key to that is our ability to learn things that natural selection did not preprogram us with; so learning is the key to generality. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 But the more complicated the system is and the less you understand the system, the more something smarter than you may have what is simply… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 That’s actually a surprisingly good plot Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 One is: “by definition”? We don’t care what’s true by definition here. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 It doesn’t scale. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 So the orthogonality thesis is that an intelligence that pursues paperclips for their own sake, because that’s what its utility function… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 That’s one of the fundamental foundational ways that systems can get stuck. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I think that the main thing you should be trying to do with the first artificial general intelligence ever built is a very narrow… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 If there was a way to make an enormous profit by knowing this, the profit would probably already be taken. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I think, by the way, that that’s a pretty terrible term. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 if alignment is technically difficult, if it is easy to screw up, if it requires a bunch of additional effort Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 a paperclip maximizer is built so as to respond to “is” questions about paperclips, not about what is right and what is good Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I don’t technically agree with it either. What I would say is that the facts are not motivating. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 for AlphaGo to play better Go than the best human Go players, it must be the case that the best human Go players cannot predict exactly… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 The thing the chimp is better at doesn’t play a big role in our global economy. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 But humanly speaking—not so much in terms of ideal rationality, but in terms of what people can actually do and the options they actually… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 my claim is not that there is a grand narrative that makes it emotionally consonant that paperclip maximizers are a thing. I’m claiming… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 But it was clear that I could self-teach, so that’s what I did. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 It can’t be settled by definitions; it can’t be settled by how you define “intelligence.” Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 It’s possible that if they were all really rational and had common knowledge of rationality, they would be able to solve the coordination… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I’m not concerned that alignment is impossible. I’m concerned that it’s difficult. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 Nobody on the sane alignment-is-necessary side of this argument is postulating that the CPUs are disobeying the laws of physics to… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 It seems to me to be only slightly more reasonable than the old theory that if you got dirty shirts and straw, they would spontaneously… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I would call that “AI alignment,” following Stuart Russell. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 by “achieve goals” we mean something like “squeezing the measure of possible futures higher in your preference ordering.” Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I do think that a lot of people listening may want us to back up and talk about the question of whether you can have something that feels… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 There’s no continuity between what you have to do to fend off little pieces of code trying to break into your computer, and what you have… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 It’s in this sense that I mean that there’s no fire alarm for artificial general intelligence. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 both the narrow and the ambitious alignment have in common that you’re trying to have the AI do that thing rather than making a lot of… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I think that there are multiple narratives about AI, and I think that the technical truth is something that doesn’t fit into any of the… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I have much clearer ideas about how to go around tackling the technical problem than tackling the social problem. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I think, for example, that if you have humans and you make the human smarter, this is not orthogonal to the humans’ values. Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 You could build a mind that would not deceive you; you could build a mind that maximizes the flourishing of a happy intergalactic… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Not checkable Eliezer Yudkowsky Not checkable 28 Feb 2018 I would say that the real function of the fire alarm is the social function of telling you that everyone else knows there’s a fire and you… Eliezer Yudkowsky · Not checkable · 28 Feb 2018
Back to the list

Not checkable

“Then my guess would be something like Kickstarter, but much better, that turned out to enable people in large groups to move forward when none of them could move forward individually.”

Eliezer Yudkowsky 28 February 2018 Sam Harris and Eliezer Yudkowsky on "AI: Racing Toward the Brink" (MIRI)

Then my guess would be something like Kickstarter, but much better, that turned out to enable people in large groups to move forward when…

Not checkable An opinion, value judgement or statement with nothing to check.

Cite this claim

Eliezer Yudkowsky, “Then my guess would be something like Kickstarter, but much better, that turned out to enable people in large groups to move forward when…” (said 28 February 2018). Verdict: not checkable. Reliability API, claim c_1997d7f17eb2, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_1997d7f17eb2

Verdicts are made automatically; how verdicts and scores are made. The same data is on Hugging Face under CC BY 4.0.