Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 70 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
60 42 78
All types combined: 74 (likely 68 to 80, high confidence), from 79 claims: 71 factual claims, 8 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Eliezer Yudkowsky's claims
46 claims
“And then, as far as the rest of the world knows, this person a bit later sent a PGP-signed email message saying, “I let Eliezer out of the box.””
Eliezer Yudkowsky, MIRI senior researcher, podcast guest 28 February 2018 Sam Harris and Eliezer Yudkowsky on "AI: Racing Toward the Brink" (MIRI)
Yudkowsky said that, as far as the rest of the world knows, the participant in an AI-box experiment later sent a PGP-signed email saying "I let Eliezer out of the box."
Mostly true True in substance, wrong in a detail.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judge as of 2018-02-28. True: archived records (e.g. SL4 mailing list posts from around 2002) show that a participant in one of Yudkowsky's AI-box experiments sent a PGP-signed message saying 'I let Eliezer out of the box' or close to it. Mostly true: such a message exists but with minor differences (slightly different wording, signed in another verifiable way, different timing). Mixed: a participant publicly confirmed letting him out, but the message was not PGP-signed and the wording differs a good deal. Mostly false: confirmation came only in some other indirect form. False: records show no such confirmation, or that the participant did not let him out.
Evidence
- The AI-Box Experiment: yudkowsky.net (Eliezer Yudkowsky's site) Own record
“If the Gatekeeper lets the AI out, the Gatekeeper party shall send a message to this effect, which shall be digitally signed if the Gatekeeper party has a digital signature.”
- The AI-Box Experiment: yudkowsky.net (Eliezer Yudkowsky's site) Own record
“On the first occasion (in March 2002), Eliezer Yudkowsky simulated the AI and Nathan Russell simulated the gatekeeper.”
- AI-Box Experiment 2: Yudkowsky and McFadzean SL4 mailing list archive (posted by Eliezer S. Yudkowsky) · 4 July 2002 Own record
“I remember when Nathan Russell let you out, but that doesn't constitute a proof.”
- The "AI Box" experiment SL4 mailing list archive (posted by Eliezer S. Yudkowsky) · 8 March 2002 Own record
“Nathan, let's run an experiment.”
- SL4: Re: AI-Box Experiment 2: Yudkowsky and McFadzean SL4 mailing list archive (hypermail) · 5 July 2002
“-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 *> David McFadzean has volunteered to be the programmer in an AI-Box* *> experiment. David McFadzean is "Lucifer".* I let the transhuman AI out of the box.”
- Timeline of AI safety - Timelines Timelines (issarice.com wiki) · 18 November 2017
“The second AI box experiment by Eliezer Yudkowsky, against David McFadzean as gatekeeper, takes place. The AI is released.”
- Eliezer Yudkowsky geschichte-der-informatik.de
“He ran the game twice, in March and July 2002, and reported that both gatekeepers let him out. The transcripts were never published; the point, he said, was that a human jailer is not a safe containment strategy against something smarter than the jailer.”
Reasoning
E5 is an archived July 2002 SL4 post that replies to the announcement of the second AI-box experiment, in which David McFadzean was the gatekeeper. It is a PGP-signed message stating "I let the transhuman AI out of the box." E6 independently confirms that the AI was released in that experiment. So a participant did send a PGP-signed message saying he let the AI out. The wording ("the transhuman AI" rather than "Eliezer") differs slightly from the quote, which under the criteria fits mostly true.
Cite this claim
Eliezer Yudkowsky, “Yudkowsky said that, as far as the rest of the world knows, the participant in an AI-box experiment later sent a PGP-signed email saying "I let Eliezer out of the box."” (said 28 February 2018). Verdict: mostly true. Reliability API, claim c_0a4ffa05fe44, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_0a4ffa05fe44
Claims without a verdict
Is a verdict here wrong, or do you speak for Eliezer Yudkowsky? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.