Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 70 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
60 42 78
All types combined: 74 (likely 68 to 80, high confidence), from 79 claims: 71 factual claims, 8 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Eliezer Yudkowsky's claims
46 claims
“Now, one of the conditions of this little meet-up was that no one would ever say what went on in there. Why did I do that? Because I was trying to make a point about what I would now call cognitive uncontainability.”
Eliezer Yudkowsky, MIRI senior researcher, podcast guest 28 February 2018 Sam Harris and Eliezer Yudkowsky on "AI: Racing Toward the Brink" (MIRI)
One condition of the AI-box experiment was that no one would ever say what went on inside it.
Mostly true True in substance, wrong in a detail.
The evidence is the person's or their organisation's own records.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
True: Yudkowsky's original AI-box experiment rules and reports (e.g. his 2002 AI-Box Experiment page and the SL4 mailing-list posts) show that the participants agreed not to disclose what was said or done during the experiment. Mostly true: there was a non-disclosure condition, but with minor exceptions, e.g. the outcome could be reported or the condition could be waived by mutual consent. Mixed: non-disclosure applied in some runs but not as a general condition. Mostly false: confidentiality was only informal or optional. False: the rules contained no such condition and transcripts were meant to be published.
Evidence
- The AI-Box Experiment: yudkowsky.net (Eliezer Yudkowsky's personal site) · 4 September 2020 Own record
“Regardless of the result, neither party shall ever reveal anything of what goes on within the AI-Box experiment except the outcome.”
- How To Win The AI Box Experiment (Sometimes) — LessWrong LessWrong (post by pinkgothic) · 12 September 2015 Own record
“Regardless of the result, neither party shall ever reveal anything of what goes on within the AI-Box experiment except the outcome.”
- The "AI Box" experiment SL4 mailing list (archive) · 8 March 2002 Own record
“One of the conditions of the test is that neither of us reveal what went on inside”
- AI-Box Experiment 2: Yudkowsky and McFadzean SL4 mailing list (archive) · 4 July 2002 Own record
“And you do understand that, under the terms of the arrangement, whether you let me out or not, you can never tell anyone what went on in there?”
Reasoning
Yudkowsky's AI-Box Experiment protocol page [E1] states that "neither party shall ever reveal anything of what goes on within the AI-Box experiment except the outcome." A LessWrong post [E2] quotes the same rule. His 2002 SL4 posts [E3, E4] also describe non-disclosure of what went on inside as a condition of the test. So the non-disclosure condition existed, but the protocol explicitly allowed the outcome to be revealed. The resolution criteria list that kind of exception under "mostly true".
Cite this claim
Eliezer Yudkowsky, “One condition of the AI-box experiment was that no one would ever say what went on inside it.” (said 28 February 2018). Verdict: mostly true. Reliability API, claim c_1accca44d1ef, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_1accca44d1ef
Claims without a verdict
Is a verdict here wrong, or do you speak for Eliezer Yudkowsky? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.