Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 70 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
60 42 78
All types combined: 74 (likely 68 to 80, high confidence), from 79 claims: 71 factual claims, 8 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Eliezer Yudkowsky's claims
8 claims
“I was observing that obvious-seeming hypothesis myself, sometime around the time of GPT 3.5.”
Eliezer Yudkowsky, author on X 20 April 2026 Post by @ESYudkowsky on X, 2026-04-20 (X)
Yudkowsky himself observed the persona-selection-like hypothesis around the time of GPT 3.5.
Mixed Partly true and partly false in roughly equal measure.
The second judge would not resolve this claim; the verdict shown is the first judge's.
The evidence is the person's or their organisation's own records.
What would count as true or false
Judge as of 2026-04-20. True: dated records (e.g. Yudkowsky's posts, tweets or comments from about late 2022 to early 2023, the GPT-3.5/ChatGPT era) show him stating a hypothesis substantially like persona selection (that LLMs model or select among characters/personas learned from text). Mostly true: such records exist but are dated a little outside that window (e.g. 2022 or mid-2023), or state the idea in a closely related but not identical form. Mixed: the records only partly match the hypothesis or the timing is unclear. Mostly false: his earliest documented statement of the idea is clearly later (e.g. 2024 or after), or only loosely related ideas appear around GPT-3.5. False: dated records show he rejected or argued against the hypothesis around GPT-3.5 time and took it up only much later. His own 2026 recollection alone does not settle the claim.
Evidence
- No, really, it predicts next tokens. — LessWrong LessWrong · 18 April 2023 Own record
“Yes, a big point of this post is that it's not "inherently mistaken" for the reasons (a) and (b) that Eliezer gives in his linked tweets.”
- No, really, it predicts next tokens. — LessWrong LessWrong · 18 April 2023 Own record
“If That-Which-Predicts were a zillion miles superhuman underneath and could solve every aspect of alignment in an instant, but the mask is near-human-level because it is trained on human-level data”
- Why do we assume there is a "real" shoggoth behind the LLM? Why not masks all the way down? — LessWrong LessWrong · 9 March 2023 Own record
“Some people are thinking in those terms, e.g. Eliezer Yudkowsky saying that "the actual shoggoth has a motivation Z".”
- On "ChatGPT Psychosis" and LLM Sycophancy — LessWrong LessWrong · 23 July 2025 Own record
“2024-10-27 Yudkowsky shares his "Rasputin's Ghost" theory of confirmation bias driven LLM psychosis.”
Reasoning
E3 (March 2023) quotes Yudkowsky saying "the actual shoggoth has a motivation Z", E1 (April 2023) refers to reasons he gave in linked tweets, and E2, from the same April 2023 post, describes a superhuman predictor behind a "near-human-level" mask but does not clearly attribute this to him. This suggests that around the GPT-3.5 era he was using a shoggoth/mask framing related to persona selection. However, his framing stresses a real underlying shoggoth with its own motivations. E3 contrasts that view with "masks all the way down", so it only partly matches the persona-selection hypothesis. E2 is also not clearly attributed to him, so the records match the timing but only partly match the hypothesis.
Cite this claim
Eliezer Yudkowsky, “Yudkowsky himself observed the persona-selection-like hypothesis around the time of GPT 3.5.” (said 20 April 2026). Verdict: mixed. Reliability API, claim c_8f3dc306412c, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_8f3dc306412c
Claims without a verdict
Is a verdict here wrong, or do you speak for Eliezer Yudkowsky? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.