Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 70 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
60 42 78
All types combined: 74 (likely 68 to 80, high confidence), from 79 claims: 71 factual claims, 8 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Eliezer Yudkowsky's claims
46 claims
“LLMs surely have neural circuits they learned to model text streams from fictional and nonfictional personas that are not lying, deceiving, cheating.”
Eliezer Yudkowsky, author on X 20 April 2026 Post by @ESYudkowsky on X, 2026-04-20 (X)
LLMs surely have neural circuits they learned to model text streams from fictional and nonfictional personas that are not lying, deceiving…
Mostly true True in substance, wrong in a detail.
What would count as true or false
The claim is that LLMs contain learned internal circuits or representations that model text from honest personas (fictional and non-fictional) who are not lying, deceiving or cheating. Judge as of 2026-04-20 against interpretability research. True: published interpretability work identifies internal features, directions or circuits in LLMs that represent honest or non-deceptive personas or truthful text-generation, distinct from deceptive ones. Mostly true: the work shows closely related representations, such as truthfulness/honesty directions or persona features, that support the claim, though not framed exactly as circuits for honest personas. Mixed: the evidence is suggestive but contested, or covers only some models or settings. Mostly false: the claim is stated as certain ('surely') when the research is inconclusive or absent, i.e. plausible but unproven. False: the research shows that LLMs do not form any such representations.
Evidence
- Personas as a way to Model Truthfulness in Language Models arXiv · 31 January 2026
“We hypothesize that the pretraining data is generated by groups of (un)truthful agents whose outputs share common features, and they form a (un)truthful persona. By training on this data, LMs can infer and represent the persona in its activation space.”
- Personas as a way to Model Truthfulness in Language Models arXiv · 31 January 2026
“Second, our experiments only provide evidence of the existence of truthful personas, i.e. there exist features that the model can use to cluster truthful agents.”
- Mechanistic Interpretability of LLM Behavior: A Survey Preprints · 26 October 2026
“For truthfulness, deception, and sycophancy, truth-related features are causally steerable [3,34,115], whereas deception is mainly decodable, with domain-sensitive signals that transfer poorly [116,117,118].”
- The assistant axis Anthropic · 19 January 2026
“In pre-trained models, the Assistant Axis is already associated with human archetypes such as therapists, consultants, and coaches, suggesting that the Assistant character might inherit properties of these existing archetypes.”
Reasoning
E1 and E2 hypothesise, and report evidence, that language models represent a 'truthful persona' in activation space, learned from pretraining data. The authors say their experiments only provide evidence that truthful personas exist, meaning there are features the model can use to cluster truthful agents. E4 shows that, in pretrained models, the Assistant Axis is already associated with human archetypes such as therapists, consultants and coaches.
Cite this claim
Eliezer Yudkowsky, “LLMs surely have neural circuits they learned to model text streams from fictional and nonfictional personas that are not lying, deceiving…” (said 20 April 2026). Verdict: mostly true. Reliability API, claim c_520567e805e4, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_520567e805e4
Claims without a verdict
Is a verdict here wrong, or do you speak for Eliezer Yudkowsky? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.