ClaimsEliezer Yudkowsky

“but the process is not really open to human introspection.”

Eliezer Yudkowsky, author, MIRI paper 2007 Levels of Organization in General Intelligence (MIRI) archived copy

Factual Philosophy, ethics and society

The process of visualizing a triangular light bulb is not really open to human introspection.

Mostly true True in substance, wrong in a detail.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The second judge said resolved true; the verdict shown is the first judge's.

Said for an organisation they lead or work for; it counts on both records.

What would count as true or false

Judge against cognitive science as of 2007. True: research shows that the processes underlying visual imagery, such as forming a mental image of a new object, are largely unconscious and cannot be reached by introspection, beyond awareness of the resulting image. Mostly true: the processes are mostly inaccessible to introspection, with some debated partial access. Mixed: the research is genuinely split. Mostly false: the evidence is inconclusive, or shows meaningful introspective access that the claim overstates the absence of. False: research shows that the mechanisms of visual imagery are substantially open to introspection.

Set before the research began.

Evidence (4)

  1. E1 ERIC - EJ163657 - Telling More Than We Can Know: Verbal Reports on Mental Processes, Psychological Review, 1977 ERIC (Education Resources Information Center), abstracting Nisbett & Wilson, Psychological Review 84(3) · 1977

    “Evidence is reviewed which suggests that there may be little or no direct introspective access to higher order cognitive processes.”
  2. E2 What the Mind's Eye Tells the Mind's Brain: A Critique of Mental Imagery Springer (chapter by Z.W. Pylyshyn, in Nicholas (ed.), Images, Perception, and Knowledge) · 1973

    “requires that we posit abstract mental structures to which we do not have conscious access and which are essentially conceptual and propositional, rather than sensory or pictorial, in nature.”
  3. E3 Imagery and Imagination Internet Encyclopedia of Philosophy · 28 March 2023

    “Nonetheless, the subjects never realized that they were seeing an image of a banana.”
  4. E4 Imagery debate - Wikipedia Wikipedia · 30 April 2023

    “Although the imagery debate was a central focus of cognitive research in the 1980s, it was never conclusively resolved.”

Reasoning

Nisbett & Wilson's 1977 review [E1] found that there may be little or no direct introspective access to higher-order cognitive processes. Pylyshyn's critique of mental imagery [E2] argues that imagery depends on abstract structures to which we have no conscious access. The finding reported in [E3], that subjects never realized they were seeing an image of a banana, bears on the limits of introspective discrimination. The imagery debate [E4] was never conclusively resolved, and the evidence's tentative wording ("may be") points to mostly rather than fully inaccessible processes.

Cite this claim

Eliezer Yudkowsky, “The process of visualizing a triangular light bulb is not really open to human introspection.” (said 2007). Verdict: mostly true. Reliability API, claim c_72fa8b709e63, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_72fa8b709e63

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Eliezer Yudkowsky, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Eliezer Yudkowsky

  1. Mixed Factual 20 April 2026
    “I was observing that obvious-seeming hypothesis myself, sometime around the time of GPT 3.5.”

    Yudkowsky himself observed the persona-selection-like hypothesis around the time of GPT 3.5.

  2. Mostly true Factual 20 April 2026
    “The test-passing preference stands on its own once formed.”

    Once formed through RL training, an LLM's test-passing preference stands on its own and is not overridden by its inference of what the user wants.

  3. Mostly true Factual 20 April 2026
    “LLMs surely have neural circuits they learned to model text streams from fictional and nonfictional personas that are not lying, deceiving, cheating.”

    LLMs surely have neural circuits they learned to model text streams from fictional and nonfictional personas that are not lying, deceiving…

  4. Mostly true Factual 20 April 2026
    “The predict-as-if-honest circuitry is contextual, invoked to predict some streams of text but not others.”

    LLMs' predict-as-if-honest circuitry is contextual, invoked for predicting some text streams but not others.

  5. Mostly true Factual 20 April 2026
    “Presumably, somewhere along the way LLMs learn a dispreference for tests that don't pass, independently of how that gets prevented or whether the new plan does what the user really wanted.”

    Presumably, at some point during RL training on code-passing tasks, LLMs learn a dispreference for failing tests, independent of how that is avoided or whether the user's real goal is met.

All of them

Verdicts are made automatically; how verdicts are made.