ClaimsEliezer Yudkowsky

“Somebody asked Bing Sydney to describe herself and fed the resulting description into one of the stable diffusion”

Eliezer Yudkowsky, interviewed by Lex Fridman March 2023 "Dangers of AI and the End of Human Civilization" Yudkowsky on Lex Fridman (LessWrong) archived copy

Factual AI capabilities

Someone asked Bing's Sydney to describe herself and fed the resulting description into a Stable Diffusion image generator.

Unresolvable The public record could not settle it.

Factual: Statements about the present or the past, checked against the record: did they hold up?

What would count as true or false

True: a social-media post, article or archive from before March 2023 documents someone asking Bing Chat (Sydney) to describe herself and then feeding that description into a Stable Diffusion or similar diffusion-based image generator. Mostly true: the event happened, but the image generator was a different diffusion model, such as Midjourney, or a minor detail differs. Mixed: not used, because this is a single event. Mostly false: a similar event happened, but in a substantially different way, for example the description came from ChatGPT rather than Bing, or the image was hand-drawn. False: the evidence shows that the event as described did not happen, for example that the widely shared image had some other documented origin.

Set before the research began.

Evidence (5)

  1. E1 Bing Chat imagines itself as a human girl and we get a face to put to Sydney Windows Central · 11 April 2023

    “It then used the built-in Bing Image Creator to sketch what she imagines she'd look like.”
  2. E2 Bing Chat imagines itself as a human girl and we get a face to put to Sydney Windows Central · 11 April 2023

    “The post has since been taken down by moderators for whatever reason, but you can see a screengrab below of the images.”
  3. E3 self-portrait Pantheon (llm-pantheon.org) · 18 February 2023

    “@repligate 2023-02-18 — A few of Sydney's self portraits https://t.co/tSh6fpXtfv ♥394”
  4. E4 self-portrait Pantheon (llm-pantheon.org), a community archive of LLM posts · 13 September 2024

    “@repligate 2023-02-18 — A few of Sydney's self portraits https://t.co/tSh6fpXtfv”
  5. E5 Bing / Sydney (Prometheus) — Pantheon Pantheon (llm-pantheon.org), a community archive of LLM posts · 7 February 2023

    “2023-02-18 @repligate — “A few of Sydney’s self portraits.”link”

Reasoning

E3–E5 show a February 18, 2023 tweet sharing 'a few of Sydney's self portraits', but they don't say how the images were made or whether a description was fed into Stable Diffusion. E1 and E2 are dated April 2023, after the claim, and describe a different event using Bing Image Creator; the original Reddit post was also removed. The evidence neither confirms nor contradicts the specific pre-March 2023 event the claim describes.

Cite this claim

Eliezer Yudkowsky, “Someone asked Bing's Sydney to describe herself and fed the resulting description into a Stable Diffusion image generator.” (said March 2023). Verdict: unresolvable. Reliability API, claim c_6da274342184, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_6da274342184

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Eliezer Yudkowsky, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Eliezer Yudkowsky

  1. Resolved true Factual September 2025
    “We learned that that's false, but we did not learn that you can have a thing that can redesign a tree and build an AI much smarter than itself, that builds an AI much smarter than itself, and that…”

    No AI has yet been shown to redesign a tree and build a much smarter AI that builds a still smarter AI; that scenario has not occurred.

  2. Mostly true Factual 25 March 2024
    “I was a passionate noticer of the human brain not being homogenous, and was therefore unpleasantly surprised by transformers scaling as well as they did.”

    Yudkowsky was unpleasantly surprised by how well transformers scaled, having believed the human brain is not homogeneous.

  3. Mostly true Factual 6 April 2023
    “First of all, you realize in principle that the task of minimizing losses on predicting human text does not stop when you’re as smart as a human, right?”

    In principle, the task of minimizing loss on predicting human text does not stop being improvable once a system is as smart as a human.

  4. Mostly true Factual 30 March 2023
    “Transformers are the main thing like that.”

    Transformers were the main architectural change that gave a non-linear jump in performance, compared with earlier approaches such as RNNs.

  5. Mostly true Factual 30 March 2023
    “Because the basic paradigm of machine learning that we are presently operating under is that you can have the loss function, but only for things you can evaluate.”

    The basic paradigm of machine learning currently in use is that a loss function can be defined only for things that can be evaluated.

All of them

Verdicts are made automatically; how verdicts are made.