ClaimsScott Alexander

“I think the Alignment community did not really expect LLMs.”

Scott Alexander, interviewee 3 April 2025 AI 2027: month-by-month model of intelligence explosion — Scott Alexander & Daniel Kokotajlo (Dwarkesh Podcast) archived copy

Factual AI safety and alignment

Scott Alexander said he thinks the AI alignment community did not really expect LLMs.

Resolved true The record shows it happened or was so.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The second judge would not resolve this claim; the verdict shown is the first judge's.

What would count as true or false

The proposition is that Scott Alexander said this, so it is tested first on attribution and then on substance. True: a transcript or recording from around 2025-04-03 (for example the Dwarkesh Patel podcast with Daniel Kokotajlo) shows Scott Alexander saying, in substance, that he thinks the alignment community did not really expect LLMs. The evidence also has to show the view is reasonable: most prominent alignment writing before about 2019 (MIRI, LessWrong, Bostrom and similar) focused on agentic, reinforcement-learning or other non-language-model routes to AGI and did not centre on large language models. Mostly true: he made the statement, but the words differ in a way that slightly changes the emphasis (for example he said 'some of the community' or 'the timing of LLMs'). Mixed: he made the statement, but the record shows that a substantial, prominent part of the alignment community did explicitly anticipate LLM-like systems as the main path. Mostly false: the statement is attributed to the wrong speaker, or he said something materially different, such as 'expected LLMs but not their capabilities'. False: the transcript shows he did not make the statement, or that he said the opposite.

Set before the research began.

Evidence (3)

  1. E1 AI 2027: Dwarkesh's Podcast with Daniel Kokotajlo and Scott Alexander Zvi Mowshowitz (Don't Worry About the Vase, Substack) · 7 April 2025

    “As Scott says, the alignment community did not expect LLMs, but also we are moving back towards RL-shaped things.”
  2. E2 A newcomer’s guide to the technical AI safety field — AI Alignment Forum AI Alignment Forum (post by zeshen) · 4 November 2022

    “Most of the research and publications at the time were from MIRI. They tend to focus on understanding the nature of intelligence and agency i.e. agent foundations, with much of their research work around embedded agency, decision theory, and value learning.”
  3. E3 Links For April 2023 Astral Codex Ten (Scott Alexander) · 20 April 2023 Own record

    “I personally am pretty surprised it was just “GPT-4 got released and was very good”.”

Reasoning

E1 is an independent write-up of the Dwarkesh Patel podcast with Daniel Kokotajlo and Scott Alexander. It credits the view to him directly: "As Scott says, the alignment community did not expect LLMs." On substance, E2, an independent guide on the AI Alignment Forum, says that most early alignment research came from MIRI and focused on agency, agent foundations, decision theory and value learning, not language models. That supports the view as reasonable. E3 is Scott Alexander's own post, so it adds only weak context about his surprise at GPT-4. We have no transcript to check his exact words, but E1's wording matches the claim closely.

Cite this claim

Scott Alexander, “Scott Alexander said he thinks the AI alignment community did not really expect LLMs.” (said 3 April 2025). Verdict: resolved true. Reliability API, claim c_e8d7cc72cf56, method 0.1.0+8bea457b, dataset release v1.1.2. https://epistacklabs.com/claims/c_e8d7cc72cf56

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Scott Alexander, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Scott Alexander

  1. Mostly true Factual 19 October 2026
    “MNX is a real-money prediction market on AI.”

    MNX, a project of Manifold Markets co-founder Stephen Grugett, is a real-money prediction market on AI.

  2. Resolved true Factual 19 October 2026
    “Friend of the blog Goodheart Labs is working on Common Notes, aka “Twitter Community Notes, but for everything”.”

    Goodheart Labs is working on Common Notes, described as Twitter Community Notes but for everything.

  3. Mostly true Factual 5 October 2026
    “Reader Nikita Sokolsky has completed his work getting some extra Fatima documents from Portugal and translating them into English.”

    Reader Nikita Sokolsky has finished obtaining extra Fatima documents from Portugal and translating them into English.

  4. Mostly true Factual 5 October 2026
    “Physicians For AI Safety wishes to advertise that they exist, are interested in talking to any physicians interested in AI safety, and have an open letter that such people can sign.”

    Physicians For AI Safety exists, wants to talk to physicians interested in AI safety, and has an open letter such people can sign.

  5. Resolved true Factual 5 October 2026
    “Rob Ennals, who made this year’s book review contest site, has gathered the reviews from earlier years into epubs here.”

    Rob Ennals, who made this year's ACX book review contest site, has gathered reviews from earlier years into epubs.

All of them

Verdicts are made automatically; how verdicts are made.