ClaimsPeople

Scott Alexander

Scott Alexander is a writer known for his blogs Astral Codex Ten and Slate Star Codex and for fiction including Unsong.

775 claims collected, 234 researched, 81 resolved. Report of 4 November 2026, method 0.1.0+8bea457b.

Scores by kind of claim

Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.

  • Factual claims

    Statements about the present or the past, checked against the record: did they hold up?

    80 72 88

    Medium confidence, 35 factual claims resolved. From 10 documents, 2014 to 2026; 15 documents sampled from 35 candidates found.

    Not scored: 46 unresolvable, 9 checkable only against their own records.

  • Predictions

    Statements about events outside the person's control, checked once they fell due: did they come true?

    70 62 78

    Medium confidence, 44 predictions resolved. From 7 documents, 2016 to 2025; 15 documents sampled from 35 candidates found.

    Not scored: 67 unresolvable, 10 checkable only against their own records. 19 more fall due later.

    Does not yet allow for how likely each prediction was when made.

  • Promises

    Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?

    Insufficient record: 2 promises resolved, 5 needed for a score.

All types combined: 75 (likely 69 to 80, high confidence), from 79 claims: 35 factual claims, 44 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.

Scott Alexander's claims

26 claims

26 claims, sorted by newest said. Choose a claim to read it in full.
VerdictKindSaidClaimTopic
Mostly true Factual 19 Oct 2026 MNX, a project of Manifold Markets co-founder Stephen Grugett, is a real-money prediction market on AI. Factual · 19 Oct 2026 Economics and markets
Mostly true Factual 5 Oct 2026 Reader Nikita Sokolsky has finished obtaining extra Fatima documents from Portugal and translating them into English. Factual · 5 Oct 2026 Their own work or organisation
Mostly true Factual 5 Oct 2026 Physicians For AI Safety exists, wants to talk to physicians interested in AI safety, and has an open letter such people can sign. Factual · 5 Oct 2026 Field building and careers
Mostly true Factual 3 Apr 2025 Through history, people have been reluctant to admit an AI is truly intelligent. Factual · 3 Apr 2025 Philosophy, ethics and society
Mostly true Prediction 3 Apr 2025 The authors of the scenario think coding is what will start the intelligence explosion. Prediction · 3 Apr 2025 AI capabilities
Mostly true Prediction 3 Apr 2025 In the AI 2027 scenario, as AI labs become more capable they tell the government, seeking government contracts and support. Prediction · 3 Apr 2025 AI policy and governance
Mostly true Prediction 3 Apr 2025 In the AI 2027 scenario, the government sees via cyber warfare that AIs are as capable as the best human hackers but deployable at huge scale. Prediction · 3 Apr 2025 AI policy and governance
Mostly true Factual 10 Dec 2024 Most of the benefits of prison come from incapacitation rather than deterrence. Factual · 10 Dec 2024 Philosophy, ethics and society
Mostly true Prediction 20 Feb 2023 Scaling AI models will continue to produce gains, though less obviously than in the past five years. Prediction · 20 Feb 2023 AI capabilities
Mostly true Factual 20 Feb 2023 As of early 2023 nobody is talking about technological unemployment, because unemployment rates are historically low. Factual · 20 Feb 2023 AI, the economy and work
Mostly true Factual 20 Feb 2023 impute.me may provide the consumer polygenic score service Scott Alexander predicted, but it has made no public waves. Factual · 20 Feb 2023 Technology
Mostly true Factual 14 Mar 2022 The probability shown in the chart in the post was almost monotonically decreasing, lower each day than the day before. Factual · 14 Mar 2022 Other global risks
Mostly true Factual 14 Mar 2022 Early in the Russia-Ukraine war prediction markets gave Ukraine poor odds, and by March 2022 they were much more optimistic about Ukraine. Factual · 14 Mar 2022 Other global risks
Mostly true Factual 14 Feb 2021 Scott Alexander said the NYT's characterisation was true only insofar as he once expressed agreement with an unrelated Charles Murray position: that telling poor people to learn to code is insufficient and a stable income is needed. Factual · 14 Feb 2021 Their own work or organisation
Mostly true Factual 22 Jan 2019 Scott Alexander made predictions in February 2018 for the next five years. Factual · 22 Jan 2019 Their own work or organisation
Mostly true Factual 22 Jan 2019 Cryptocurrency crashed during 2018, after Bitcoin was around $15,000 when Scott Alexander made his 2018 predictions. Factual · 22 Jan 2019 Economics and markets
Mostly true Prediction 15 Feb 2018 Global existential risks will hopefully not be a big part of the 2018-2023 period. Prediction · 15 Feb 2018 Other global risks
Mostly true Prediction 15 Feb 2018 The crisis of the Republican Party will turn out to have been overblown. Prediction · 15 Feb 2018 Other
Mostly true Prediction 6 Jan 2017 No announcement of a genetically engineered human baby or credible plan for one will occur in 2017. Prediction · 6 Jan 2017 Biosecurity
Mostly true Prediction 6 Jan 2017 Scott Alexander gave a 95% probability that fewer refugees would be admitted in 2017 than in 2016. Prediction · 6 Jan 2017 Other
Mostly true Prediction 25 Jan 2016 Scott Alexander gave an 80% probability that there would be no major intifada in Israel in 2016 (over 250 Israeli deaths, excluding a Cast Lead style war). Prediction · 25 Jan 2016 Other global risks
Mostly true Factual 25 Jan 2016 Scott Alexander makes predictions at the start of every year and scores them at the end of each year. Factual · 25 Jan 2016 Their own work or organisation
Mostly true Factual 30 Sep 2014 The Nazis' outgroup was the almost-identical German Jews rather than the culturally distant Japanese. Factual · 30 Sep 2014 Philosophy, ethics and society
Mostly true Factual 30 Sep 2014 Estimates of the genetic contribution to political association range from 0.4 to 0.6. Factual · 30 Sep 2014 Science and research methods
Mostly true Factual 30 Sep 2014 Heritability of attitudes toward gay rights is estimated at 0.3 to 0.5, slightly higher than the heritability of homosexuality. Factual · 30 Sep 2014 Science and research methods
Mostly true Factual 30 Sep 2014 Researchers have studied belief congruence theory, that belief differences matter more than demographics in forming in-groups and outgroups, for decades. Factual · 30 Sep 2014 Philosophy, ethics and society
Back to the list

Prediction AI capabilities

“I expect scaling to continue to produce gains, but this is less obvious than it’s been the past five years.”

Scott Alexander, blogger 20 February 2023 Grading My 2018 Predictions For 2023 (Astral Codex Ten)

Scaling AI models will continue to produce gains, though less obviously than in the past five years.

Mostly true True in substance, wrong in a detail.

The second judge said resolved true; the verdict shown is the first judge's.

What would count as true or false

The claim has two parts. (a) Scaling continued to produce gains: from February 2023 onward, larger models or more training compute kept giving measurable capability improvements, shown in benchmark results, technical reports or published scaling-law studies of frontier models released after the claim. (b) The gains were less obvious than in 2018-2023: credible sources (researcher statements, analyses, press coverage of diminishing returns, debate over a pre-training 'wall') show that the returns from scaling became more contested or harder to see than in the GPT-2 to GPT-4 era. True: both (a) and (b) hold. Mostly true: (a) clearly holds and (b) holds only weakly or is mildly disputed. Mixed: one part holds and the other clearly fails. For example, scaling gains were as obvious and undisputed as before, or the gains came mainly from methods other than scale while pure scaling stalled. Mostly false: scaling gave only marginal gains that most expert sources call negligible. False: scaling stopped producing gains or reversed. Judge on evidence from February 2023 up to the time of evaluation.

Evidence

  1. Trends in AI Epoch AI · 5 February 2026
    “Training compute for frontier language models has been growing at 5× per year since 2020.”
  2. Trends in AI Epoch AI · 5 February 2026
    “Following the introduction of the first reasoning models (OpenAI’s o1-mini and o1-preview) in September 2024, the Epoch Capabilities Index (ECI) frontier has advanced linearly by 14 points per year, compared with 6 points per year for non-reasoning models.”
  3. AI Scaling Wall Wikipedia · 30 September 2026
    “One 2025 analysis estimated that each tenfold rise in compute yields only one to two percentage points of MMLU-Pro accuracy.”
  4. The $19.6 billion pivot: How OpenAI's 2-year struggle to launch GPT-5 revealed that its core AI strategy has stopped working | Fortune Fortune · 25 February 2025
    “These media reports indicated that Orion was better at some language tasks than GPT-4, but that its abilities at coding and mathematics was not significantly improved on the previous model.”

Reasoning

Epoch AI reports that frontier training compute kept growing about 5× per year (E1). It also reports that frontier capability, measured by its Capabilities Index, kept rising, by about 6 points per year for non-reasoning models and faster for reasoning models (E2). A 2025 analysis estimated that each tenfold rise in compute still adds one to two points of MMLU-Pro accuracy (E3), so scaling kept producing gains, but small ones. Fortune reports that OpenAI's Orion model was better than GPT-4 at some language tasks but not significantly improved in coding and mathematics (E4). This supports the 'less obvious' part, while E3 shows that added compute still produced measurable, if small, gains, and E2 shows the capability frontier advancing faster after reasoning models were introduced than for non-reasoning models.

Cite this claim

Scott Alexander, “Scaling AI models will continue to produce gains, though less obviously than in the past five years.” (said 20 February 2023). Verdict: mostly true. Reliability API, claim c_6690cfadae41, method 0.1.0+8bea457b. https://epistacklabs.com/claims/c_6690cfadae41

Claims without a verdict

Is a verdict here wrong, or do you speak for Scott Alexander? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.