ClaimsScott Alexander

“Things felt so fuzzy that I (partly) abandoned my usual clear-resolution probabilistic predictions for total guesses.”

Scott Alexander, blogger 20 February 2023 Grading My 2018 Predictions For 2023 (Astral Codex Ten) archived copy

Factual Their own work or organisation

In 2018 Scott Alexander partly abandoned his usual clear-resolution probabilistic predictions for rough guesses in his five-year predictions.

Resolved true The record shows it happened or was so.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The evidence is the person's or their organisation's own records.

What would count as true or false

Judged as of 2023-02-20. True: Scott's 2018 five-year predictions post contained at least some loosely worded predictions or rough guesses without clear resolution criteria, alongside or in place of his usual clearly resolvable probabilistic predictions. Mostly true: the 2018 post mixed the two kinds, but the 'fuzzy' share or the timing differs slightly from his description. Mixed: only a small, marginal part of the post was fuzzy. Mostly false: nearly all of the predictions were clearly resolvable and probabilistic. False: every prediction in the 2018 post was clearly resolvable with probabilities, or no such post exists.

Set before the research began.

Evidence (5)

  1. E1 2018 Predictions: Calibration Results Slate Star Codex (Scott Alexander's blog) · 22 January 2019 Own record

    “And while you're waiting, I also made some predictions last February for the next five years.”
  2. E2 Five More Years Slate Star Codex · 15 February 2018 Own record

    “Those yearly “predictions for next year” posts are starting to reach the limit of their usefulness. Not much changes from year to year, and most of what does change is hard to capture in objective probabilistic predictions.”
  3. E3 Five More Years Slate Star Codex · 15 February 2018 Own record

    “AI will be marked by various spectacular achievements, plus nobody being willing to say the spectacular achievements signify anything broader.”
  4. E4 Five More Years Slate Star Codex · 15 February 2018 Own record

    “1. Trump wins 2020: 20%”
  5. E5 Five More Years Slate Star Codex · 15 February 2018 Own record

    “Cryptocurrency will neither collapse nor take over everything. It will become integrated into the existing system and regulated to the point of uselessness.”

Reasoning

The 2018 post "Five More Years" opens by saying that much of what changes is hard to capture in objective probabilistic predictions (E3). It contains prose forecasts with no probability or resolution criteria, on AI (E4) and on cryptocurrency (E6). These sit alongside numbered predictions with probabilities, such as "Trump wins 2020: 20%" (E5). This meets the 'true' criterion: some loosely worded guesses appear alongside the usual clearly resolvable probabilistic predictions. The verdict rests on the post itself, which is the subject's own published record.

Cite this claim

Scott Alexander, “In 2018 Scott Alexander partly abandoned his usual clear-resolution probabilistic predictions for rough guesses in his five-year predictions.” (said 20 February 2023). Verdict: resolved true. Reliability API, claim c_f5e620ed4ad2, method 0.1.0+8bea457b, dataset release v1.1.2. https://epistacklabs.com/claims/c_f5e620ed4ad2

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Scott Alexander, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Scott Alexander

  1. Mostly true Factual 5 October 2026
    “Reader Nikita Sokolsky has completed his work getting some extra Fatima documents from Portugal and translating them into English.”

    Reader Nikita Sokolsky has finished obtaining extra Fatima documents from Portugal and translating them into English.

  2. Resolved true Factual 5 October 2026
    “Rob Ennals, who made this year’s book review contest site, has gathered the reviews from earlier years into epubs here.”

    Rob Ennals, who made this year's ACX book review contest site, has gathered reviews from earlier years into epubs.

  3. Resolved true Factual 10 December 2024
    “There’s a good interview with Skarbek in last month’s issue of Asterisk, I think it will be online shortly.”

    Last month's issue of Asterisk (November 2024) contains an interview with Skarbek, which Scott thinks will be online shortly.

  4. Resolved true Factual 14 March 2022
    “Also last month, I suggested Manifold Markets have a loan feature to help boost investment in long-term markets.”

    In February 2022 Scott Alexander suggested that Manifold Markets add a loan feature to boost investment in long-term markets.

  5. Mixed Factual 14 February 2021
    “Their original pitch – and I don’t know if it was true or not – was that they were interested in how I warned about the coronavirus pandemic very early and urged people to wear face masks before this…”

    The NYT's original pitch was interest in how Scott Alexander warned early about the coronavirus pandemic and urged mask-wearing before it was standard advice.

All of them

Verdicts are made automatically; how verdicts are made.