Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
80 72 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
70 62 78 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 2 promises resolved, 5 needed for a score.
All types combined: 75 (likely 69 to 80, high confidence), from 79 claims: 35 factual claims, 44 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Scott Alexander's claims
35 claims
“Things felt so fuzzy that I (partly) abandoned my usual clear-resolution probabilistic predictions for total guesses.”
Scott Alexander, blogger 20 February 2023 Grading My 2018 Predictions For 2023 (Astral Codex Ten)
In 2018 Scott Alexander partly abandoned his usual clear-resolution probabilistic predictions for rough guesses in his five-year predictions.
Resolved true The record shows it happened or was so.
The evidence is the person's or their organisation's own records.
What would count as true or false
Judged as of 2023-02-20. True: Scott's 2018 five-year predictions post contained at least some loosely worded predictions or rough guesses without clear resolution criteria, alongside or in place of his usual clearly resolvable probabilistic predictions. Mostly true: the 2018 post mixed the two kinds, but the 'fuzzy' share or the timing differs slightly from his description. Mixed: only a small, marginal part of the post was fuzzy. Mostly false: nearly all of the predictions were clearly resolvable and probabilistic. False: every prediction in the 2018 post was clearly resolvable with probabilities, or no such post exists.
Evidence
- 2018 Predictions: Calibration Results Slate Star Codex (Scott Alexander's blog) · 22 January 2019 Own record
“And while you're waiting, I also made some predictions last February for the next five years.”
- Five More Years Slate Star Codex · 15 February 2018 Own record
“Those yearly “predictions for next year” posts are starting to reach the limit of their usefulness. Not much changes from year to year, and most of what does change is hard to capture in objective probabilistic predictions.”
- Five More Years Slate Star Codex · 15 February 2018 Own record
“AI will be marked by various spectacular achievements, plus nobody being willing to say the spectacular achievements signify anything broader.”
- Five More Years Slate Star Codex · 15 February 2018 Own record
“1. Trump wins 2020: 20%”
- Five More Years Slate Star Codex · 15 February 2018 Own record
“Cryptocurrency will neither collapse nor take over everything. It will become integrated into the existing system and regulated to the point of uselessness.”
Reasoning
The 2018 post "Five More Years" opens by saying that much of what changes is hard to capture in objective probabilistic predictions (E3). It contains prose forecasts with no probability or resolution criteria, on AI (E4) and on cryptocurrency (E6). These sit alongside numbered predictions with probabilities, such as "Trump wins 2020: 20%" (E5). This meets the 'true' criterion: some loosely worded guesses appear alongside the usual clearly resolvable probabilistic predictions. The verdict rests on the post itself, which is the subject's own published record.
Cite this claim
Scott Alexander, “In 2018 Scott Alexander partly abandoned his usual clear-resolution probabilistic predictions for rough guesses in his five-year predictions.” (said 20 February 2023). Verdict: resolved true. Reliability API, claim c_f5e620ed4ad2, method 0.1.0+8bea457b. https://epistacklabs.com/claims/c_f5e620ed4ad2
Claims without a verdict
Is a verdict here wrong, or do you speak for Scott Alexander? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.