Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
80 72 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
70 62 78 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 2 promises resolved, 5 needed for a score.
All types combined: 75 (likely 69 to 80, high confidence), from 79 claims: 35 factual claims, 44 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Scott Alexander's claims
39 claims
“I actually remember and grade these predictions publicly sometime in the year 2023: 90%”
Scott Alexander, blog author 15 February 2018 Five More Years (Slate Star Codex)
Scott Alexander gave a 90% probability that he would remember and publicly grade these predictions sometime in 2023.
Resolved true The record shows it happened or was so.
What would count as true or false
This is a probabilistic forecast; judge whether the event happened. True if, at some point in calendar 2023, Scott Alexander publicly graded the predictions from his February 2018 post (the five-year predictions), e.g. in a blog post scoring them. Mostly true if the grading was published in 2023 but covered most rather than all of the predictions. Mostly false if he graded them, but only after 31 December 2023, or only in passing without real grading. False if a 2023 or later record shows no grading in 2023, e.g. he graded them in 2024 or said he had forgotten.
Evidence
- Grading My 2018 Predictions For 2023 Astral Codex Ten (Scott Alexander) · 20 February 2023 Own record
“Last week was the tenth anniversary of my old blog (I accept your congratulations), so it's time to look back on my terrible doomed 2018 predictions and see how I did at predicting the last half decade, starting with:”
- Grading My 2018 Predictions For 2023 Astral Codex Ten (Scott Alexander) · 20 February 2023 Own record
“I grade 1, 5, and 6 as coming true; 2, 3, and 4 as not coming true, and 7 as “more”, all of which I got directionally correct.”
- Grading My 2018 Predictions For 2023 Astral Codex Ten (Scott Alexander) · 20 February 2023 Own record
“My biggest failure here was 10, where I gave Roe vs. Wade only a 1% chance (!) of being overturned!”
- Grading My 2018 Predictions For 2023 — Scott Alexander, curated ACX Index (unofficial fan index, not affiliated with Scott Alexander) · 20 February 2023
“Scott grades his 2018 five-year predictions across AI, world affairs, US culture/politics, economics, science/tech, and x-risks (best call: AI generating images/stories to a prompt; worst: giving Roe's overturn only 1%), then lays out fresh 2028 predictions”
Reasoning
E1 is a post titled "Grading My 2018 Predictions For 2023", dated 2023-02-20, in which Scott Alexander says it is time to look back on his 2018 predictions. E2 and E3 show him scoring specific numbered predictions, including the Roe v. Wade forecast. E4 is an independent fan index, and it describes the same post as grading his 2018 five-year predictions across AI, world affairs, US culture and politics, economics, science and tech, and x-risks. So the event he gave 90% odds to did happen in calendar 2023.
Cite this claim
Scott Alexander, “Scott Alexander gave a 90% probability that he would remember and publicly grade these predictions sometime in 2023.” (said 15 February 2018). Verdict: resolved true. Reliability API, claim c_4d7337c4c4b1, method 0.1.0+8bea457b. https://epistacklabs.com/claims/c_4d7337c4c4b1
Claims without a verdict
Is a verdict here wrong, or do you speak for Scott Alexander? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.