Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
80 72 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
70 62 78 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 2 promises resolved, 5 needed for a score.
All types combined: 75 (likely 69 to 80, high confidence), from 79 claims: 35 factual claims, 44 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Scott Alexander's claims
19 claims
“I think this technology will be ready in the next five years, although it might suffer from the self-driving car problem where you need more nines of reliability than it can provide.”
Scott Alexander, blogger 20 February 2023 Grading My 2018 Predictions For 2023 (Astral Codex Ten)
He expected language-model agents that act on the internet (for example, answering emails or ordering food) to be ready within five years, though he said they might not reach the reliability needed, as with self-driving cars.
Not yet due The date it refers to has not come.
Reasoning
deadline 2028 is after 2026-11-04
Cite this claim
Scott Alexander, “He expected language-model agents that act on the internet (for example, answering emails or ordering food) to be ready within five years, though he said they might not reach the reliability needed, as with self-driving cars.” (said 20 February 2023). Verdict: not yet due. Reliability API, claim c_1c20acf4182d, method 0.1.0+8bea457b. https://epistacklabs.com/claims/c_1c20acf4182d
Claims without a verdict
Is a verdict here wrong, or do you speak for Scott Alexander? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.