Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
80 72 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
70 62 78 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 2 promises resolved, 5 needed for a score.
All types combined: 75 (likely 69 to 80, high confidence), from 79 claims: 35 factual claims, 44 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Scott Alexander's claims
234 claims · page 3 of 3
“I will still be at my current job: 95%”
Scott Alexander, blogger 25 January 2016 2016 Predictions: Calibration Results (Slate Star Codex)
Scott Alexander will still be at his current job at the end of 2016.
Unresolvable The public record could not settle it.
What would count as true or false
Judge whether the event happened; the 95% probability is not part of the test. 'Current job' means the job Scott Alexander held when he made the prediction (his medical/psychiatric post at that time). True: he was still in that same position on 31 December 2016. Mostly true: he was with the same employer in a slightly different role, for example moving to the next stage of the same training programme. False: he had left that job, or moved to a different employer, before the end of 2016, as shown by his own scoring of the prediction or by dated accounts of his employment.
Evidence
- 2017 Predictions: Calibration Results Slate Star Codex (Scott Alexander's blog) · 2 January 2018 Own record
“I overestimated the success of my diet, my savings plan, my travel plans my job start date, my long-FAQ-making ability, and my future housing search”
- 2017 Predictions: Calibration Results Slate Star Codex (Scott Alexander's blog) · 2 January 2018 Own record
“66. I will take the job I am currently expecting to take: 90%”
- To The Great City! Slate Star Codex (Scott Alexander's blog) · 3 July 2017 Own record
“Back when I first left the Bay Area to take this position four years ago, I wrote myself a letter.”
- To The Great City! Slate Star Codex (Scott Alexander's blog) · 3 July 2017 Own record
“Last Friday I said goodbye to my patients, handed over my pager, and left Our Lady Of An Undisclosed Location for the last time.”
- To The Great City! Slate Star Codex (Scott Alexander's blog) · 3 July 2017 Own record
“So I’m happy to be able to announce that I’ve just accepted a psychiatrist position in the San Francisco metropolitan area”
Reasoning
In his July 2017 blog posts, Scott Alexander says he took his position about four years earlier [E3] and left that hospital on the Friday before the post [E4]. Read together, that suggests he was still in the job at the end of 2016. But all the support comes from his own ordinary blog posts, not an official record or an independent source. The evidence also doesn't include his scoring of the 2016 prediction: E1 and E2 cover his 2017 predictions instead. The judges treated the claim as unresolvable because the only evidence is his own blog posts, and his scoring of the 2016 prediction is not among the evidence.
Cite this claim
Scott Alexander, “Scott Alexander will still be at his current job at the end of 2016.” (said 25 January 2016). Verdict: unresolvable. Reliability API, claim c_aa7dda33c3c1, method 0.1.0+8bea457b. https://epistacklabs.com/claims/c_aa7dda33c3c1
Claims without a verdict
Is a verdict here wrong, or do you speak for Scott Alexander? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.