Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
80 72 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
70 62 78 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 2 promises resolved, 5 needed for a score.
All types combined: 75 (likely 69 to 80, high confidence), from 79 claims: 35 factual claims, 44 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Scott Alexander's claims
“Assad will remain President of Syria: 60%”
Scott Alexander, blogger 25 January 2016 2016 Predictions: Calibration Results (Slate Star Codex)
Scott Alexander gave a 60% probability that Assad would remain President of Syria.
Resolved true The record shows it happened or was so.
What would count as true or false
This is a probabilistic forecast that Bashar al-Assad would still be President of Syria at the end of 2016. It is judged by whether the favoured outcome happened. True: Assad held the office of President of Syria continuously through 31 December 2016. False: Assad had left office, been removed or died by 31 December 2016. Because the forecast was only 60%, it is not marked down beyond false if the event failed, and intermediate verdicts are not used unless his status on that date is genuinely disputed (for example a contested claim of removal), in which case mixed.
Evidence
- Scott Alexander's Self-Evaluations - Econlib Econlib (Liberty Fund) · 6 April 2017
“Since he assigns probabilities to each prediction, Scott can graph his ex ante subjective probabilities against the ex post objective probabilities.”
- Freedom in the World 2017 - Syria Freedom House (republished by ecoi.net) · 1 January 2017
“Syria’s civil war continued unabated in 2016, with the country effectively divided into four main zones, controlled respectively by the repressive government of President Bashar al-Assad;”
- Freedom in the World 2017 - Syria Freedom House (republished by ecoi.net) · 1 January 2017
“However, political power remains monopolized by President Assad, his family, and their security and business allies, though foreign actors also express influence.”
Reasoning
Freedom House's Freedom in the World 2017 report on Syria covers 2016. It describes the civil war as continuing through 2016, with one of the main zones controlled by "the repressive government of President Bashar al-Assad" (E2), and says political power "remains monopolized by President Assad" (E3). This independent account shows Assad still held the presidency at the end of 2016, so the outcome the forecast favoured happened. E1 confirms only that the subject graded his own predictions; it says nothing about this outcome.
Cite this claim
Scott Alexander, “Scott Alexander gave a 60% probability that Assad would remain President of Syria.” (said 25 January 2016). Verdict: resolved true. Reliability API, claim c_748145851f30, method 0.1.0+8bea457b. https://epistacklabs.com/claims/c_748145851f30
Claims without a verdict
Is a verdict here wrong, or do you speak for Scott Alexander? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.