Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
73 67 79 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 0 predictions resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 0 promises resolved, 5 needed for a score.
All types combined: 73 (likely 67 to 79, high confidence), from 94 claims: 94 factual claims. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Nassim Taleb's claims
26 claims
“We analyze the robustness of our results to errors in historical reports, taking into account the unreliability of accounts by historians and absence of critical data.”
Nassim Taleb, paper author (abstract) 18 May 2015 On the statistical properties and tail risk of violent conflicts (arXiv)
The paper analyzes the robustness of its results to errors in historical reports, accounting for historians' unreliability and missing data.
Resolved true The record shows it happened or was so.
The second judge said mostly true; the verdict shown is the first judge's.
What would count as true or false
True: the paper in question (Cirillo & Taleb, 'On the statistical properties and tail risk of violent conflicts', 2015/2016) contains a robustness analysis that perturbs or reweights historical casualty figures to allow for errors or unreliability in historians' estimates, and addresses missing or incomplete data. Mostly true: there is such an analysis, but it covers either reporting error or missing data only lightly. Mixed: only one of the two (reporting error or missing data) is addressed. Mostly false: the robustness discussion is only a brief mention without real analysis. False: the paper has no such analysis.
Evidence
- [PDF] Long Peace.nb - Nassim Nicholas Taleb fooledbyrandomness.com (Nassim Nicholas Taleb) Own record
“Using Monte Carlo methods we have shown that, if we assume that the real number of casualties in a conflict is uniformly distributed between the minimum and the maximum in the available data”
- [PDF] Long Peace.nb - Nassim Nicholas Taleb fooledbyrandomness.com (Nassim Nicholas Taleb) Own record
“As we have shown in Section IV, missing data are unlikely to influence our estimates of the shape parameter”
- Are Wars And Violence Decreasing? Taleb's New Paper Reviewed William M. Briggs (wmbriggs.com) · 20 May 2015
“Measurement error, as admitted by the authors, and is by now obvious, is a tremendous and incurable problem.”
Reasoning
The claim is true. The paper's text (E2) describes Monte Carlo tests in which each conflict's casualty count is drawn uniformly between the minimum and maximum figures in the available data. That is a perturbation test for errors in historians' estimates. The paper also refers back to a Section IV analysis showing that missing data are unlikely to affect its estimates of the shape parameter (E3). An independent review (E4) notes that the authors admit measurement error and argues the problem is incurable; this shows that the authors acknowledge the error, but does not by itself show whether the paper analyses it.
Cite this claim
Nassim Taleb, “The paper analyzes the robustness of its results to errors in historical reports, accounting for historians' unreliability and missing data.” (said 18 May 2015). Verdict: resolved true. Reliability API, claim c_a053612b3a08, method 0.1.0+28da144b. https://epistacklabs.com/claims/c_a053612b3a08
Claims without a verdict
Is a verdict here wrong, or do you speak for Nassim Taleb? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.