Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 63 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 1 prediction resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
70 52 87
All types combined: 74 (likely 64 to 84, medium confidence), from 22 claims: 15 factual claims, 7 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
GiveWell's claims
22 claims
“Among all donors who gave in the previous year, about 35% gave again in 2016, down from about 40% who gave again in 2015.”
GiveWell 2018 GiveWell Metrics Report – 2016 Annual Review (GiveWell)
Among donors who gave in 2015, about 35% gave again in 2016, down from about 40% who gave again in 2015.
Unresolvable The public record could not settle it.
What would count as true or false
Judged against GiveWell's donor-retention data as published around 2018. True: the share of prior-year donors who gave again was about 35% in 2016 (within roughly ±3 points) and about 40% in 2015 (within roughly ±3 points), so retention fell. Mostly true: retention fell from 2015 to 2016, but one figure is off by a little more than that (up to about ±5 points). Mixed: only one of the two figures is roughly right, or both figures are roughly right but the decline is negligible or ambiguous. Mostly false: retention did not decline, or both figures are clearly off. False: the data show retention rose or stayed flat, with figures far from 35% and 40%.
Evidence
- GiveWell’s money moved and web traffic in 2015 - The GiveWell Blog GiveWell (GiveWell Blog) · 13 May 2016 Own record
“Among all donors who gave in the previous year, about 40% gave again in 2015, up from about 33% who gave again in 2014.”
Reasoning
GiveWell's 2016 blog post [E2] reports that about 40% of prior-year donors gave again in 2015, which matches the claim's 2015 figure. No evidence covers the 2016 retention rate, so neither the roughly 35% figure nor the claimed decline can be checked against GiveWell's published data. With only half the claim supported, the evidence does not settle it under the criteria.
Cite this claim
GiveWell, “Among donors who gave in 2015, about 35% gave again in 2016, down from about 40% who gave again in 2015.” (said 2018). Verdict: unresolvable. Reliability API, claim c_0fbe5e3ff778, method 0.1.0+7831dd9d. https://epistacklabs.com/claims/c_0fbe5e3ff778
Claims without a verdict
Is a verdict here wrong, or do you speak for GiveWell? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.