Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 63 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 1 prediction resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
70 52 87
All types combined: 74 (likely 64 to 84, medium confidence), from 22 claims: 15 factual claims, 7 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
GiveWell's claims
22 claims
“We aim to be conservative in calculating our money moved by including only donations that we are confident that we influenced.”
GiveWell, unsigned metrics report 2015 GiveWell Metrics Report – 2014 Annual Review (GiveWell)
GiveWell's money moved calculation includes only donations it is confident it influenced.
Unresolvable The public record could not settle it.
What would count as true or false
Judge GiveWell's 2015-era money moved methodology as stated in its money moved reports, as of 2015. True: the documented methodology counts only donations GiveWell had a specific, stated basis for attributing to its influence (for example donations made through GiveWell, donors who said in surveys that GiveWell influenced them, or recommended-charity reports tied to GiveWell), and it excludes donations whose attribution is uncertain. GiveWell describing itself as 'conservative' is not enough; the inclusion rules themselves must show this. Mostly true: the rules are conservative overall, with one minor documented category counted on looser grounds (for example a small estimated or default-attributed component). Mixed: a substantial share of the counted total rests on assumptions that GiveWell influenced donations it could not confirm. Mostly false or false: the methodology routinely counts donations without evidence of GiveWell's influence (for example all donations to its top charities), as shown by the report itself or by a third-party analysis.
Evidence
- Microsoft Word - Metrics report 2013 v5.doc (GiveWell Metrics Report 2013 Annual Review) GiveWell Own record
“It includes only donations that we can confidently attribute to our recommendations.”
- 2016 Annual Review How much charitable giving did GiveWell influence? GiveWell Own record
“Our understanding is that GiveWell's research is the sole input into these groups' recommendation of our top charities.”
Reasoning
E1, GiveWell's 2013 metrics report, says money moved includes only donations it can confidently attribute to its recommendations, but this is the subject's own description, which the criteria say is not enough on its own. E4, from 2016, shows at least one category counted in the headline total (donations via effective-giving groups) on an asserted basis rather than donor-level evidence, which points to looser attribution. Neither item documents the 2015-era inclusion rules themselves, and there is no independent analysis, so the evidence does not settle the claim under the criteria.
Cite this claim
GiveWell, “GiveWell's money moved calculation includes only donations it is confident it influenced.” (said 2015). Verdict: unresolvable. Reliability API, claim c_2e9508d7b1fb, method 0.1.0+7831dd9d. https://epistacklabs.com/claims/c_2e9508d7b1fb
Claims without a verdict
Is a verdict here wrong, or do you speak for GiveWell? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.