Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 63 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 1 prediction resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
70 52 87
All types combined: 74 (likely 64 to 84, medium confidence), from 22 claims: 15 factual claims, 7 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
GiveWell's claims
22 claims
“The latter tend to be focused on the “end product,” as we stay agnostic on progress other organizations have made and how they can improve.”
GiveWell, unsigned blog post 7 January 2010 GiveWell's self-evaluation and plan (The GiveWell Blog)
GiveWell's reviews of other organizations tend to focus on the end product and stay agnostic on those organizations' progress and how they can improve.
Unresolvable The public record could not settle it.
What would count as true or false
Judged as of 2010-01-07. True: GiveWell's reviews of other organizations up to that date generally assessed outputs or end results and did not evaluate those organizations' progress or suggest improvements. Mostly true: this held for most reviews with some exceptions. Mixed: the reviews were split. Mostly false: most reviews did assess progress or recommend improvements. False: the reviews routinely focused on progress and improvement.
Evidence
- Charities Worthy of Special Recognition GiveWell · 10 May 2010 Own record
“we recognize AMREF for its commitment to monitoring and evaluation. However, the details in this report did not meet our criteria for proven impact, and we therefore did not proceed further with AMREF.”
- Celebrated charities that we don't recommend - The GiveWell Blog GiveWell Blog · 28 December 2009 Own record
“In most cases our assessment is based on significant back-and-forth with the charities themselves, though in some cases we are going off their website.”
- Overview of Criteria and Process Used for Identifying International Charities GiveWell · 1 January 2009 Own record
“Intervention reports. These are reviews of specific programs (e.g., bednets to prevent malaria, drugs to treat HIV/AIDS) in which we describe the program, review its evidence of effectiveness, and present what we know about its cost-effectiveness.”
- Celebrated charities that we don't recommend - The GiveWell Blog GiveWell Blog · 28 December 2009 Own record
“Normally, we focus on identifying outstanding charities, and minimize the time spent on opaque or otherwise lackluster ones.”
Reasoning
All evidence comes from GiveWell itself, and none directly shows whether its reviews of other organizations up to 2010-01-07 assessed their progress or suggested improvements. E3 describes intervention reports that review evidence of effectiveness and cost-effectiveness, and E4 says GiveWell spends little time on lackluster charities; both fit an end-product focus but do not confirm it. E2 notes extended back-and-forth with charities, which does not by itself show that GiveWell evaluated their progress or recommended improvements. E1 postdates the judgment date and addresses impact evidence rather than improvement advice, so the evidence does not settle the claim.
Cite this claim
GiveWell, “GiveWell's reviews of other organizations tend to focus on the end product and stay agnostic on those organizations' progress and how they can improve.” (said 7 January 2010). Verdict: unresolvable. Reliability API, claim c_1ce9fd146caf, method 0.1.0+7831dd9d. https://epistacklabs.com/claims/c_1ce9fd146caf
Claims without a verdict
Is a verdict here wrong, or do you speak for GiveWell? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.