Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 63 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 1 prediction resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
70 52 87
All types combined: 74 (likely 64 to 84, medium confidence), from 22 claims: 15 factual claims, 7 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
GiveWell's claims
22 claims
“We expect that most strong entries will focus on one of the above programs.”
GiveWell, unsigned organisational page 6 April 2022 GiveWell's Change Our Mind Contest (GiveWell)
Most strong contest entries will focus on one of the six listed programs.
Unresolvable The public record could not settle it.
What would count as true or false
Judge after the Change Our Mind contest results are announced (2022). True: more than half of the winning, runner-up and honourable-mention entries (GiveWell's 'strong' entries) focus on one of the six listed programs. Mostly true: about half or slightly more, with ambiguity about whether some entries count as focusing on a listed program. Mixed: roughly 40–50%. Mostly false: a clear minority. False: few or none of the strong entries focus on the listed programs.
Evidence
- The winners of the Change Our Mind Contest—and some reflections - The GiveWell Blog GiveWell Blog · 15 December 2022 Own record
“Dr. Samantha Field and Dr. Yannish Naik for “A critique of GiveWell’s CEA model for Conditional Cash Transfers for vaccination in Nigeria (New Incentives)“”
- The winners of the Change Our Mind Contest—and some reflections - The GiveWell Blog GiveWell Blog · 15 December 2022 Own record
“Isobel Phillips for “Improving GiveWell’s modelling of insecticide resistance may change their cost per life saved for AMF by up to 20%“”
- The winners of the Change Our Mind Contest—and some reflections - The GiveWell Blog GiveWell Blog · 15 December 2022 Own record
“The authors suggest several changes to GiveWell’s analysis of water chlorination programs, which overall make Dispensers for Safe Water’s program appear less cost-effective.”
- The winners of the Change Our Mind Contest—and some reflections - The GiveWell Blog GiveWell Blog · 15 December 2022 Own record
“We received at least two entries on each of the six cost-effectiveness analyses we pointed people toward, plus some entries on other programs, and many cross-cutting entries on issues like uncertainty, the discount rate for future benefits, our moral weights, and more.”
Reasoning
The evidence identifies some strong entries that focus on listed or top-charity programs: New Incentives (E1), AMF (E2) and possibly water chlorination (E3), though the excerpt does not confirm that chlorination is among the six. E4 says there were many cross-cutting entries on uncertainty, discount rates and moral weights, but it does not say how many of the winning, runner-up and honourable-mention entries were cross-cutting. Without the full list of strong entries and their topics, the share focusing on the six programs cannot be worked out under the criteria.
Cite this claim
GiveWell, “Most strong contest entries will focus on one of the six listed programs.” (said 6 April 2022). Verdict: unresolvable. Reliability API, claim c_8062f95fc8df, method 0.1.0+7831dd9d. https://epistacklabs.com/claims/c_8062f95fc8df
Claims without a verdict
Is a verdict here wrong, or do you speak for GiveWell? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.