Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 63 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 1 prediction resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
70 52 87
All types combined: 74 (likely 64 to 84, medium confidence), from 22 claims: 15 factual claims, 7 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
GiveWell's claims
22 claims
“We will share a full, substantive response to the winning and runner-up entries.”
GiveWell, unsigned organisational page 6 April 2022 GiveWell's Change Our Mind Contest (GiveWell)
GiveWell will share a full, substantive response to the winning and runner-up contest entries.
Unresolvable The public record could not settle it.
What would count as true or false
Delivered (true): GiveWell published a substantive response addressing the content of each winning and each runner-up entry in the Change Our Mind contest. Mostly true: every such entry got a response, with one response noticeably brief. Mostly false: responses covered only some of the winning and runner-up entries. False: a later record (for example the results post or a later update) shows no such responses were published or that the plan was dropped. No deadline was given; record when the responses appeared.
Evidence
- The winners of the Change Our Mind Contest—and some reflections - The GiveWell Blog GiveWell · 15 December 2022 Own record
“Winners are listed below, followed by our reflections on this contest and responses to the winners.”
- The winners of the Change Our Mind Contest—and some reflections - The GiveWell Blog GiveWell · 15 December 2022 Own record
“We’re not sure if conducting the full uncertainty modeling recommended by the entry is the right approach for GiveWell, and we’d like to explore alternative approaches to addressing this issue.”
- The winners of the Change Our Mind Contest—and some reflections - The GiveWell Blog GiveWell · 15 December 2022 Own record
“We believe the authors understand our analysis well and were able to identify some weak points in our cost-effectiveness analysis; we expect to make some but not all of the changes they propose.”
- Four prize-winning posts from 2022 - Happier Lives Institute Happier Lives Institute · 23 December 2022
“We believe HLI’s feedback is likely to change some of our funding recommendations, at least marginally, and perhaps, more importantly, improve our decision-making across multiple interventions.”
Reasoning
GiveWell's 15 December 2022 results post says it includes responses to the winners (E1). It gives substantive responses to the Haber first-place entry (E2) and the Romer & Romer first-place entry (E3), and the Happier Lives Institute quotes a GiveWell response to its prize-winning entry (E4). The fetched text shows no individual responses to the honorable-mention (runner-up) entries, but it was cut off partway (E3), so their absence does not show those responses were never published. The evidence therefore does not settle whether every runner-up entry received a substantive response.
Cite this claim
GiveWell, “GiveWell will share a full, substantive response to the winning and runner-up contest entries.” (said 6 April 2022). Verdict: unresolvable. Reliability API, claim c_a2683a51e756, method 0.1.0+7831dd9d. https://epistacklabs.com/claims/c_a2683a51e756
Claims without a verdict
Is a verdict here wrong, or do you speak for GiveWell? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.