ClaimsGiveWell

“We expect that most strong entries will focus on one of the above programs.”

GiveWell, unsigned organisational page 6 April 2022 GiveWell's Change Our Mind Contest (GiveWell) archived copy

Prediction Their own work or organisation

Most strong contest entries will focus on one of the six listed programs.

Unresolvable The public record could not settle it.

Prediction: Statements about events outside the person's control, checked once they fell due: did they come true?

What would count as true or false

Judge after the Change Our Mind contest results are announced (2022). True: more than half of the winning, runner-up and honourable-mention entries (GiveWell's 'strong' entries) focus on one of the six listed programs. Mostly true: about half or slightly more, with ambiguity about whether some entries count as focusing on a listed program. Mixed: roughly 40–50%. Mostly false: a clear minority. False: few or none of the strong entries focus on the listed programs.

Set before the research began.

Evidence (4)

  1. E1 The winners of the Change Our Mind Contest—and some reflections - The GiveWell Blog GiveWell Blog · 15 December 2022 Own record

    “Dr. Samantha Field and Dr. Yannish Naik for “A critique of GiveWell’s CEA model for Conditional Cash Transfers for vaccination in Nigeria (New Incentives)“”
  2. E2 The winners of the Change Our Mind Contest—and some reflections - The GiveWell Blog GiveWell Blog · 15 December 2022 Own record

    “Isobel Phillips for “Improving GiveWell’s modelling of insecticide resistance may change their cost per life saved for AMF by up to 20%“”
  3. E3 The winners of the Change Our Mind Contest—and some reflections - The GiveWell Blog GiveWell Blog · 15 December 2022 Own record

    “The authors suggest several changes to GiveWell’s analysis of water chlorination programs, which overall make Dispensers for Safe Water’s program appear less cost-effective.”
  4. E4 The winners of the Change Our Mind Contest—and some reflections - The GiveWell Blog GiveWell Blog · 15 December 2022 Own record

    “We received at least two entries on each of the six cost-effectiveness analyses we pointed people toward, plus some entries on other programs, and many cross-cutting entries on issues like uncertainty, the discount rate for future benefits, our moral weights, and more.”

Reasoning

The evidence identifies some strong entries that focus on listed or top-charity programs: New Incentives (E1), AMF (E2) and possibly water chlorination (E3), though the excerpt does not confirm that chlorination is among the six. E4 says there were many cross-cutting entries on uncertainty, discount rates and moral weights, but it does not say how many of the winning, runner-up and honourable-mention entries were cross-cutting. Without the full list of strong entries and their topics, the share focusing on the six programs cannot be worked out under the criteria.

Cite this claim

GiveWell, “Most strong contest entries will focus on one of the six listed programs.” (said 6 April 2022). Verdict: unresolvable. Reliability API, claim c_8062f95fc8df, method 0.1.0+7831dd9d, dataset release v1.1.2. https://epistacklabs.com/claims/c_8062f95fc8df

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For GiveWell, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More prediction claims by GiveWell

  1. Resolved true Prediction 6 April 2022
    “Due to limited research capacity, we likely won't be able to share a full response to all entries; it's time-consuming for us to write thorough responses, and we aren't sure how many entries we will…”

    GiveWell likely will not be able to share a full response to all contest entries, due to limited research capacity.

All of them

Verdicts are made automatically; how verdicts are made.