Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 63 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 1 prediction resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
70 52 87
All types combined: 74 (likely 64 to 84, medium confidence), from 22 claims: 15 factual claims, 7 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
GiveWell's claims
“The progress we’ve made since November 2008 (when we last laid out a business plan)”
GiveWell, unsigned blog post 7 January 2010 GiveWell's self-evaluation and plan (The GiveWell Blog)
GiveWell last laid out a business plan in November 2008.
Mostly true True in substance, wrong in a detail.
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
Judged as of 2010-01-07. True: GiveWell published or laid out a business plan in November 2008 and laid out none between then and January 2010. Mostly true: the plan dates to late 2008, within about a month of November, and no later plan exists. Mixed or mostly false: a business plan was laid out in November 2008, but a later one also appeared before January 2010. False: there was no business plan around November 2008, or the most recent plan before January 2010 is clearly at a different date.
Evidence
- Self-evaluation: GiveWell as a donor resource - The GiveWell Blog GiveWell Blog (givewell.org) · 9 February 2010 Own record
“Our progress over the last year (specifically, since our last business plan in 11/2008);”
- Self-evaluation: GiveWell as a project - The GiveWell Blog GiveWell Blog (givewell.org) · 11 February 2010 Own record
“As of 11/08, we had only made one extended attempt to hire a third employee”
- Microsoft Word - Vision Document 2008 11 17.doc GiveWell (files.givewell.org) · 17 November 2008 Own record
“The path we are focused on now, outlined in a separate document, focuses for the short term on the depth, breadth, and presentation of our research”
- Revisiting GiveWell Createquity · 22 January 2009
“GiveWell has published a new “steady-state” vision document describing where the founders see the organization in 3-6 years.”
Reasoning
E3 is a GiveWell document filed under 'Business Plans and Reviews' in a folder dated 2008-11-17, which points to planning documents from November 2008. E1 and E2, GiveWell's own self-evaluations from February 2010, describe 11/2008 as the date of its last business plan, so no later plan is indicated. The independent source E4 (January 2009) mentions a newly published vision document, which fits a late-2008 date but does not confirm the business plan's exact date. Because the evidence comes mostly from GiveWell itself and the November date rests on file and folder names, the claim resolves mostly true rather than fully true.
Cite this claim
GiveWell, “GiveWell last laid out a business plan in November 2008.” (said 7 January 2010). Verdict: mostly true. Reliability API, claim c_52dc902652d3, method 0.1.0+7831dd9d. https://epistacklabs.com/claims/c_52dc902652d3
Claims without a verdict
Is a verdict here wrong, or do you speak for GiveWell? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.