Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
79 72 85 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
80 72 88 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 1 promise resolved, 5 needed for a score.
All types combined: 79 (likely 74 to 84, high confidence), from 102 claims: 64 factual claims, 38 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Gary Marcus's claims
42 claims
“It actually called for *more* research.”
Gary Marcus, quoting own tweet 30 March 2023 The Open Letter Controversy (Marcus on AI)
The FLI open letter called for more AI research.
Resolved true The record shows it happened or was so.
What would count as true or false
Refers to the Future of Life Institute's March 2023 open letter 'Pause Giant AI Experiments'. True if the letter's text explicitly calls for more or refocused AI research (e.g. that AI research and development be refocused or that AI safety research be expanded) while pausing training of systems more powerful than GPT-4. Mostly true if the letter calls for more research only in specific areas (such as safety or alignment) rather than AI research in general, and the claim's emphasis slightly overstates it. Mixed if the letter mentions research only in passing and its main call is to restrict research. Mostly false if the letter's call for research is marginal and its overall demand is a halt to AI research activity. False if the letter's text contains no call for more research.
Evidence
- Pause Giant AI Experiments: An Open Letter - Future of Life Institute Future of Life Institute
“AI research and development should be refocused on making today’s powerful, state-of-the-art systems more accurate, safe, interpretable, transparent, robust, aligned, trustworthy, and loyal.”
- Pause Giant AI Experiments: An Open Letter - Future of Life Institute Future of Life Institute
“Therefore, we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.”
- Pause Giant AI Experiments: An Open Letter - Future of Life Institute Future of Life Institute
“liability for AI-caused harm; robust public funding for technical AI safety research; and well-resourced institutions for coping with the dramatic economic and political disruptions”
- FAQs about FLI’s Open Letter Calling for a Pause on Giant AI Experiments - Future of Life Institute Future of Life Institute · 31 March 2023
“This does not imply a pause or ban on all AI research and development or the use of systems that have already been placed in the market.”
Reasoning
The letter's text says that "AI research and development should be refocused" on making current systems more accurate, safe, interpretable and aligned (E1). It also calls for "robust public funding for technical AI safety research" (E3). The same letter calls on AI labs to pause for at least six months the training of AI systems more powerful than GPT-4 (E2). The criteria count an explicit call for refocused research or expanded safety research alongside the pause as true, and the letter's text meets that standard.
Cite this claim
Gary Marcus, “The FLI open letter called for more AI research.” (said 30 March 2023). Verdict: resolved true. Reliability API, claim c_a8a6616c6d1a, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_a8a6616c6d1a
Claims without a verdict
Is a verdict here wrong, or do you speak for Gary Marcus? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.