Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
79 72 85 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
80 72 88 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 1 promise resolved, 5 needed for a score.
All types combined: 79 (likely 74 to 84, high confidence), from 102 claims: 64 factual claims, 38 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Gary Marcus's claims
42 claims
“The letter didn't call for a ban on AI. It didn't call for a permanent ban.”
Gary Marcus, quoting own tweet 30 March 2023 The Open Letter Controversy (Marcus on AI)
The FLI open letter did not call for a ban on AI or for a permanent ban.
Resolved true The record shows it happened or was so.
What would count as true or false
Judged as of 2023-03-30, against the text of the Future of Life Institute's March 2023 'Pause Giant AI Experiments' open letter. True: the letter calls for a time-limited pause (for example at least six months) on training systems more powerful than GPT-4, and does not call for banning AI in general or for any permanent ban. A fallback call for a temporary government moratorium on the same frontier training is consistent with true. Mostly false: the letter's wording could reasonably be read as calling for an indefinite halt to some AI development. False: the letter explicitly calls for banning AI or for a permanent ban.
Evidence
- Pause Giant AI Experiments: An Open Letter - Future of Life Institute Future of Life Institute
“Therefore, we call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.”
- Pause Giant AI Experiments: An Open Letter - Future of Life Institute Future of Life Institute
“If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.”
- Pause Giant AI Experiments: An Open Letter - Future of Life Institute Future of Life Institute
“This does not mean a pause on AI development in general, merely a stepping back from the dangerous race to ever-larger unpredictable black-box models with emergent capabilities.”
- FAQs about FLI’s Open Letter Calling for a Pause on Giant AI Experiments - Future of Life Institute Future of Life Institute · 31 March 2023
“This does not imply a pause or ban on all AI research and development or the use of systems that have already been placed in the market.”
Reasoning
The letter's text calls on AI labs to pause for at least 6 months the training of systems more powerful than GPT-4 [E1]. It states that this "does not mean a pause on AI development in general" [E3]. Its fallback asks governments to institute a moratorium if a pause cannot be enacted quickly [E2]. The criteria treat that fallback as consistent with true, and no part of the quoted text calls for a ban on AI or for a permanent ban. FLI's FAQ, dated 31 March 2023, likewise says the call does not imply a pause or ban on all AI research and development [E4].
Cite this claim
Gary Marcus, “The FLI open letter did not call for a ban on AI or for a permanent ban.” (said 30 March 2023). Verdict: resolved true. Reliability API, claim c_d0a4353b3ee8, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_d0a4353b3ee8
Claims without a verdict
Is a verdict here wrong, or do you speak for Gary Marcus? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.