Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
79 72 85 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
80 72 88 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 1 promise resolved, 5 needed for a score.
All types combined: 79 (likely 74 to 84, high confidence), from 102 claims: 64 factual claims, 38 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Gary Marcus's claims
52 claims
“Microsoft put out a press release yesterday, masquerading as science, that claimed that GPT-4 was “an early (yet still incomplete) version of an artificial general intelligence (AGI) system”.”
Gary Marcus, Substack author 24 March 2023 The Sparks of AGI? Or the End of Science? (Marcus on AI)
Gary Marcus said that on 2023-03-23 Microsoft had put out what he called a press release masquerading as science, which claimed that GPT-4 was an early (yet still incomplete) version of an AGI system.
Mostly true True in substance, wrong in a detail.
What would count as true or false
The substantive claim is that around 23 March 2023 Microsoft (including its researchers) published a document stating that GPT-4 could be seen as 'an early (yet still incomplete) version of an artificial general intelligence (AGI) system'. Calling it a 'press release masquerading as science' is Marcus's characterisation, not a factual test. True: a Microsoft-authored document with that statement was made public on 2023-03-23, or a little before. Mostly true: such a document with that statement exists and was released within a few days of 23 March 2023 (for example on 22 March), or it is a research paper rather than a formal press release, with the substance otherwise as stated. Mostly false: Microsoft published such a document, but the wording materially differs (for example it does not describe GPT-4 as an early version of AGI), or it was released well away from that date. False: no such Microsoft document making that statement existed.
Evidence
- Sparks of Artificial General Intelligence: Early experiments with GPT-4 ar5iv (arXiv HTML rendering of arXiv:2303.12712)
“Given the breadth and depth of GPT-4’s capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system.”
- Microsoft Researchers Claim GPT-4 Is Showing "Sparks" of AGI Futurism · 23 March 2023
““Given the breadth and depth of GPT-4’s capabilities,” they continue, “we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system.””
- Artificial General Intelligence (AGI) Is A Very Human Hallucination Forbes (Gil Press, Senior Contributor) · 28 March 2023
“Microsoft researchers reported on March 22 the results of their investigation of an “early version” of GPT-4, claiming that it exhibits “more general intelligence than previous AI models.””
- Sparks of Artificial General Intelligence: Early experiments with GPT-4 | CenterConsulting CenterConsulting · 22 March 2023
““Sparks of Artificial General Intelligence: Early experiments with GPT-4” was submitted to arXiv on March 22, 2023 by a Microsoft Research team led by Sebastien Bubeck, with co-authors including Eric Horvitz and Yin Tat Lee.”
Reasoning
E1 and E2 confirm that a document by Microsoft researchers, "Sparks of Artificial General Intelligence: Early experiments with GPT-4", says GPT-4 "could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system", matching the quoted wording. E3 and E4 date its release to 22 March 2023 on arXiv, one day before the date the claim implies. It was also a research paper rather than a formal press release. Under the criteria, those two differences make the verdict mostly true.
Cite this claim
Gary Marcus, “Gary Marcus said that on 2023-03-23 Microsoft had put out what he called a press release masquerading as science, which claimed that GPT-4 was an early (yet still incomplete) version of an AGI system.” (said 24 March 2023). Verdict: mostly true. Reliability API, claim c_80e488884e68, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_80e488884e68
Claims without a verdict
Is a verdict here wrong, or do you speak for Gary Marcus? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.