Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
79 72 85 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
80 72 88 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 1 promise resolved, 5 needed for a score.
All types combined: 79 (likely 74 to 84, high confidence), from 102 claims: 64 factual claims, 38 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Gary Marcus's claims
52 claims
“AGI didn’t materialize (contra predictions from Elon Musk and others); GPT-5 was underwhelming, and didn’t solve hallucinations.”
Gary Marcus, author January 2026 Six (or seven) predictions for AI 2026 from a Generative AI realist (Marcus on AI)
AGI did not materialize in 2025, contrary to predictions by Elon Musk and others, and GPT-5 was underwhelming and did not solve hallucinations.
Mostly true True in substance, wrong in a detail.
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
Three parts: (1) AGI did not arrive in 2025 even though Elon Musk and others predicted it; (2) GPT-5 was underwhelming; (3) GPT-5 did not solve hallucinations. True if: no system was widely accepted as AGI by the end of 2025; Musk or other prominent figures had predicted AGI by around 2025; GPT-5 (released 2025) got a broadly lukewarm or disappointed reception from users, reviewers or experts relative to the hype; and evaluations or OpenAI's own documentation show GPT-5 still hallucinates at non-trivial rates. Mostly true if all parts hold but one detail is weak, e.g. the reception was mixed rather than clearly underwhelming, or Musk's prediction was for a slightly different date. Mixed if roughly half of the parts hold (e.g. AGI and hallucinations hold but GPT-5 was broadly received as a major advance). Mostly false if only one part holds. False if AGI was widely held to have been achieved in 2025, or GPT-5 was shown to have eliminated hallucinations and was well received.
Evidence
- GPT-5’s model router ignited a user backlash against OpenAI—but it might be the future of AI | Fortune Fortune · 12 August 2025
“But Falcon said the core problem was that GPT-5 simply didn’t feel like a leap.”
- Commentary: Say farewell to the AI bubble, and get ready for the crash Los Angeles Times · 20 August 2025
“As it happened, GPT-5 was a bust. It turned out to be less user-friendly and in many ways less capable than its predecessors in OpenAI’s arsenal.”
- GPT-5 System Card OpenAI · 7 August 2025
“We’ve made significant advances in reducing hallucinations, improving instruction following, and minimizing sycophancy”
- Why language models hallucinate OpenAI · 5 September 2025
“| Error rate (wrong answer, lower is better) | 26% | 75% |”
- Elon Musk Said AGI Would Arrive by 2025. Now He Says 2026. Spotify (Elon Musk Podcast episode page) · 18 December 2025
“The same week, he told xAI staff that AGI could arrive by 2026. Last year he said AGI would arrive by 2025.”
- GPT-5 System Card - OpenAI Deployment Safety Hub OpenAI · 7 August 2025
“We’ve made significant advances in reducing hallucinations, improving instruction following, and minimizing”
- OpenAI says GPT-5 hallucinates less — what does the data say? Mashable · 7 August 2025
“Specifically, GPT makes incorrect claims 9.6 percent of the time, compared to 12.9 percent for GPT-4o.”
- GPT-5 and GPT-4 were both major leaps in benchmarks from the previous generation Epoch AI · 29 August 2025
“we observe dramatic improvements on benchmarks for both GPT-4 and GPT-5 on benchmarks that were salient in their respective time periods.”
Reasoning
E5 reports that Musk said AGI would arrive by 2025 and in late 2025 moved his forecast to 2026, which indicates AGI had not arrived by the end of 2025. E7 reports that GPT-5 still makes incorrect claims 9.6% of the time, and OpenAI's own system card (E3) speaks only of "reducing" hallucinations, not eliminating them. On reception, E1 (Fortune, quoting a person named Falcon) and E2 (an LA Times commentary) describe GPT-5 as not feeling like a leap or as a bust. E8 (Epoch AI), however, reports dramatic benchmark gains for GPT-5; this addresses capability rather than reception, but it weighs against calling GPT-5 underwhelming on capability grounds, so the 'underwhelming' part is the weakest.
Cite this claim
Gary Marcus, “AGI did not materialize in 2025, contrary to predictions by Elon Musk and others, and GPT-5 was underwhelming and did not solve hallucinations.” (said January 2026). Verdict: mostly true. Reliability API, claim c_5a94576e8fe7, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_5a94576e8fe7
Claims without a verdict
Is a verdict here wrong, or do you speak for Gary Marcus? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.