| Verdict | Person | Kind | Said | Claim | Topic |
|---|---|---|---|---|---|
| Resolved true | Ray Dalio | Factual | 9 May 2026 | About one-third of US debt is held by foreigners. Ray Dalio · Factual · 9 May 2026 | Economics and markets |
| Mostly true | Jensen Huang | Factual | 17 Mar 2026 | Satya Nadella confirmed that the first Vera Rubin rack is running on Microsoft Azure. Jensen Huang · Factual · 17 Mar 2026 | Economics and markets |
| Mixed | Jensen Huang | Factual | Nov 2025 | Cloud GPUs are sold out, as of NVIDIA's third quarter fiscal 2026 results (Nov. 2025). Jensen Huang · Factual · Nov 2025 | AI compute, hardware and data |
| Mixed | Sam Altman | Factual | 9 Aug 2025 | GPT-5 is significantly better than earlier models at healthcare-related queries. Sam Altman · Factual · 9 Aug 2025 | AI capabilities |
| Resolved true | Gary Marcus | Prediction | 27 Jul 2025 | If the model being discussed has guardrails like ChatGPT's, they will teeter between being too weak (beaten by jailbreaks) and too strong (rejecting some perfectly reasonable requests). Gary Marcus · Prediction · 27 Jul 2025 | AI safety and alignment |
| Mostly true | Dario Amodei | Factual | 18 Feb 2025 | The lack of understanding of how AI systems work is essentially unprecedented in the history of technology. Dario Amodei · Factual · 18 Feb 2025 | AI safety and alignment |
| Resolved true | Rodney Brooks | Factual | 1 Jan 2025 | Despite further thruster anomalies, Starliner would have landed safely had the crew been aboard when it returned empty in 2024. Rodney Brooks · Factual · 1 Jan 2025 | Economics and markets |
| Resolved true | Tyler Cowen | Factual | 25 Dec 2024 | The war in Ethiopia affecting Yonas's region is over in the immediate sense. Tyler Cowen · Factual · 25 Dec 2024 | Other |
| Mostly true | Peter Thiel | Factual | Apr 2024 | René Girard often said that Christ was the first political atheist. Peter Thiel · Factual · Apr 2024 | Philosophy, ethics and society |
| Mostly true | Elon Musk | Factual | 19 Mar 2024 | Political donations from old Twitter were 99% to Democrats. Elon Musk · Factual · 19 Mar 2024 | Philosophy, ethics and society |
| Mostly true | Marc Andreessen | Factual | 12 Jun 2023 | As of June 2023, the U.S. government was both alarmed about deepfakes and trying to outlaw blockchains. Marc Andreessen · Factual · 12 Jun 2023 | AI policy and governance |
| Mostly true | Elon Musk | Promise | 26 Jan 2023 | Tesla expects to use the Dojo computer operationally later in 2023. Elon Musk · Promise · 26 Jan 2023 | AI compute, hardware and data |
| Mostly true | Jeremy Grantham | Factual | 31 Aug 2022 | Few superbubbles exist in history to study, and they share clear common features. Jeremy Grantham · Factual · 31 Aug 2022 | Economics and markets |
| Resolved true | Daniela Amodei | Factual | 2022 | As of 2022 there are no clear guidelines for AI developers on how to avoid advancing race dynamics or do the right thing on safety. Daniela Amodei · Factual · 2022 | AI policy and governance |
| Resolved true | Daniela Amodei | Factual | 2022 | Anthropic trains large-scale generative models and does safety research on those models. Daniela Amodei · Factual · 2022 | Their own work or organisation |
| Mostly true | GiveWell | Promise | 28 May 2020 | In 2020 GiveWell will complete its review of the New Incentives RCT results and decide whether to direct additional funding to New Incentives. GiveWell · Promise · 28 May 2020 | Their own work or organisation |
| Mostly true | Marc Andreessen | Factual | 1 Jan 2018 | Andreessen Horowitz initially made no healthcare-related investments. Marc Andreessen · Factual · 1 Jan 2018 | Their own work or organisation |
| Mostly false | Ray Kurzweil | Prediction | 3 Jun 2015 | Kurzweil predicted that humans will gradually merge with technology and enhance themselves. Ray Kurzweil · Prediction · 3 Jun 2015 | AI timelines and forecasting |
| Mostly true | Nassim Taleb | Factual | 12 Dec 2012 | Theory is born from practice more often than practice from theory, with technology more often preceding science. Nassim Taleb · Factual · 12 Dec 2012 | Science and research methods |
| Resolved true | Jeff Bezos | Factual | 2001 | Amazon.com said it had been told that its American Customer Satisfaction Index score of 84 was the highest ever recorded for a service company in any industry. Jeff Bezos · Factual · 2001 | Economics and markets |
“this lack of understanding is essentially unprecedented in the history of technology.”
Dario Amodei, writing on his own site 18 February 2025 The Urgency of Interpretability (darioamodei.com)
The lack of understanding of how AI systems work is essentially unprecedented in the history of technology.
Mostly true True in substance, wrong in a detail.
The second judge said mostly false; the verdict shown is the first judge's.
What would count as true or false
The claim is hedged ('essentially'). It says that how poorly the internal workings of modern AI systems are understood has essentially no precedent among major technologies. TRUE: expert or historical analyses support that widely deployed technologies have generally been built on a reasonably good mechanistic understanding, and that no comparable case exists of a major deployed technology whose workings were as opaque to its builders. MOSTLY TRUE: the claim broadly holds, but there are partial historical parallels (for example early pharmaceuticals such as aspirin, metallurgy, or early steam engines before thermodynamics) that make 'unprecedented' slightly too strong. MIXED: significant precedents exist that are arguably comparable, and expert opinion is divided. MOSTLY FALSE: clear precedents exist of important technologies deployed with little understanding of how they work, so the claim exaggerates a real gap in understanding. FALSE: it was common historically to deploy technologies whose mechanisms were similarly poorly understood, and AI is not distinctive in this respect.
Evidence
- The Virtues of Interpretable Medical AI Cambridge Quarterly of Healthcare Ethics (authors: Joshua Hatherley, Robert Sparrow, Mark Howard, Monash University) · 2024
“Other authors have also highlighted acetaminophen and penicillin, which “were in widespread use for decades before their mechanism of action was understood,” along with selective serotonin reuptake inhibitors, whose underlying causal mechanism is still unclear.”
- The Virtues of Interpretable Medical AI Cambridge Quarterly of Healthcare Ethics (authors: Joshua Hatherley, Robert Sparrow, Mark Howard, Monash University) · 2024
“For example, electroconvulsive therapy is highly effective for severe depression, but we have no idea how it works. Likewise, there are many drugs that seem to work even though no one can explain how.”
- The Virtues of Interpretable Medical AI Cambridge Quarterly of Healthcare Ethics (authors: Joshua Hatherley, Robert Sparrow, Mark Howard, Monash University) · 2024
“A problem, however, is that the inner workings of these systems have often proven thoroughly resistant to understanding, explanation, or justification, not only to end users (e.g., doctors, clinicians, and nurses), but even to the designers of these systems themselves.”
Reasoning
A medical ethics journal article (E3) says the inner workings of these AI systems have often resisted understanding, even by the people who designed them. That supports the premise that AI is unusually opaque. The same article also records partial historical parallels: acetaminophen and penicillin were widely used for decades before anyone understood how they worked, the mechanism of SSRIs is still unclear (E1), and electroconvulsive therapy and many drugs work in ways no one can explain (E2). The resolution criteria name early pharmaceuticals as exactly the kind of partial parallel that makes "unprecedented" slightly too strong, so the hedged claim broadly holds but is somewhat overstated.
Cite this claim
Dario Amodei, “The lack of understanding of how AI systems work is essentially unprecedented in the history of technology.” (said 18 February 2025). Verdict: mostly true. Reliability API, claim c_217a061d517b, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_217a061d517b
Verdicts are made automatically; how verdicts and scores are made. The same data is on Hugging Face under CC BY 4.0.