Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
68 61 75 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
42 25 60 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 0 promises resolved, 5 needed for a score.
All types combined: 65 (likely 58 to 71, high confidence), from 78 claims: 69 factual claims, 9 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Ray Kurzweil's claims
24 claims
“And it’s going very, very quickly — at an exponential rate”
Ray Kurzweil, interviewee 29 March 2024 The Future Is Nearer with Ray Kurzweil (Nob Hill Gazette)
AI progress is advancing very quickly, at an exponential rate.
Mostly true True in substance, wrong in a detail.
What would count as true or false
Judge as of 2024-03-29. True: credible measures of AI progress up to early 2024 (e.g. training compute, benchmark performance, price-performance of compute, model capability trends from sources such as Epoch AI, Stanford AI Index) show sustained rapid growth that is roughly exponential, meaning a roughly constant doubling time or multiplicative rate over years. Mostly true: progress was very rapid and key inputs (e.g. compute) grew exponentially, but capability measures grew in a way that is only loosely exponential or uneven. Mixed: some major measures show exponential growth while others of similar weight show linear, saturating or slowing trends, so 'exponential' holds for about half of the relevant evidence. Mostly false: progress was fast, but the evidence shows it was not exponential in any meaningful measure, or only in a narrow input stated as if it applied to AI progress overall. False: evidence shows AI progress was not rapid, or was stagnating or slowing, as of early 2024.
Evidence
- Compute trends across three eras of machine learning Epoch AI · 16 February 2022
“Furthermore, we find that the training compute has grown by a factor of 10 billion since 2010, with a doubling rate of around 5-6 months.”
- Compute trends across three eras of machine learning Epoch AI · 16 February 2022
“Interestingly, the growth of compute in these Large-Scale models seems slower, with a doubling time of about 10 months.”
- Technical Performance Stanford Institute for Human-Centered Artificial Intelligence (HAI), 2024 AI Index Report · 1 January 2024
“AI models have reached performance saturation on established benchmarks such as ImageNet, SQuAD, and SuperGLUE, prompting researchers to develop more challenging ones.”
- The 2024 AI Index Report Stanford Institute for Human-Centered Artificial Intelligence (HAI)
“According to AI Index estimates, the training costs of state-of-the-art AI models have reached unprecedented levels. For example, OpenAI’s GPT-4 used an estimated $78 million worth of compute to train, while Google’s Gemini Ultra cost $191 million for compute.”
Reasoning
Epoch AI found that training compute for milestone ML systems grew about 10 billion-fold from 2010, doubling roughly every 5-6 months [E1]. Even the slower large-scale trend still doubled about every 10 months [E2]. So the main input grew at a roughly constant exponential rate. The 2024 AI Index says models have saturated established benchmarks like ImageNet, SQuAD and SuperGLUE [E3], and that frontier training costs reached $78M for GPT-4 and $191M for Gemini Ultra [E4]. That points to very fast progress, but it does not show capability itself growing at a constant exponential rate. The criteria call this case mostly true: inputs grew exponentially, while the capability evidence is only loosely exponential.
Cite this claim
Ray Kurzweil, “AI progress is advancing very quickly, at an exponential rate.” (said 29 March 2024). Verdict: mostly true. Reliability API, claim c_469e81ca9c7b, method 0.1.0+28da144b. https://epistacklabs.com/claims/c_469e81ca9c7b
Claims without a verdict
Is a verdict here wrong, or do you speak for Ray Kurzweil? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.