Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
81 76 87 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 2 predictions resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
65 45 83
All types combined: 80 (likely 75 to 85, high confidence), from 84 claims: 78 factual claims, 6 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Demis Hassabis's claims
14 claims
“I don’t think that’s the case. I think that actually Gemini 1 used roughly the same amount of compute, maybe slightly more, than what was rumored for GPT-4.”
Demis Hassabis, CEO of Google DeepMind 28 February 2024 Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFold (Dwarkesh Podcast)
Hassabis said he thinks Gemini 1 used roughly the same amount of compute as was rumored for GPT-4, maybe slightly more, though he said he did not know exactly what was used for GPT-4.
Own records only Only the person's or their organisation's own records speak to it, so it is not scored.
Said for an organisation they lead or work for; it counts on both records.
Reasoning
Gemini 1 training compute is not publicly disclosed and GPT-4's is only rumored.
Cite this claim
Demis Hassabis, “Hassabis said he thinks Gemini 1 used roughly the same amount of compute as was rumored for GPT-4, maybe slightly more, though he said he did not know exactly what was used for GPT-4.” (said 28 February 2024). Verdict: own records only. Reliability API, claim c_aed1b8bd499f, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_aed1b8bd499f
Claims without a verdict
Is a verdict here wrong, or do you speak for Demis Hassabis? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.