Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 69 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
56 42 70 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 4 promises resolved, 5 needed for a score.
All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Dario Amodei's claims
28 claims
“There was no example data from humans required in the AlphaGo Zero version of it.”
Dario Amodei, Anthropic CEO, interviewee 11 November 2024 Transcript for Dario Amodei: Anthropic CEO on Claude, AGI & the Future of AI & Humanity (Lex Fridman Podcast)
DeepMind's AlphaGo Zero required no example data from humans.
Resolved true The record shows it happened or was so.
What would count as true or false
True: DeepMind's AlphaGo Zero paper (Silver et al., Nature, 2017) or DeepMind's announcement states that AlphaGo Zero was trained without human game data, through self-play reinforcement learning starting from random play, given only the rules. Mostly true: no human gameplay data was used, but some minor human input, such as hand-specified rules or the board representation, is relevant in a way that slightly qualifies 'no example data'. Mixed or mostly false: AlphaGo Zero used some human game records in a meaningful way. False: AlphaGo Zero was trained substantially on human expert games.
Evidence
- Mastering the game of Go without human knowledge - Nature Nature · 19 October 2017
“Here we introduce an algorithm based solely on reinforcement learning, without human data, guidance or domain knowledge beyond game rules.”
- AlphaGo Zero: Starting from scratch DeepMind · 18 October 2017
“AlphaGo Zero skips this step and learns to play simply by playing games against itself, starting from completely random play.”
- AlphaGo Zero: Starting from scratch DeepMind · 18 October 2017
“AlphaGo Zero only uses the black and white stones from the Go board as its input, whereas previous versions of AlphaGo included a small number of hand-engineered features.”
- AlphaGo Zero: Starting from scratch DeepMind · 18 October 2017
“Previous versions of AlphaGo initially trained on thousands of human amateur and professional games to learn how to play Go.”
Reasoning
The Nature paper's abstract describes AlphaGo Zero's algorithm as "based solely on reinforcement learning, without human data, guidance or domain knowledge beyond game rules" (E1). DeepMind's announcement says AlphaGo Zero skipped the human-game training step and learned by playing against itself, starting from completely random play (E2). It contrasts this with earlier AlphaGo versions, which trained on thousands of human games (E4). This matches the True criterion: AlphaGo Zero was trained through self-play without human game data, given only the rules.
Cite this claim
Dario Amodei, “DeepMind's AlphaGo Zero required no example data from humans.” (said 11 November 2024). Verdict: resolved true. Reliability API, claim c_fd02a288d30c, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_fd02a288d30c
Claims without a verdict
- Unresolvable 157
- Not yet due 40
- Own records only 43
- Not researched 134
- Not checkable 864
Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.