Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 69 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
56 42 70 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 4 promises resolved, 5 needed for a score.
All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Dario Amodei's claims
28 claims
“We kind of already do RL with RLHF.”
Dario Amodei, Anthropic CEO, interviewed 8 August 2023 Dario Amodei (Anthropic CEO) - $10 Billion Models, OpenAI, Scaling, & AGI in 2 years (Dwarkesh Podcast)
Amodei said Anthropic "kind of" already does reinforcement learning, through RLHF.
Resolved true The record shows it happened or was so.
The evidence is the person's or their organisation's own records.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
True: Anthropic's publications or official statements as of August 2023 show that it trained its language models with reinforcement learning from human feedback (RLHF) or its RL-based variants (e.g. RLAIF/Constitutional AI), which involve reinforcement learning. Mostly true: RL was used, but by a variant described slightly differently. Mostly false: RLHF-style methods were used only in research and not on its models. False: Anthropic did not use RL-based fine-tuning on its language models.
Evidence
- Model Card and Evaluations for Claude Models - Anthropic Anthropic Own record
“They use a transformer architecture and are trained via unsupervised learning, RLHF, and Constitutional AI (including both”
- Claude's constitution Anthropic · 9 May 2023 Own record
“During the second phase, a model is trained via reinforcement learning, but rather than using human feedback, it uses AI-generated feedback based on the set of principles to choose the more harmless output.”
- Training a helpful and harmless assistant with RLHF Anthropic · 12 April 2022 Own record
“We apply preference modeling and reinforcement learning from human feedback (RLHF) to finetune language models to act as helpful and harmless assistants.”
- Constitutional AI: Harmlessness from AI feedback Anthropic · 15 December 2022 Own record
“In the RL phase, we sample from the finetuned model, use a model to evaluate which of the two samples is better, and then train a preference model from this dataset of AI preferences. We then train with RL using the preference model as the reward signal, i.e. we use 'RL from AI Feedback' (RLAIF).”
Reasoning
E2 is Anthropic's 2023-05-09 post on Claude's constitution, which predates the claim. It says that in the second training phase a model is trained with reinforcement learning using AI-generated feedback. E3 (April 2022) and E4 (December 2022) are Anthropic's own research publications describing RLHF and RL from AI feedback applied to its language models. E1, Anthropic's model card for its Claude models, says they are trained via RLHF and Constitutional AI, but it is undated. All of these are Anthropic's own official publications rather than independent sources, and they consistently show RL-based fine-tuning of its models before August 2023.
Cite this claim
Dario Amodei, “Amodei said Anthropic "kind of" already does reinforcement learning, through RLHF.” (said 8 August 2023). Verdict: resolved true. Reliability API, claim c_9def3a5c157d, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_9def3a5c157d
Claims without a verdict
- Unresolvable 157
- Not yet due 40
- Own records only 43
- Not researched 134
- Not checkable 864
Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.