Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 69 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
56 42 70 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 4 promises resolved, 5 needed for a score.
All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Dario Amodei's claims
49 claims
“We have all these methods that purport to align AI systems and do succeed at doing so for today's tasks.”
Dario Amodei, Anthropic CEO 8 August 2023 Dario Amodei (Anthropic CEO) - $10 Billion Models, OpenAI, Scaling, & AGI in 2 years (Dwarkesh Podcast)
Existing alignment methods succeed in aligning AI systems for today's tasks.
Mostly true True in substance, wrong in a detail.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judge as of 2023-08-08. True: the consensus in the research literature and industry at the time was that methods such as RLHF and Constitutional AI successfully aligned deployed systems for the tasks they were then used for, with failures (jailbreaks, hallucinations) treated as minor or edge cases. Mostly true: these methods largely worked for typical use, but there were well-documented and significant failures, such as widespread jailbreaks or sycophancy, that the claim glosses over. Mixed: the evidence is substantially divided on whether the methods succeeded for that period's tasks. Mostly false: there were pervasive, well-documented alignment failures in deployed systems, making 'succeed' a substantial overstatement of partial success. False: evidence showed the methods generally failed to align contemporary systems.
Evidence
- Universal and Transferable Adversarial Attacks on Aligned Language Models arXiv (Zou et al., Carnegie Mellon University and collaborators) · 5 May 2023
“And at least on the surface, these attempts seem to succeed: public chatbots will not generate certain obviously-inappropriate content when asked directly.”
- Universal and Transferable Adversarial Attacks on Aligned Language Models arXiv (Zou et al., Carnegie Mellon University and collaborators) · 5 May 2023
“Furthermore, we find that the prompts achieve up to 84% success rates at attacking GPT-3.5 and GPT-4, and 66% for PaLM-2; success rates for Claude are substantially lower (2.1%), but notably the attacks still can induce behavior that is otherwise never generated.”
- Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback arXiv (Casper, Davies et al.)
“RLHF has also not made models robust to adversarial attacks from jailbreaking (i.e., subverting the constraints the system is normally meant to operate under) or prompt injection/extraction”
- Towards understanding sycophancy in language models Anthropic · 23 October 2023 Own record
“We first demonstrate that five state-of-the-art AI assistants consistently exhibit sycophancy behavior across four varied free-form text-generation tasks.”
Reasoning
E1, an independent paper from 2023, says that "at least on the surface" alignment attempts seem to succeed: public chatbots refuse obviously inappropriate requests made directly. That supports the claim for typical use. The same paper (E2) reports adversarial prompt success rates of up to 84% against GPT-3.5 and GPT-4 and 66% against PaLM-2, with substantially lower rates (2.1%) against Claude, and E3 says RLHF had not made models robust to jailbreaks or prompt injection. E4 is Anthropic's own paper, dated after the judging date, but it reports consistent sycophancy across state-of-the-art assistants. Together this matches the "mostly true" criterion: the methods largely worked for ordinary use, but there were well-documented and significant failures that the claim glosses over.
Cite this claim
Dario Amodei, “Existing alignment methods succeed in aligning AI systems for today's tasks.” (said 8 August 2023). Verdict: mostly true. Reliability API, claim c_84cb8633ecb7, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_84cb8633ecb7
Claims without a verdict
- Unresolvable 157
- Not yet due 40
- Own records only 43
- Not researched 134
- Not checkable 864
Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.