Daniela Amodei said she thinks part of what Anthropic's AI safety research is seeing is that different sized models exhibit different safety issues.
Mostly true True in substance, wrong in a detail.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge said resolved true; the verdict shown is the first judge's.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
The claim is that Daniela Amodei said this. True if a recording or transcript of the 2022 interview shows her saying, in substance, that part of what Anthropic's safety research is finding is that models of different sizes show different safety issues. Mostly true if the wording differs but the meaning is the same. Mixed if she said something related but notably different, such as only about capabilities. Mostly false if the statement was made by someone else or its meaning was substantially changed. False if no such statement appears in the source, or if the source shows she said the opposite.
Set before the research began.
Evidence (3)
-
E1 Daniela and Dario Amodei on Anthropic - Future of Life Institute Future of Life Institute · 16 November 2022
“Daniela Amodei is Co-Founder and President of Anthropic. She was previously at Stripe and OpenAI, and has also served as a congressional staffer.”
-
E2 Daniela and Dario Amodei on Anthropic · Zencastr Video Zencastr (hosts a transcript of the Future of Life Institute podcast) · 1 May 2024
“I think part of what we're seeing and the sort of potential shorter term impacts of some of the AI safety research that we do is that different sized models exhibit different safety issues, right?”
-
E3 Daniela and Dario Amodei on Anthropic · Zencastr Video Zencastr (hosts a transcript of the Future of Life Institute podcast) · 1 May 2024
“Yeah, I think one point Daniella made that's really important is this sudden emergence or change.”
Reasoning
A transcript of the Future of Life Institute podcast with Daniela and Dario Amodei contains the quoted line almost word for word: "different sized models exhibit different safety issues" [E4]. The quoted transcript excerpt in E4 does not itself name the speaker. However, the next speaker says "one point Daniella made that's really important" [E5], which supports attributing the line to Daniela Amodei. The FLI episode page dates the interview to 2022 and identifies her as Anthropic's co-founder and president [E3]. The wording differs slightly from the quote ("the sort of potential shorter term impacts") but the meaning is the same, so under the criteria this resolves as mostly true; attribution to Daniela Amodei rests on the episode featuring her [E3] and another speaker in the same transcript referring to a point 'Daniella' made [E5].
Cite this claim
Daniela Amodei, “Daniela Amodei said she thinks part of what Anthropic's AI safety research is seeing is that different sized models exhibit different safety issues.” (said 2022). Verdict: mostly true. Reliability API, claim c_06a3e6342890, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_06a3e6342890
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Daniela Amodei
-
Mostly true
“Because we have the information about how the technology can be abused, because we see it every day.”
-
Mostly true
“but we’re just not confident enough yet.”
-
Mostly true
“We have detailed, real-time knowledge of how technology can be misused because we see it in action every day”
-
Mostly true
“We developed a powerful new class of model that customers would love to use right away, but we felt we needed more time to ensure it was safe before wide release.”
-
Mostly true
“that’s why we chose not to release our latest model widely due to concerns about cyber misuse.”
Anthropic chose not to release its latest model widely because of concerns about cyber misuse.
Verdicts are made automatically; how verdicts are made.