Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 69 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
56 42 70 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 4 promises resolved, 5 needed for a score.
All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Dario Amodei's claims
28 claims
“Most memorably, we used this method to create “Golden Gate Claude”, a version of one of Anthropic’s models where the “Golden Gate Bridge” feature was artificially amplified”
Dario Amodei, Anthropic co-founder, writing on his own site 18 February 2025 The Urgency of Interpretability (darioamodei.com)
Anthropic created "Golden Gate Claude", a version of one of its models with the Golden Gate Bridge feature artificially amplified, making it obsessed with the bridge.
Resolved true The record shows it happened or was so.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
True: Anthropic's records show it released or demonstrated 'Golden Gate Claude', a version of a Claude model in which an interpretability feature for the Golden Gate Bridge was artificially amplified, causing the model to fixate on the bridge. Mostly true: as described, with a minor detail off (e.g. which model or exactly how it was steered). Mostly false: a related Golden Gate Bridge feature experiment existed, but not as a released model version, or not done by amplifying a feature. False: no such model or experiment existed.
Evidence
- Golden Gate Claude Anthropic · 23 May 2024 Own record
“UPDATE: Golden Gate Claude was online for a 24-hour period as a research demo and is no longer available.”
- Golden Gate Claude Anthropic · 23 May 2024 Own record
“And as we explain in our research paper, when we turn up the strength of the “Golden Gate Bridge” feature, Claude’s responses begin to focus on the Golden Gate Bridge. Its replies to most queries start to mention the Golden Gate Bridge, even if it’s not directly relevant.”
- Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet Transformer Circuits Thread (Anthropic) · 21 May 2024 Own record
“For instance, we see that clamping the Golden Gate Bridge feature 34M/31164353 to 10× its maximum activation value induces thematically-related model behavior. In this example, the model starts to self-identify as the Golden Gate Bridge!”
- Golden Gate Claude — Pantheon Pantheon (community archive) · 23 May 2024
“Claude 3 Sonnet with one interpretability feature — 34M/31164353, “Golden Gate Bridge” — clamped to roughly 10× its maximum activation, and served on claude.ai for about 24 hours on 23 May 2024 as the public demo of the Scaling Monosemanticity results.”
Reasoning
Anthropic's research page says Golden Gate Claude was online for 24 hours as a research demo (E1). It also says that turning up the strength of the "Golden Gate Bridge" feature made Claude's replies focus on the bridge, even when it wasn't relevant (E2). The Scaling Monosemanticity paper says that clamping this feature to 10× its maximum activation in Claude 3 Sonnet led the model to identify itself as the bridge (E3). An independent community archive confirms the public demo ran on claude.ai for about 24 hours on 23 May 2024 (E4). This meets the criteria for true.
Cite this claim
Dario Amodei, “Anthropic created "Golden Gate Claude", a version of one of its models with the Golden Gate Bridge feature artificially amplified, making it obsessed with the bridge.” (said 18 February 2025). Verdict: resolved true. Reliability API, claim c_800bcc96ffbf, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_800bcc96ffbf
Claims without a verdict
- Unresolvable 157
- Not yet due 40
- Own records only 43
- Not researched 134
- Not checkable 864
Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.