Anthropic released a writeup on Garcon, the infrastructure tool its team used for interpretability research.
Resolved true The record shows it happened or was so.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The evidence is the person's or their organisation's own records.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judged as of 2022. True: Anthropic published, on or before the date the statement was made, a writeup describing Garcon as the infrastructure its team used for interpretability research (for example, on transformer-circuits.pub). Mostly true: the writeup exists, but a minor detail differs, for example it was published as part of another article rather than on its own, or it was released by members of the team rather than by Anthropic as such. Mostly false: Garcon is only mentioned in passing in other work, without a writeup, or the writeup appeared only after the statement. False: Anthropic has no published material on a tool called Garcon.
Set before the research began.
Evidence (3)
-
E1 Garcon Transformer Circuits Thread (transformer-circuits.pub); the page does not name a publisher separately · 22 December 2021 Own record
“This document describes one of the core pieces of infrastructure we've built to enable interpretability research at Anthropic: a tool we call Garçon.”
-
E2 Garcon Transformer Circuits Thread (transformer-circuits.pub); the page does not name a publisher separately · 22 December 2021 Own record
“We've found Garçon very helpful for our research. We now use it for essentially all of our interpretability work, and other teams have also adopted it for ad-hoc exploration of models.”
-
E3 A Mathematical Framework for Transformer Circuits Transformer Circuits Thread (transformer-circuits.pub); the page does not name a publisher separately · 22 December 2021 Own record
“The crucial piece of software infrastructure which made our analysis of models possible is a library called Garcon (described in another article) created by Nelson Elhage with help from Tom Brown, Sam McCandlish, and Chris Olah.”
Reasoning
E1 is a standalone Garçon writeup on transformer-circuits.pub, dated 2021-12-22, which is before the 2022 statement. It describes Garçon as "one of the core pieces of infrastructure we've built to enable interpretability research at Anthropic." E2, from the same page, says the team uses it for essentially all of its interpretability work. E3 is a companion paper that names Garcon as the key infrastructure and points to the separate article. The evidence is the published writeup itself, which matches the criteria for true.
Cite this claim
Daniela Amodei, “Anthropic released a writeup on Garcon, the infrastructure tool its team used for interpretability research.” (said 2022). Verdict: resolved true. Reliability API, claim c_d4198b2fec5b, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_d4198b2fec5b
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Daniela Amodei
-
Resolved true
“There’s medical research showing that people who have a good relationship with their doctor tend to have better clinical outcomes.”
-
Mixed
“we've seen other researchers and engineers playing around with the tools and watching the videos.”
-
Mostly false
“This was an immovable baseline established from day one.”
-
Mostly true
“In the lab, Claude designed new protein binders from scratch.”
In laboratory work, Anthropic's Claude designed new protein binders from scratch.
-
Mostly true
“including open-source code much of the internet runs on, before attackers could exploit them.”
Verdicts are made automatically; how verdicts are made.