Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 70 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
60 42 78
All types combined: 74 (likely 68 to 80, high confidence), from 79 claims: 71 factual claims, 8 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Eliezer Yudkowsky's claims
21 claims
“OpenAI’s openly declared intention is to make some future AI do our AI alignment homework.”
Eliezer Yudkowsky, MIRI researcher, op-ed author 7 April 2023 Pausing AI Developments Isn't Enough. We Need to Shut it All Down (MIRI (TIME op-ed))
OpenAI has openly declared an intention to have some future AI do our AI alignment work.
Resolved true The record shows it happened or was so.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
True: an official OpenAI publication from on or before 2023-04-07 openly states an intention to use AI systems to do or substantially help with alignment research. An example would be the August 2022 post 'Our approach to alignment research', which describes training AI systems to do alignment research. Mostly true: OpenAI stated an intention to use AI to assist alignment research substantially, but framed it as partial help or acceleration rather than having AI do the work. The 'homework' characterisation is a fair paraphrase of this. Mixed: OpenAI mentioned AI-assisted alignment only as one minor or speculative option. Mostly false: only individual employees or informal remarks suggested it, with no official declaration. False: OpenAI made no such statement by that date, or explicitly rejected the approach.
Evidence
- Our approach to alignment research OpenAI · 24 August 2022
“As we make progress on this, our AI systems can take over more and more of our alignment work and ultimately conceive, implement, study, and develop better alignment techniques than we have now.”
- Our approach to alignment research OpenAI · 24 August 2022
“Our goal is to train models to be so aligned that we can off-load almost all of the cognitive labor required for alignment research.”
- Our approach to alignment research OpenAI · 24 August 2022
“Therefore human researchers will focus more and more of their effort on reviewing alignment research done by AI systems instead of generating this research by themselves.”
Reasoning
OpenAI published the official post 'Our approach to alignment research' on 2022-08-24, before the claim date. In it, OpenAI says its AI systems "can take over more and more of our alignment work" (E1). It names as its goal to "off-load almost all of the cognitive labor required for alignment research" onto models (E2), and says human researchers will move toward reviewing alignment research done by AI systems (E3). This meets the True criterion, an openly stated intention to have AI do alignment research.
Cite this claim
Eliezer Yudkowsky, “OpenAI has openly declared an intention to have some future AI do our AI alignment work.” (said 7 April 2023). Verdict: resolved true. Reliability API, claim c_65beec95cb24, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_65beec95cb24
Claims without a verdict
Is a verdict here wrong, or do you speak for Eliezer Yudkowsky? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.