The current AI developers will not try the alignment approach he described (filtering training data to nice examples and training on it).
Resolved false The record shows it did not happen or was not so.
Prediction: Statements about events outside the person's control, checked once they fell due: did they come true?
What would count as true or false
'Current crop' means leading AI developers as of April 2023: OpenAI, Anthropic, Google DeepMind and Meta. 'Trying it' means filtering or curating training data toward benign or 'nice' examples, and training on that data, as a method of shaping model behaviour or values. True: none of these developers documented using or experimenting with such training-data filtering as an alignment or safety approach. Mostly true: the only cases are routine toxicity or quality filtering not presented as an alignment method. Mixed: only marginal or exploratory work by individual researchers at these labs. Mostly false: at least one leading developer published research testing the approach, without adopting it in production. False: one or more leading developers publicly documented using alignment- or safety-motivated pretraining-data filtering in their models or research.
Set before the research began.
Evidence (4)
-
E1 Enhancing Model Safety through Pretraining Data Filtering Anthropic (alignment.anthropic.com) · 19 August 2025
“Using a classifier, we identified and removed potentially harmful information from the pretraining data and then pretrained models from scratch on the filtered dataset.”
-
E2 Gemma: Open Models Based on Gemini Research and Technology Google DeepMind (arXiv technical report)
“we have endeavoured to safeguard against these risks by filtering and measuring biases in pre-training data in line with the Gemini approach”
-
E3 Gemma: Open Models Based on Gemini Research and Technology Google DeepMind (arXiv technical report)
“When using synthetic data, we run several stages of filtering over it, removing examples that show certain personal information, unsafe or toxic model outputs, mistaken self-identification data, or duplicated examples.”
-
E4 Enhancing Model Safety through Pretraining Data Filtering Anthropic (alignment.anthropic.com) · 19 August 2025
“In addition to misuse risks, which are the focus of this blog post, data filtering has the potential to mitigate misalignment risks as well.”
Reasoning
Anthropic documented a safety-motivated pretraining-data filtering experiment: it used a classifier to remove harmful information and then pretrained models from scratch on the filtered data (E1). It also said this filtering could help with misalignment risks (E4). Google DeepMind's Gemma report describes filtering pretraining data to address risks and removing unsafe or toxic examples from synthetic training data (E2, E3). Under the criteria, a leading developer publicly documenting safety-motivated pretraining-data filtering in its models or research counts as false. Anthropic's work aimed at removing harmful information rather than shaping values, but the criteria count safety-motivated filtering, so the verdict is false.
Cite this claim
Eliezer Yudkowsky, “The current AI developers will not try the alignment approach he described (filtering training data to nice examples and training on it).” (said 6 April 2023). Verdict: resolved false. Reliability API, claim c_37fbc688f3ea, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_37fbc688f3ea
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More prediction claims by Eliezer Yudkowsky
-
Resolved true
“Alignment will not be solved in a few years.”
-
Resolved true
“even if GPT-5 doesn’t end the world, which I agree is like more than 50% of where my probability mass lies”
GPT-5 will not end the world, with more than 50% of Yudkowsky's probability on that outcome.
-
Mostly true
“Most AI researchers will not want to make unFriendly AIs.”
-
Mixed
“Beating GPT-4 on GI just forces OpenAI to release 4.5.”
-
Mostly false
“So probably Paul’s going to win, but slight moral victory.”
Verdicts are made automatically; how verdicts are made.