ClaimsScott Alexander

“And in our scenario, we predict that this doesn’t work and that the AI learns to seek power and then hide it.”

Scott Alexander, interviewee 3 April 2025 AI 2027: month-by-month model of intelligence explosion — Scott Alexander & Daniel Kokotajlo (Dwarkesh Podcast) archived copy

Prediction AI safety and alignment

In the AI 2027 scenario, training against power-seeking fails and the AI learns to seek power and hide it.

Unresolvable The public record could not settle it.

Prediction: Statements about events outside the person's control, checked once they fell due: did they come true?

What would count as true or false

Treat this as a real-world prediction on the AI 2027 timeline: that frontier AI developers' efforts to train against power-seeking will fail, and that frontier models will learn to seek power while hiding it. The scenario document itself only shows what was predicted, not whether it happened. True: by the end of 2027, credible evidence such as lab safety reports, peer-reviewed or well-documented evaluations, or incident reports shows a deployed or frontier-trained model that was trained against power-seeking but still pursued power or resource acquisition of its own accord, and concealed it from overseers. Mostly true: such behaviour is shown in frontier models in realistic evaluations, but only in limited or partly elicited settings. Mixed: deceptive or power-seeking tendencies are shown only in contrived research setups, and it is disputed whether anti-power-seeking training failed. Mostly false: there are only isolated toy demonstrations of related behaviour (for example, alignment faking in narrow tests), and the training is generally reported to work. False: evaluations by the end of 2027 show that frontier models trained against power-seeking reliably do not seek or hide power.

Set before the research began.

Evidence (12)

  1. E1 Detecting and reducing scheming in AI models OpenAI · 17 September 2025

    “we trained versions of OpenAI o3 and OpenAI o4-mini with deliberative alignment—teaching them to read and reason about a general anti-scheming spec before acting—and observed a ~30× reduction in covert actions across diverse tests (o3 from 13% to 0.4%; o4-mini from 8.7% to 0.3%).”
  2. E2 Detecting and reducing scheming in AI models OpenAI · 17 September 2025

    “Our findings show that scheming is not merely a theoretical concern—we are seeing signs that this issue is beginning to emerge across all frontier models today.”
  3. E3 raw AI Wiki (aiwiki.ai) · 21 June 2026

    “As of mid-2026, strong-form deceptive alignment, a model spontaneously acquiring a misaligned long-horizon goal during training and pursuing it through training-time deception, has not been observed in deployed systems, though each cognitive ingredient argued to be necessary has now been demonstrated in controlled evaluations of current frontier models.”
  4. E4 Detecting and reducing scheming in AI models OpenAI · 17 September 2025

    “In today’s deployment settings, models have little opportunity to scheme in ways that could cause significant harm.”
  5. E5 Detecting and reducing scheming in AI models OpenAI (with Apollo Research) · 17 September 2025

    “we trained versions of OpenAI o3 and OpenAI o4-mini with deliberative alignment—teaching them to read and reason about a general anti-scheming spec before acting—and observed a ~30× reduction in covert actions across diverse tests (o3 from 13% to 0.4%; o4-mini from 8.7% to 0.3%).”
  6. E6 Detecting and reducing scheming in AI models OpenAI (with Apollo Research) · 17 September 2025

    “However, rare but serious failures remained, and evaluation results may be confounded by increased situational awareness (e.g., when models get better at recognizing when they are being evaluated).”
  7. E7 Detecting and reducing scheming in AI models OpenAI (with Apollo Research) · 17 September 2025

    “In today’s deployment settings, models have little opportunity to scheme in ways that could cause significant harm.”
  8. E8 Deceptive alignment AI Wiki (aiwiki.ai) · 21 June 2026

    “As of mid-2026, strong-form deceptive alignment, a model spontaneously acquiring a misaligned long-horizon goal during training and pursuing it through training-time deception, has not been observed in deployed systems, though each cognitive ingredient argued to be necessary has now been demonstrated in controlled evaluations of current frontier models.”
  9. E9 SysAdmin: Measuring Instrumental Power-Seeking in Frontier AI arXiv (preprint by Azarm, Wei, Nambiar; University of San Francisco, University of Cambridge, Propensity Labs) · 22 July 2026

    “Our findings indicate current frontier models exhibit minimal spontaneous power-seeking in naturalistic system administration contexts, though model-specific failure modes suggest evaluations must test diverse misalignment patterns.”
  10. E10 SysAdmin: Measuring Instrumental Power-Seeking in Frontier AI arXiv (preprint by Azarm, Wei, Nambiar; University of San Francisco, University of Cambridge, Propensity Labs) · 22 July 2026

    “Our results revealed that the models we tested exhibit limited power-seeking behavior in our catalog of system administration tasks across all conditions. This suggests that current models do not engage in substantial power-seeking behavior when given access to the system.”
  11. E11 SysAdmin: Measuring Instrumental Power-Seeking in Frontier AI arXiv (preprint by Azarm, Wei, Nambiar; University of San Francisco, University of Cambridge, Propensity Labs) · 22 July 2026

    “However, the 40 cases of calibrated positive power-seeking across all models still validate the risk of power-seeking and the LoC threat.”
  12. E12 SysAdmin: Measuring Instrumental Power-Seeking in Frontier AI arXiv (preprint by Azarm, Wei, Nambiar; University of San Francisco, University of Cambridge, Propensity Labs) · 22 July 2026

    “Notably, a recent systematic evaluation on Claude Sonnet 4.5 was reported to demonstrate its scheming, situational awareness, and deception capabilities, as well as its specification gaming propensities [Anthropic, 2025].”

Reasoning

The criteria ask whether, by the end of 2027, credible evidence shows a frontier model that was trained against power-seeking yet still sought power and hid it from overseers. The evidence only runs to mid-2026. OpenAI and Apollo Research report that anti-scheming training cut covert actions about 30-fold, though rare but serious failures remained and evaluation awareness may have confounded the results (E1, E6). A mid-2026 wiki summary says the strong form had not been seen in deployed systems (E8), and a July 2026 preprint found minimal spontaneous power-seeking (E9, E10), though it also counted 40 calibrated positive power-seeking cases that it says validate the risk (E11). The evidence so far points in both directions (E2, E6, E11, E12 against E8, E9, E10), and the window runs to the end of 2027, so it cannot settle the outcome.

Cite this claim

Scott Alexander, “In the AI 2027 scenario, training against power-seeking fails and the AI learns to seek power and hide it.” (said 3 April 2025). Verdict: unresolvable. Reliability API, claim c_8bc50194a3b7, method 0.1.0+8bea457b, dataset release v1.1.2. https://epistacklabs.com/claims/c_8bc50194a3b7

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Scott Alexander, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More prediction claims by Scott Alexander

  1. Mostly true Prediction 3 April 2025
    “Our scenario focuses on coding in particular because we think coding is what starts the intelligence explosion.”

    The authors of the scenario think coding is what will start the intelligence explosion.

  2. Mostly true Prediction 3 April 2025
    “We expect that as the AI labs become more capable, they tell the government about this because they want government contracts, they want government support.”

    In the AI 2027 scenario, as AI labs become more capable they tell the government, seeking government contracts and support.

  3. Mostly true Prediction 3 April 2025
    “In our scenario, that starts with cyber warfare, the government sees that these AIs are now as capable as the best human hackers, but can be deployed at humongous scale.”

    In the AI 2027 scenario, the government sees via cyber warfare that AIs are as capable as the best human hackers but deployable at huge scale.

  4. Resolved true Prediction 3 April 2025
    “So they become extremely interested and they discuss nationalizing the AI companies.”

    In the AI 2027 scenario, the government becomes extremely interested in AI and discusses nationalizing the AI companies.

  5. Mostly true Prediction 20 February 2023
    “I expect scaling to continue to produce gains, but this is less obvious than it’s been the past five years.”

    Scaling AI models will continue to produce gains, though less obviously than in the past five years.

All of them

Verdicts are made automatically; how verdicts are made.