ClaimsEliezer Yudkowsky

“So probably Paul’s going to win, but slight moral victory.”

Eliezer Yudkowsky, interviewee 6 April 2023 Eliezer Yudkowsky - Why AI Will Kill Us, Aligning LLMs, Nature of Intelligence, SciFi, & Rationality (Dwarkesh Podcast) archived copy

Prediction AI timelines and forecasting

Paul Christiano will probably win his forecast disagreement with Yudkowsky on an AI getting IMO gold by 2025, with prediction-market odds then running around 30%.

Mostly false False in substance, right in a detail.

Prediction: Statements about events outside the person's control, checked once they fell due: did they come true?

The second judge would not resolve this claim; the verdict shown is the first judge's.

What would count as true or false

Paul Christiano 'wins' the bet if no AI system achieves an International Mathematical Olympiad gold-medal standard by the end of 2025, under the terms of their 2021 bet. True: no AI achieved IMO gold-level performance through IMO 2025 under the bet's conditions. Mostly true: the only claimed gold-level results fall clearly outside the bet's terms (for example, extra time or human-formalized problems) and are not accepted as satisfying it. Mixed: a gold-level claim exists but whether it satisfies the bet is genuinely disputed. Mostly false: an AI met the gold standard with only minor deviations from the bet's conditions. False: an AI achieved IMO gold-medal-level performance by 2025 in a way that satisfies the bet, as acknowledged by the participants or by credible verification.

Set before the research began.

Evidence (4)

  1. E1 Google and OpenAI Get 2025 IMO Gold — LessWrong LessWrong (post by Zvi Mowshowitz, 'Don't Worry About the Vase') · 22 July 2025 Own record

    “So I think we have Paul at <8%, Eliezer at >16% for AI made before the IMO is able to get a gold (under time controls *etc.* of grand challenge) in one of 2022-2025.”
  2. E2 Google and OpenAI Get 2025 IMO Gold — LessWrong LessWrong (post by Zvi Mowshowitz, 'Don't Worry About the Vase') · 22 July 2025 Own record

    “The results were not super clear cut if you look at the details, as Christiano was in large part doubting that the hardest problem would be solved and indeed the hardest problem was #6 and was not solved, but a gold medal was still achieved.”
  3. E3 Advanced version of Gemini with Deep Think officially achieves gold-medal standard at the International Mathematical Olympiad Google DeepMind · 21 July 2025

    “The IMO have confirmed that our submitted answers are complete and correct solutions. It is important to note that their review does not extend to validating our system, processes, or underlying model”
  4. E4 AI at IMO 2025: a round-up Xena Project (Kevin Buzzard, Imperial College London mathematician) · 3 August 2025

    “It is very exciting to see progress in the mathematical capabilities of AI models, but we would like to be clear that the IMO cannot validate the methods, including the amount of compute used or whether there was any human involvement, or whether the results can be reproduced.”

Reasoning

Google DeepMind reported gold-medal-standard performance at IMO 2025, and the IMO confirmed its submitted solutions were complete and correct, though its review did not extend to validating the system, processes or model (E3); a LessWrong post says a gold medal was achieved (E2). This is against Christiano's side of the bet, which concerned gold under grand-challenge time controls and conditions (E1). The IMO said it could not validate the methods, compute or human involvement (E3, E4), and E2 calls the outcome not fully clear-cut because problem 6 went unsolved. The evidence does not show whether the bet's conditions were fully met or whether either participant acknowledged a result, so gold was reached with some uncertainty about the bet's terms.

Cite this claim

Eliezer Yudkowsky, “Paul Christiano will probably win his forecast disagreement with Yudkowsky on an AI getting IMO gold by 2025, with prediction-market odds then running around 30%.” (said 6 April 2023). Verdict: mostly false. Reliability API, claim c_2b396ed98e67, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_2b396ed98e67

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Eliezer Yudkowsky, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More prediction claims by Eliezer Yudkowsky

  1. Mixed Prediction 5 March 2024
    “Beating GPT-4 on GI just forces OpenAI to release 4.5.”

    If a rival AI developer beats GPT-4 on general intelligence, OpenAI will be forced to release GPT-4.5.

  2. Resolved false Prediction 6 April 2023
    “The current crop of people will not try it.”

    The current AI developers will not try the alignment approach he described (filtering training data to nice examples and training on it).

  3. Resolved true Prediction 6 April 2023
    “Alignment will not be solved in a few years.”

    AI alignment will not be solved within a few years.

  4. Resolved true Prediction 6 April 2023
    “even if GPT-5 doesn’t end the world, which I agree is like more than 50% of where my probability mass lies”

    GPT-5 will not end the world, with more than 50% of Yudkowsky's probability on that outcome.

  5. Mostly true Prediction February 2023
    “But I do feel quite confident that the upper range of that untapped potential is insufficient to outsmart all the living humans and implement the scenario that I'm worried about.”

    Yudkowsky said he felt quite confident that the upper range of the untapped potential of ChatGPT-style systems is insufficient to outsmart all living humans and carry out the catastrophe scenario he worries about.

All of them

Verdicts are made automatically; how verdicts are made.