ClaimsNate Silver

“In general, they were uncannily close to the actual numbers, missing by an average of only 2.3 points, given results as reported so far.”

Nate Silver, author of Silver Bulletin 7 November 2024 The model exactly predicted the most likely election map (Silver Bulletin) archived copy

Factual Their own work or organisation

In simulations producing the actual map, projected state margins missed actual results by an average of 2.3 points, given results reported so far.

Unresolvable The public record could not settle it.

Factual: Statements about the present or the past, checked against the record: did they hold up?

What would count as true or false

Judged as of 2024-11-07, using results reported at that time. The claim is that, in the Silver Bulletin model's simulations that produced the actual 2024 electoral map, the projected state margins differed from the actual state margins by an average of 2.3 points. True: the Silver Bulletin's analysis or data show an average miss of about 2.3 points (2.1–2.5 counts as matching) against results as reported around November 7. Mostly true: the average was within about 0.5 points of 2.3, or the figure depends on a slightly different way of averaging. Mixed: the figure can be reproduced only under a substantially different method. Mostly false: the average miss was well off (e.g. 3.5 points or more, or under 1.5). False: the figure is badly wrong, or no such simulation analysis existed.

Set before the research began.

Evidence (8)

  1. E1 2024 polls were accurate but still underestimated Trump ABC News (538) · 8 November 2024

    “the average poll conducted over the last three weeks of the campaign missed the margin of the election by just 2.94 percentage points.”
  2. E2 2024 polls were accurate but still underestimated Trump ABC News (538) · 8 November 2024

    “In the seven main swing states (minus Arizona, which is not yet at 95 percent reporting), pollsters did even better: They missed the margin by just 2.2 points.”
  3. E3 2024 polls were accurate but still underestimated Trump ABC News (538) · 8 November 2024

    “By our math, state polls overestimated support for Harris by an average of 2.7 points on margin in competitive states.”
  4. E4 FINAL Silver Bulletin 2024 presidential election forecast Silver Bulletin · 5 November 2024 Own record

    “Out of 80,000 simulations, Kamala Harris won in 40,012 (50.015%) cases.”
  5. E5 How did the polls do in 2024? It’s complicated. Silver Bulletin (Nate Silver) · 17 February 2025 Own record

    “The 3.4-point error in the presidential general election is the second-lowest in our database, and the 4.1-point average polling error in Senate races this cycle is the lowest in our records.”
  6. E6 A random number generator determined the “favorite" in our forecast Silver Bulletin (Nate Silver) · 5 November 2024 Own record

    “We’d decided ahead of time to run 80,000 simulations instead of our usual 40K.”
  7. E7 2024 Presidential Election Results — Donald Trump Wins The American Vote

    “Pennsylvania | 19 EV | 3,543,308 50.4% | 3,423,042 48.7% | None | 120,266 1.7 pts | Trump Rep |”
  8. E8 2024 Presidential Election Results by State | Civics Matter Civics Matter · 4 November 2026

    “| Pennsylvania | Republican | 48.5% | 50.2% | 19 |”

Reasoning

None of the evidence reports the average gap between projected and actual state margins in the Silver Bulletin simulations that produced the actual 2024 map. E1 and E2 give average misses for polls (2.94 and 2.2 points), and E3 gives an average poll overestimate of Harris's support (2.7 points). None of these are figures for the model's simulations. E4 and E6 give only simulation counts. E5 is a later polling-error analysis, and E7–E8 are state result tables that do not compute the claimed average. So the 2.3-point figure can be neither confirmed nor refuted.

Cite this claim

Nate Silver, “In simulations producing the actual map, projected state margins missed actual results by an average of 2.3 points, given results reported so far.” (said 7 November 2024). Verdict: unresolvable. Reliability API, claim c_c363113f411c, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_c363113f411c

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Nate Silver, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Nate Silver

  1. Resolved true Factual 7 November 2024
    “a Trump sweep of the swing states was actually our most common scenario, occurring in 20 percent of simulations.”

    In Silver Bulletin's final model, a Trump sweep of the seven swing states was the most common scenario, occurring in 20 percent of simulations.

  2. Resolved true Factual 13 August 2024
    “Part of why I've moved the model back to the newsletter, where the probabilities are paywalled, technically”

    Nate Silver has moved his election forecast model back to his Silver Bulletin newsletter, where the probabilities are technically paywalled.

  3. Mostly true Factual 11 September 2023
    “launching FiveThirtyEight was basically my fourth career after management consulting, professional poker, and baseball analytics.”

    Nate Silver said launching FiveThirtyEight was basically his fourth career, after management consulting, professional poker, and baseball analytics.

  4. Resolved true Factual 11 September 2023
    “I’ve turned on the option for paid subscriptions.”

    Nate Silver turned on paid subscriptions for the Silver Bulletin newsletter by 11 September 2023.

  5. Mostly true Factual 8 June 2021
    “Overall we were quite happy and the forecasts were largely accurate and well-calibrated despite a bad year for the polls.”

    The 2020 election forecasts by Nate Silver's team were largely accurate and well-calibrated despite a bad year for the polls.

All of them

Verdicts are made automatically; how verdicts are made.