In simulations producing the actual map, projected state margins missed actual results by an average of 2.3 points, given results reported so far.
Unresolvable The public record could not settle it.
Factual: Statements about the present or the past, checked against the record: did they hold up?
What would count as true or false
Judged as of 2024-11-07, using results reported at that time. The claim is that, in the Silver Bulletin model's simulations that produced the actual 2024 electoral map, the projected state margins differed from the actual state margins by an average of 2.3 points. True: the Silver Bulletin's analysis or data show an average miss of about 2.3 points (2.1–2.5 counts as matching) against results as reported around November 7. Mostly true: the average was within about 0.5 points of 2.3, or the figure depends on a slightly different way of averaging. Mixed: the figure can be reproduced only under a substantially different method. Mostly false: the average miss was well off (e.g. 3.5 points or more, or under 1.5). False: the figure is badly wrong, or no such simulation analysis existed.
Set before the research began.
Evidence (8)
-
E1 2024 polls were accurate but still underestimated Trump ABC News (538) · 8 November 2024
“the average poll conducted over the last three weeks of the campaign missed the margin of the election by just 2.94 percentage points.”
-
E2 2024 polls were accurate but still underestimated Trump ABC News (538) · 8 November 2024
“In the seven main swing states (minus Arizona, which is not yet at 95 percent reporting), pollsters did even better: They missed the margin by just 2.2 points.”
-
E3 2024 polls were accurate but still underestimated Trump ABC News (538) · 8 November 2024
“By our math, state polls overestimated support for Harris by an average of 2.7 points on margin in competitive states.”
-
E4 FINAL Silver Bulletin 2024 presidential election forecast Silver Bulletin · 5 November 2024 Own record
“Out of 80,000 simulations, Kamala Harris won in 40,012 (50.015%) cases.”
-
E5 How did the polls do in 2024? It’s complicated. Silver Bulletin (Nate Silver) · 17 February 2025 Own record
“The 3.4-point error in the presidential general election is the second-lowest in our database, and the 4.1-point average polling error in Senate races this cycle is the lowest in our records.”
-
E6 A random number generator determined the “favorite" in our forecast Silver Bulletin (Nate Silver) · 5 November 2024 Own record
“We’d decided ahead of time to run 80,000 simulations instead of our usual 40K.”
-
E7 2024 Presidential Election Results — Donald Trump Wins The American Vote
“Pennsylvania | 19 EV | 3,543,308 50.4% | 3,423,042 48.7% | None | 120,266 1.7 pts | Trump Rep |”
-
E8 2024 Presidential Election Results by State | Civics Matter Civics Matter · 4 November 2026
“| Pennsylvania | Republican | 48.5% | 50.2% | 19 |”
Reasoning
None of the evidence reports the average gap between projected and actual state margins in the Silver Bulletin simulations that produced the actual 2024 map. E1 and E2 give average misses for polls (2.94 and 2.2 points), and E3 gives an average poll overestimate of Harris's support (2.7 points). None of these are figures for the model's simulations. E4 and E6 give only simulation counts. E5 is a later polling-error analysis, and E7–E8 are state result tables that do not compute the claimed average. So the 2.3-point figure can be neither confirmed nor refuted.
Cite this claim
Nate Silver, “In simulations producing the actual map, projected state margins missed actual results by an average of 2.3 points, given results reported so far.” (said 7 November 2024). Verdict: unresolvable. Reliability API, claim c_c363113f411c, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_c363113f411c
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Nate Silver
-
Resolved true
“a Trump sweep of the swing states was actually our most common scenario, occurring in 20 percent of simulations.”
-
Resolved true
“Part of why I've moved the model back to the newsletter, where the probabilities are paywalled, technically”
-
Mostly true
“launching FiveThirtyEight was basically my fourth career after management consulting, professional poker, and baseball analytics.”
-
Resolved true
“I’ve turned on the option for paid subscriptions.”
Nate Silver turned on paid subscriptions for the Silver Bulletin newsletter by 11 September 2023.
-
Mostly true
“Overall we were quite happy and the forecasts were largely accurate and well-calibrated despite a bad year for the polls.”
Verdicts are made automatically; how verdicts are made.