ClaimsNate Silver

“The single most important reason that our model gave Trump a better chance than others is because of our assumption that polling errors are correlated.”

Nate Silver, editor in chief, writing in FiveThirtyEight article November 2016 Why FiveThirtyEight Gave Trump A Better Chance Than Almost Anyone Else (FiveThirtyEight) archived copy

Factual AI timelines and forecasting

The main reason FiveThirtyEight's 2016 model gave Trump a better chance than other models was its assumption that polling errors are correlated.

Mostly true True in substance, wrong in a detail.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The second judge would not resolve this claim; the verdict shown is the first judge's.

Said for an organisation they lead or work for; it counts on both records.

What would count as true or false

This is a claim about the design of FiveThirtyEight's own 2016 model and why its Trump probability differed from other forecasters' (e.g., NYT Upshot, PEC, HuffPost, PredictWise). True: published model documentation and/or independent comparative analyses show that FiveThirtyEight assumed correlated state polling errors more strongly than the other models, and that this is the largest single source of the gap in Trump's probability. Mostly true: correlated error is shown to be a major driver, perhaps tied with or barely ahead of other factors (higher overall uncertainty, undecided/third-party handling, trend adjustment), so 'single most important' is only slightly overstated. Mixed: analyses find correlated errors were one of several roughly equal drivers, with no clear primacy. Mostly false: other models also assumed substantial correlation, or other factors (e.g., larger national uncertainty, treatment of undecideds) clearly account for most of the gap, with correlation playing only a minor role. False: the evidence shows FiveThirtyEight did not assume more correlated errors than the others, or that correlation played no meaningful part in the difference.

Set before the research began.

Evidence (4)

  1. E1 Unskewing the Election rjlipton.com (Richard J. Lipton blog) · 8 November 2016

    “The main difference cited by Silver is the higher number of voters telling pollsters they are undecided or supporting third-party candidates compared to 2012.”
  2. E2 After 2016, Can We Ever Trust the Polls Again? The New Republic · 14 December 2016

    “FiveThirtyEight’s Nate Silver, who successfully predicted the 2008 and 2012 presidential races, was among the few pollsters to at least account for correlated error, giving Trump a 28 percent chance of winning.”
  3. E3 The Polls and the US Presidential Election in 2020 ….and 2024 MIT Sloan (working paper by A. Barnett) · 30 December 2025

    “praising its awareness that outcomes in Pennsylvania, Michigan, and Wisconsin—the three key states Clinton was expected to carry but which went to Trump—were positively correlated.”
  4. E4 Chapter 20: When Models Fail: 2016, 2020, and Beyond datafield.dev (online textbook chapter) · 1 January 2026

    “The difference between 5% and 29% was almost entirely explained by different assumptions about correlated versus independent state errors.”

Reasoning

E2 reports that FiveThirtyEight was among the few forecasters to account for correlated error and gave Trump a 28 percent chance; E3 praises an awareness that outcomes in Pennsylvania, Michigan and Wisconsin were positively correlated. E4 says the difference between a 5% and a 29% forecast was almost entirely explained by different assumptions about correlated versus independent state errors. E1 reports that Silver cited a higher share of undecided and third-party voters compared with 2012 as the main difference, which suggests other factors may also have shaped the model's output. Correlated error appears to be a major driver, but no rigorous comparison in the evidence shows that it was the largest single source of the gap.

Cite this claim

Nate Silver, “The main reason FiveThirtyEight's 2016 model gave Trump a better chance than other models was its assumption that polling errors are correlated.” (said November 2016). Verdict: mostly true. Reliability API, claim c_454ed970fc5e, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_454ed970fc5e

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Nate Silver, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Nate Silver

  1. Resolved true Factual 8 September 2023
    “It’s not hard, for instance, to find polls from this point in 2015 showing Hillary Clinton with double-digit leads over Trump.”

    Polls from around September 2015 can be found showing Hillary Clinton with double-digit leads over Donald Trump.

  2. Mostly true Factual 21 May 2022
    “There was never any spike in Biden's approval rating.”

    Joe Biden's approval rating never had a spike.

  3. Resolved true Factual 9 June 2021
    “This is the pollster that had shown a big bounce for Garcia before, so either that previous poll was an outlier or her momentum has been usurped by Wiley.”

    A pollster that earlier showed a big bounce for Garcia has now shown a result implying either that the earlier poll was an outlier or that Wiley has taken over her momentum.

  4. Mixed Factual November 2016
    “Instead, there was a modest polling error, well in line with historical polling errors, but even a modest error was enough to provide for plenty of paths to victory for Trump.”

    The 2016 polling error was modest and in line with historical polling errors, yet large enough to give Trump many paths to victory.

  5. Mostly true Factual November 2016
    “Clinton collapsed in the Midwest, destroying her Electoral College chances”

    Clinton significantly underperformed her polls across the Midwest and Rust Belt in the 2016 election, costing her the Electoral College.

All of them

Verdicts are made automatically; how verdicts are made.