The main reason FiveThirtyEight's 2016 model gave Trump a better chance than other models was its assumption that polling errors are correlated.
Mostly true True in substance, wrong in a detail.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
This is a claim about the design of FiveThirtyEight's own 2016 model and why its Trump probability differed from other forecasters' (e.g., NYT Upshot, PEC, HuffPost, PredictWise). True: published model documentation and/or independent comparative analyses show that FiveThirtyEight assumed correlated state polling errors more strongly than the other models, and that this is the largest single source of the gap in Trump's probability. Mostly true: correlated error is shown to be a major driver, perhaps tied with or barely ahead of other factors (higher overall uncertainty, undecided/third-party handling, trend adjustment), so 'single most important' is only slightly overstated. Mixed: analyses find correlated errors were one of several roughly equal drivers, with no clear primacy. Mostly false: other models also assumed substantial correlation, or other factors (e.g., larger national uncertainty, treatment of undecideds) clearly account for most of the gap, with correlation playing only a minor role. False: the evidence shows FiveThirtyEight did not assume more correlated errors than the others, or that correlation played no meaningful part in the difference.
Set before the research began.
Evidence (4)
-
E1 Unskewing the Election rjlipton.com (Richard J. Lipton blog) · 8 November 2016
“The main difference cited by Silver is the higher number of voters telling pollsters they are undecided or supporting third-party candidates compared to 2012.”
-
E2 After 2016, Can We Ever Trust the Polls Again? The New Republic · 14 December 2016
“FiveThirtyEight’s Nate Silver, who successfully predicted the 2008 and 2012 presidential races, was among the few pollsters to at least account for correlated error, giving Trump a 28 percent chance of winning.”
-
E3 The Polls and the US Presidential Election in 2020 ….and 2024 MIT Sloan (working paper by A. Barnett) · 30 December 2025
“praising its awareness that outcomes in Pennsylvania, Michigan, and Wisconsin—the three key states Clinton was expected to carry but which went to Trump—were positively correlated.”
-
E4 Chapter 20: When Models Fail: 2016, 2020, and Beyond datafield.dev (online textbook chapter) · 1 January 2026
“The difference between 5% and 29% was almost entirely explained by different assumptions about correlated versus independent state errors.”
Reasoning
E2 reports that FiveThirtyEight was among the few forecasters to account for correlated error and gave Trump a 28 percent chance; E3 praises an awareness that outcomes in Pennsylvania, Michigan and Wisconsin were positively correlated. E4 says the difference between a 5% and a 29% forecast was almost entirely explained by different assumptions about correlated versus independent state errors. E1 reports that Silver cited a higher share of undecided and third-party voters compared with 2012 as the main difference, which suggests other factors may also have shaped the model's output. Correlated error appears to be a major driver, but no rigorous comparison in the evidence shows that it was the largest single source of the gap.
Cite this claim
Nate Silver, “The main reason FiveThirtyEight's 2016 model gave Trump a better chance than other models was its assumption that polling errors are correlated.” (said November 2016). Verdict: mostly true. Reliability API, claim c_454ed970fc5e, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_454ed970fc5e
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Nate Silver
-
Resolved true
“It’s not hard, for instance, to find polls from this point in 2015 showing Hillary Clinton with double-digit leads over Trump.”
-
Mostly true
“There was never any spike in Biden's approval rating.”
-
Resolved true
“This is the pollster that had shown a big bounce for Garcia before, so either that previous poll was an outlier or her momentum has been usurped by Wiley.”
-
Mixed
“Instead, there was a modest polling error, well in line with historical polling errors, but even a modest error was enough to provide for plenty of paths to victory for Trump.”
-
Mostly true
“Clinton collapsed in the Midwest, destroying her Electoral College chances”
Verdicts are made automatically; how verdicts are made.