ClaimsNate Silver

“Instead, there was a modest polling error, well in line with historical polling errors, but even a modest error was enough to provide for plenty of paths to victory for Trump.”

Nate Silver, editor in chief, writing in FiveThirtyEight article November 2016 Why FiveThirtyEight Gave Trump A Better Chance Than Almost Anyone Else (FiveThirtyEight) archived copy

Factual AI timelines and forecasting

The 2016 polling error was modest and in line with historical polling errors, yet large enough to give Trump many paths to victory.

Mixed Partly true and partly false in roughly equal measure.

Factual: Statements about the present or the past, checked against the record: did they hold up?

Said for an organisation they lead or work for; it counts on both records.

What would count as true or false

Judged as of November 2016. The claim has three parts: the 2016 polling error was modest; it was in line with historical polling errors; and it was large enough to give Trump many paths to victory. True: post-election analyses (e.g. the AAPOR 2017 evaluation, FiveThirtyEight data) show the national polling error (about 1–2 points) and the average state-level error were within the historical range for presidential elections, and that a uniform error of that size flipped enough states for Trump to win. Mostly true: the national error was historically typical but state-level errors in key Midwestern states were somewhat above average, which the claim plays down. Mixed: the national error was in line with history but state errors were clearly larger than historical norms, so only part of the claim holds. Mostly false: the errors overall were historically large, though correlated errors did open paths for Trump. False: the 2016 polling error was far outside historical norms.

Set before the research began.

Evidence (4)

  1. E1 AN EVALUATION OF 2016 ELECTION POLLS IN THE UNITED STATES AAPOR Ad Hoc Committee on 2016 Election Polling

    “National polls were generally correct and accurate by historical standards.”
  2. E2 AN EVALUATION OF 2016 ELECTION POLLS IN THE UNITED STATES AAPOR Ad Hoc Committee on 2016 Election Polling

    “Analysis of 423 state polls completed at least 13 days before the 2016 election, shows an average absolute error of 5.1 percentage points and a signed error of 3.0 percentage points in the direction of over-estimating support for Clinton. In the four prior presidential elections, the average absolute error in state polls ranged from 3.2 to 4.6.”
  3. E3 Polling in the age of Trump highlights flawed methods and filtered realities The Conversation · 26 November 2024

    “From 1968 to 2012, the average polling error in the national popular vote was 2 percentage points. That would make 2016 an average year for presidential polling.”
  4. E4 How Trump could win the 2020 election through the Electoral College Vox · 29 October 2020

    “Polls underestimated Trump’s margin in most states in 2016, but the misses were bigger than average in or near the Upper Midwest (underestimating Trump by 8 points in Minnesota, a little over 7 points in Wisconsin, a little over 6 points in Ohio and Iowa, nearly 4 points in Michigan, and nearly 3 points in Pennsylvania).”

Reasoning

AAPOR found national polls accurate by historical standards (E1), and The Conversation puts 2016 national error at about the 1968–2012 average of 2 points (E3). State polls, however, had an average absolute error of 5.1 points, above the 3.2–4.6 range of the four prior elections (E2). Misses were larger than average in or near the Upper Midwest (E4). The national part of the claim holds, but AAPOR's figure for state polls completed at least 13 days before the election (5.1 points) is above the 3.2–4.6 range of the four prior elections, which fits the mixed criterion.

Cite this claim

Nate Silver, “The 2016 polling error was modest and in line with historical polling errors, yet large enough to give Trump many paths to victory.” (said November 2016). Verdict: mixed. Reliability API, claim c_058de6d0ae10, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_058de6d0ae10

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Nate Silver, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Nate Silver

  1. Resolved true Factual 8 September 2023
    “It’s not hard, for instance, to find polls from this point in 2015 showing Hillary Clinton with double-digit leads over Trump.”

    Polls from around September 2015 can be found showing Hillary Clinton with double-digit leads over Donald Trump.

  2. Mostly true Factual 21 May 2022
    “There was never any spike in Biden's approval rating.”

    Joe Biden's approval rating never had a spike.

  3. Resolved true Factual 9 June 2021
    “This is the pollster that had shown a big bounce for Garcia before, so either that previous poll was an outlier or her momentum has been usurped by Wiley.”

    A pollster that earlier showed a big bounce for Garcia has now shown a result implying either that the earlier poll was an outlier or that Wiley has taken over her momentum.

  4. Mostly true Factual November 2016
    “The single most important reason that our model gave Trump a better chance than others is because of our assumption that polling errors are correlated.”

    The main reason FiveThirtyEight's 2016 model gave Trump a better chance than other models was its assumption that polling errors are correlated.

  5. Mostly true Factual November 2016
    “Clinton collapsed in the Midwest, destroying her Electoral College chances”

    Clinton significantly underperformed her polls across the Midwest and Rust Belt in the 2016 election, costing her the Electoral College.

All of them

Verdicts are made automatically; how verdicts are made.