ClaimsNate Silver

“Clinton collapsed in the Midwest, destroying her Electoral College chances”

Nate Silver, editor in chief, writing in FiveThirtyEight article November 2016 Why FiveThirtyEight Gave Trump A Better Chance Than Almost Anyone Else (FiveThirtyEight) archived copy

Factual AI timelines and forecasting

Clinton significantly underperformed her polls across the Midwest and Rust Belt in the 2016 election, costing her the Electoral College.

Mostly true True in substance, wrong in a detail.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The second judge would not resolve this claim; the verdict shown is the first judge's.

Said for an organisation they lead or work for; it counts on both records.

What would count as true or false

Judged against certified 2016 results and final 2016 polling averages (e.g. RealClearPolitics, FiveThirtyEight, HuffPost) for Midwest and Rust Belt states (MI, WI, PA, OH, IA, MN). True: Clinton's actual margins fell well short of her final polling averages across most of these states (misses of several points), and losing Michigan, Wisconsin and Pennsylvania was decisive for the Electoral College, meaning she would have won with them. Mostly true: the broad pattern holds but the underperformance was small or absent in one or two of the named states. Mixed: the underperformance was clear in some key states but not in most of the region, or it was not decisive for the Electoral College outcome. Mostly false: the polling misses were small (about 1 to 2 points) and not region-wide, so 'collapsed' overstates them. False: Clinton matched or beat her polls in these states, or the results there did not decide the Electoral College.

Set before the research began.

Evidence (4)

  1. E1 AN EVALUATION OF 2016 ELECTION POLLS IN THE UNITED STATES AAPOR Ad Hoc Committee on 2016 Election Polling

    “State-level general election poll errors were much larger, with an average absolute error of 5.1 points and an average signed error of 3.0 points. This was exacerbated by state polls, which indicated the wrong winner in Pennsylvania, Michigan and Wisconsin – states that collectively were enough to tip the outcome of the Electoral College.”
  2. E2 7 experts try to explain how the polls missed Donald Trump’s victory Vox · 9 November 2016

    “The whole region was something of a black hole for pollsters. In the home stretch, Clinton was projected to be up by around 7 points in Wisconsin. She lost it by a point. In Iowa, she was only down by 3 points in most polls. She lost it by a whopping 9 points.”
  3. E3 7 experts try to explain how the polls missed Donald Trump’s victory Vox · 9 November 2016

    “Clinton lost the state. Grossmann wasn’t alone in badly missing it — most polls had her up by around 4 points in the state.”
  4. E4 7 experts try to explain how the polls missed Donald Trump’s victory Vox · 9 November 2016

    “The RealClearPolitics average for Clinton in Pennsylvania, for instance, only had her up by 1.5 points — well within the margin of her error in her loss.”

Reasoning

The AAPOR committee report [E1] says state polls named the wrong winner in Pennsylvania, Michigan and Wisconsin, and that those three states together were enough to tip the Electoral College, so the decisiveness part of the claim holds. Vox [E2, E3] reports large misses in the region: Clinton led late Wisconsin polls by about 7 points and lost by about 1; she trailed by about 3 in Iowa polls and lost by 9; and in another state, which the quote does not name, most polls had her up by about 4 before she lost it. In Pennsylvania, however, the RealClearPolitics average had her up only 1.5 points, a miss Vox calls within the margin of error [E4], and the evidence gives no figures for Ohio or Minnesota. The overall pattern holds, but the miss was small in at least one named state, which fits "mostly true".

Cite this claim

Nate Silver, “Clinton significantly underperformed her polls across the Midwest and Rust Belt in the 2016 election, costing her the Electoral College.” (said November 2016). Verdict: mostly true. Reliability API, claim c_cd96d5a8fc57, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_cd96d5a8fc57

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Nate Silver, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Nate Silver

  1. Resolved true Factual 8 September 2023
    “It’s not hard, for instance, to find polls from this point in 2015 showing Hillary Clinton with double-digit leads over Trump.”

    Polls from around September 2015 can be found showing Hillary Clinton with double-digit leads over Donald Trump.

  2. Mostly true Factual 21 May 2022
    “There was never any spike in Biden's approval rating.”

    Joe Biden's approval rating never had a spike.

  3. Resolved true Factual 9 June 2021
    “This is the pollster that had shown a big bounce for Garcia before, so either that previous poll was an outlier or her momentum has been usurped by Wiley.”

    A pollster that earlier showed a big bounce for Garcia has now shown a result implying either that the earlier poll was an outlier or that Wiley has taken over her momentum.

  4. Mixed Factual November 2016
    “Instead, there was a modest polling error, well in line with historical polling errors, but even a modest error was enough to provide for plenty of paths to victory for Trump.”

    The 2016 polling error was modest and in line with historical polling errors, yet large enough to give Trump many paths to victory.

  5. Mostly true Factual November 2016
    “The single most important reason that our model gave Trump a better chance than others is because of our assumption that polling errors are correlated.”

    The main reason FiveThirtyEight's 2016 model gave Trump a better chance than other models was its assumption that polling errors are correlated.

All of them

Verdicts are made automatically; how verdicts are made.