Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
82 76 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
61 47 75 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
67 46 85
All types combined: 77 (likely 72 to 82, high confidence), from 84 claims: 63 factual claims, 16 predictions, 5 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Nate Silver's claims
37 claims
“Clinton collapsed in the Midwest, destroying her Electoral College chances”
Nate Silver, editor in chief, writing in FiveThirtyEight article November 2016 Why FiveThirtyEight Gave Trump A Better Chance Than Almost Anyone Else (FiveThirtyEight)
Clinton significantly underperformed her polls across the Midwest and Rust Belt in the 2016 election, costing her the Electoral College.
Mostly true True in substance, wrong in a detail.
The second judge would not resolve this claim; the verdict shown is the first judge's.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judged against certified 2016 results and final 2016 polling averages (e.g. RealClearPolitics, FiveThirtyEight, HuffPost) for Midwest and Rust Belt states (MI, WI, PA, OH, IA, MN). True: Clinton's actual margins fell well short of her final polling averages across most of these states (misses of several points), and losing Michigan, Wisconsin and Pennsylvania was decisive for the Electoral College, meaning she would have won with them. Mostly true: the broad pattern holds but the underperformance was small or absent in one or two of the named states. Mixed: the underperformance was clear in some key states but not in most of the region, or it was not decisive for the Electoral College outcome. Mostly false: the polling misses were small (about 1 to 2 points) and not region-wide, so 'collapsed' overstates them. False: Clinton matched or beat her polls in these states, or the results there did not decide the Electoral College.
Evidence
- AN EVALUATION OF 2016 ELECTION POLLS IN THE UNITED STATES AAPOR Ad Hoc Committee on 2016 Election Polling
“State-level general election poll errors were much larger, with an average absolute error of 5.1 points and an average signed error of 3.0 points. This was exacerbated by state polls, which indicated the wrong winner in Pennsylvania, Michigan and Wisconsin – states that collectively were enough to tip the outcome of the Electoral College.”
- 7 experts try to explain how the polls missed Donald Trump’s victory Vox · 9 November 2016
“The whole region was something of a black hole for pollsters. In the home stretch, Clinton was projected to be up by around 7 points in Wisconsin. She lost it by a point. In Iowa, she was only down by 3 points in most polls. She lost it by a whopping 9 points.”
- 7 experts try to explain how the polls missed Donald Trump’s victory Vox · 9 November 2016
“Clinton lost the state. Grossmann wasn’t alone in badly missing it — most polls had her up by around 4 points in the state.”
- 7 experts try to explain how the polls missed Donald Trump’s victory Vox · 9 November 2016
“The RealClearPolitics average for Clinton in Pennsylvania, for instance, only had her up by 1.5 points — well within the margin of her error in her loss.”
Reasoning
The AAPOR committee report [E1] says state polls named the wrong winner in Pennsylvania, Michigan and Wisconsin, and that those three states together were enough to tip the Electoral College, so the decisiveness part of the claim holds. Vox [E2, E3] reports large misses in the region: Clinton led late Wisconsin polls by about 7 points and lost by about 1; she trailed by about 3 in Iowa polls and lost by 9; and in another state, which the quote does not name, most polls had her up by about 4 before she lost it. In Pennsylvania, however, the RealClearPolitics average had her up only 1.5 points, a miss Vox calls within the margin of error [E4], and the evidence gives no figures for Ohio or Minnesota. The overall pattern holds, but the miss was small in at least one named state, which fits "mostly true".
Cite this claim
Nate Silver, “Clinton significantly underperformed her polls across the Midwest and Rust Belt in the 2016 election, costing her the Electoral College.” (said November 2016). Verdict: mostly true. Reliability API, claim c_cd96d5a8fc57, method 0.1.0+28da144b. https://epistacklabs.com/claims/c_cd96d5a8fc57
Claims without a verdict
Is a verdict here wrong, or do you speak for Nate Silver? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.