Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
82 76 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
61 47 75 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
67 46 85
All types combined: 77 (likely 72 to 82, high confidence), from 84 claims: 63 factual claims, 16 predictions, 5 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Nate Silver's claims
37 claims
“Since our model is based on a combination of state and national polls, we can’t get a lot of utility out of years before that.”
Nate Silver, FiveThirtyEight editor-in-chief, column author 2016 Election Update: Why Our Model Is More Bullish Than Others On Trump (FiveThirtyEight)
FiveThirtyEight's model is based on a combination of state and national polls.
Mostly true True in substance, wrong in a detail.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judged as of 2016 against FiveThirtyEight's published 2016 presidential model methodology. True: the methodology states that the forecast uses both state-level and national polls (for example, national polls feed the trend line adjustment). Mostly true: it uses both, with other inputs such as economic or demographic data, mainly in the polls-plus version, that the claim does not mention. Mixed: national polls play only a marginal role. Mostly false: the model relies almost entirely on one kind of poll. False: the model does not use both state and national polls.
Evidence
- [PDF] Deciphering the Signal and the Noise - Ben Tanen Ben Tanen (Tufts University term paper) · 10 May 2017
“FiveThirtyEight’s model included almost every state and national poll that was published by any major polling house throughout the 2016 election cycle (Silver 2016b).”
- The Contest to Predict the Presidential Winner in Florida Was as Close as the Race Itself Sayfie Review (Featured Column by Dr. Aubrey Jewett, UCF) · 12 January 2017
“FiveThirtyEight starts with the actual results of published polls but then “the model weights each poll by its sample size, how recently it was conducted, and the historical accuracy and methodology of the polling firm.””
- The Contest to Predict the Presidential Winner in Florida Was as Close as the Race Itself Sayfie Review (Featured Column by Dr. Aubrey Jewett, UCF) · 12 January 2017
“FiveThirtyEight also calculates a “Polls Plus Forecast” which includes state demographic, economic and historical information into the Polls Only model”
- Five Thirty Eight Model: Trump Wins Georgia, But Clinton Wins Nationally in a Landslide GeorgiaPol (blog) · 30 June 2016
“The final model, polls plus, uses economic data and past voter behavior to make assumptions about how the election will turn out.”
Reasoning
E1, an independent paper citing Silver's 2016 methodology, says the model took in almost every state and national poll published during the 2016 cycle, so it used both kinds of poll. E3 and E4 show that the polls-plus version also used economic, demographic and historical data, and the claim does not mention these inputs. The resolution criteria rate this situation as mostly true.
Cite this claim
Nate Silver, “FiveThirtyEight's model is based on a combination of state and national polls.” (said 2016). Verdict: mostly true. Reliability API, claim c_690c25e5f167, method 0.1.0+28da144b. https://epistacklabs.com/claims/c_690c25e5f167
Claims without a verdict
Is a verdict here wrong, or do you speak for Nate Silver? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.