ClaimsNate Silver

“Since our model is based on a combination of state and national polls, we can’t get a lot of utility out of years before that.”

Nate Silver, FiveThirtyEight editor-in-chief, column author 2016 Election Update: Why Our Model Is More Bullish Than Others On Trump (FiveThirtyEight) archived copy

Factual Science and research methods

FiveThirtyEight's model is based on a combination of state and national polls.

Mostly true True in substance, wrong in a detail.

Factual: Statements about the present or the past, checked against the record: did they hold up?

Said for an organisation they lead or work for; it counts on both records.

What would count as true or false

Judged as of 2016 against FiveThirtyEight's published 2016 presidential model methodology. True: the methodology states that the forecast uses both state-level and national polls (for example, national polls feed the trend line adjustment). Mostly true: it uses both, with other inputs such as economic or demographic data, mainly in the polls-plus version, that the claim does not mention. Mixed: national polls play only a marginal role. Mostly false: the model relies almost entirely on one kind of poll. False: the model does not use both state and national polls.

Set before the research began.

Evidence (4)

  1. E1 [PDF] Deciphering the Signal and the Noise - Ben Tanen Ben Tanen (Tufts University term paper) · 10 May 2017

    “FiveThirtyEight’s model included almost every state and national poll that was published by any major polling house throughout the 2016 election cycle (Silver 2016b).”
  2. E2 The Contest to Predict the Presidential Winner in Florida Was as Close as the Race Itself Sayfie Review (Featured Column by Dr. Aubrey Jewett, UCF) · 12 January 2017

    “FiveThirtyEight starts with the actual results of published polls but then “the model weights each poll by its sample size, how recently it was conducted, and the historical accuracy and methodology of the polling firm.””
  3. E3 The Contest to Predict the Presidential Winner in Florida Was as Close as the Race Itself Sayfie Review (Featured Column by Dr. Aubrey Jewett, UCF) · 12 January 2017

    “FiveThirtyEight also calculates a “Polls Plus Forecast” which includes state demographic, economic and historical information into the Polls Only model”
  4. E4 Five Thirty Eight Model: Trump Wins Georgia, But Clinton Wins Nationally in a Landslide GeorgiaPol (blog) · 30 June 2016

    “The final model, polls plus, uses economic data and past voter behavior to make assumptions about how the election will turn out.”

Reasoning

E1, an independent paper citing Silver's 2016 methodology, says the model took in almost every state and national poll published during the 2016 cycle, so it used both kinds of poll. E3 and E4 show that the polls-plus version also used economic, demographic and historical data, and the claim does not mention these inputs. The resolution criteria rate this situation as mostly true.

Cite this claim

Nate Silver, “FiveThirtyEight's model is based on a combination of state and national polls.” (said 2016). Verdict: mostly true. Reliability API, claim c_690c25e5f167, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_690c25e5f167

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Nate Silver, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Nate Silver

  1. Mostly true Factual 9 October 2024
    “The previous Quinnipiac polls of these states had been quite a bit better for Harris.”

    The previous Quinnipiac polls of Michigan, Wisconsin and Pennsylvania were quite a bit better for Harris than the latest ones.

  2. Resolved true Factual 9 October 2024
    “Although John McCain had periods of strong polling in 2008, especially after the Republican Convention, in the end Barack Obama won in a landslide that didn’t justify Democrats’ constant anxieties.”

    John McCain had periods of strong polling in 2008, especially after the Republican Convention, but Barack Obama won in a landslide.

  3. Resolved true Factual 9 October 2024
    “The recognition that the election is only four weeks away.”

    As of early October 2024, the US presidential election is about four weeks away.

  4. Resolved true Factual 9 October 2024
    “And yet, there are dozens of polls released every week.”

    Dozens of election polls are released every week.

  5. Mostly true Factual 8 October 2024
    “This property is even more profound in baseball, where single-run leads are relatively durable because runs tend to come in bunches and the default outcome is not to score at all.”

    In baseball, single-run leads are relatively durable because runs tend to come in bunches and the default outcome is not to score at all.

All of them

Verdicts are made automatically; how verdicts are made.