ClaimsNate Silver

“Furthermore, polling this early historically has little to no predictive power.”

Nate Silver, author of Silver Bulletin 8 September 2023 It's gonna be a very long and exceptionally tedious road to November 2024 (Silver Bulletin) archived copy

Factual Science and research methods

Polling conducted this early in a US presidential cycle has historically had little to no predictive power for the election result.

Resolved true The record shows it happened or was so.

Factual: Statements about the present or the past, checked against the record: did they hold up?

What would count as true or false

True: published analyses of historical general-election or primary polling about 14 months before a US presidential election (September of the year before) show weak or negligible correlation with, or large errors relative to, the final outcome. Examples include FiveThirtyEight's analyses and academic work such as Wlezien and Erikson's. Mostly true: the research shows low but meaningful predictive power, so 'little' fits but 'none' slightly overstates it. Mixed: the evidence is split, for example early primary polls of well-known front-runners have moderate predictive power while general-election polls do not. Mostly false: the research shows early polls have substantial predictive power in most settings, though not in some. False: the research shows early polls predict outcomes well.

Set before the research began.

Evidence (4)

  1. E1 The Timeline of Presidential Elections University of Chicago Press · 2012

    “Polls from the beginning of the year, they show, have virtually no predictive power.”
  2. E2 More on Early Polls Columbia Journalism Review · 26 May 2011

    “The graph shows that polls 300 days [before the vote] have little predictive value at all.”
  3. E3 When You Know How Polls Work, You Realize That The Early Polls Don't Matter Washington Monthly · 10 October 2023

    “The margin of error is mainly a cover for the historical evidence that there simply is no statistical correlation between early polls and who wins the election.”
  4. E4 Early presidential poll favorites sometimes struggle at finish line National Constitution Center · 22 July 2015

    “Polls that test hypothetical general election matchups at this stage in the cycle are mostly wrong about who will win the White House,”

Reasoning

Wlezien and Erikson's book, as described by its publisher, says polls from the start of the election year have "virtually no predictive power" (E1). A CJR analysis says polls taken 300 days before the vote have "little predictive value at all" (E2). Both of those points are closer to Election Day than September of the year before. Independent commentary also says early polls show no statistical correlation with who wins (E3), and that hypothetical general-election matchups at this stage are "mostly wrong" (E4). None of the evidence shows early polls having substantial predictive power, so the claim of "little to no" predictive power holds.

Cite this claim

Nate Silver, “Polling conducted this early in a US presidential cycle has historically had little to no predictive power for the election result.” (said 8 September 2023). Verdict: resolved true. Reliability API, claim c_d028154579e7, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_d028154579e7

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Nate Silver, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Nate Silver

  1. Mostly true Factual 9 October 2024
    “The previous Quinnipiac polls of these states had been quite a bit better for Harris.”

    The previous Quinnipiac polls of Michigan, Wisconsin and Pennsylvania were quite a bit better for Harris than the latest ones.

  2. Resolved true Factual 9 October 2024
    “Although John McCain had periods of strong polling in 2008, especially after the Republican Convention, in the end Barack Obama won in a landslide that didn’t justify Democrats’ constant anxieties.”

    John McCain had periods of strong polling in 2008, especially after the Republican Convention, but Barack Obama won in a landslide.

  3. Resolved true Factual 9 October 2024
    “The recognition that the election is only four weeks away.”

    As of early October 2024, the US presidential election is about four weeks away.

  4. Resolved true Factual 9 October 2024
    “And yet, there are dozens of polls released every week.”

    Dozens of election polls are released every week.

  5. Mostly true Factual 8 October 2024
    “This property is even more profound in baseball, where single-run leads are relatively durable because runs tend to come in bunches and the default outcome is not to score at all.”

    In baseball, single-run leads are relatively durable because runs tend to come in bunches and the default outcome is not to score at all.

All of them

Verdicts are made automatically; how verdicts are made.