Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
82 76 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
61 47 75 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
67 46 85
All types combined: 77 (likely 72 to 82, high confidence), from 84 claims: 63 factual claims, 16 predictions, 5 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Nate Silver's claims
35 claims
“Furthermore, polling this early historically has little to no predictive power.”
Nate Silver, author of Silver Bulletin 8 September 2023 It's gonna be a very long and exceptionally tedious road to November 2024 (Silver Bulletin)
Polling conducted this early in a US presidential cycle has historically had little to no predictive power for the election result.
Resolved true The record shows it happened or was so.
What would count as true or false
True: published analyses of historical general-election or primary polling about 14 months before a US presidential election (September of the year before) show weak or negligible correlation with, or large errors relative to, the final outcome. Examples include FiveThirtyEight's analyses and academic work such as Wlezien and Erikson's. Mostly true: the research shows low but meaningful predictive power, so 'little' fits but 'none' slightly overstates it. Mixed: the evidence is split, for example early primary polls of well-known front-runners have moderate predictive power while general-election polls do not. Mostly false: the research shows early polls have substantial predictive power in most settings, though not in some. False: the research shows early polls predict outcomes well.
Evidence
- The Timeline of Presidential Elections University of Chicago Press · 2012
“Polls from the beginning of the year, they show, have virtually no predictive power.”
- More on Early Polls Columbia Journalism Review · 26 May 2011
“The graph shows that polls 300 days [before the vote] have little predictive value at all.”
- When You Know How Polls Work, You Realize That The Early Polls Don't Matter Washington Monthly · 10 October 2023
“The margin of error is mainly a cover for the historical evidence that there simply is no statistical correlation between early polls and who wins the election.”
- Early presidential poll favorites sometimes struggle at finish line National Constitution Center · 22 July 2015
“Polls that test hypothetical general election matchups at this stage in the cycle are mostly wrong about who will win the White House,”
Reasoning
Wlezien and Erikson's book, as described by its publisher, says polls from the start of the election year have "virtually no predictive power" (E1). A CJR analysis says polls taken 300 days before the vote have "little predictive value at all" (E2). Both of those points are closer to Election Day than September of the year before. Independent commentary also says early polls show no statistical correlation with who wins (E3), and that hypothetical general-election matchups at this stage are "mostly wrong" (E4). None of the evidence shows early polls having substantial predictive power, so the claim of "little to no" predictive power holds.
Cite this claim
Nate Silver, “Polling conducted this early in a US presidential cycle has historically had little to no predictive power for the election result.” (said 8 September 2023). Verdict: resolved true. Reliability API, claim c_d028154579e7, method 0.1.0+28da144b. https://epistacklabs.com/claims/c_d028154579e7
Claims without a verdict
Is a verdict here wrong, or do you speak for Nate Silver? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.