Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
82 76 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
61 47 75 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
67 46 85
All types combined: 77 (likely 72 to 82, high confidence), from 84 claims: 63 factual claims, 16 predictions, 5 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Nate Silver's claims
37 claims
“In the case of presidential primaries, indicators such as endorsements and support from party elites tend to be more reliable indicators of eventual success.”
Nate Silver, editor in chief, writing on FiveThirtyEight 2015 Donald Trump Is Winning The Polls — And Losing The Nomination (FiveThirtyEight)
In presidential primaries, endorsements and party elite support tend to be more reliable indicators of eventual success than early polls.
Mostly true True in substance, wrong in a detail.
The second judge said resolved true; the verdict shown is the first judge's.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judge against the political-science and forecasting evidence available in 2015 on modern US presidential nomination contests (roughly 1980–2012). Later cases such as Trump in 2016 are later knowledge and do not count. The claim is hedged ('tend to'), so it does not need endorsements to win every time. TRUE: the published research of the time (e.g. 'The Party Decides', Cohen et al. 2008, and related analyses) found that endorsements or party-elite support predicted eventual nominees better than early (pre-primary) polls, and that work was not seriously contradicted. MOSTLY TRUE: the research generally supported endorsements as the better predictor, but some studies found early polls about as predictive in some periods or specifications. MIXED: the research of the time was roughly evenly split on whether endorsements or early polls predicted better. MOSTLY FALSE: endorsements were shown to be predictive, but the evidence of the time showed early national polls predicted at least as well, so 'more reliable' overstates it. FALSE: the research of the time showed endorsements were not predictive, or clearly less predictive than early polls.
Evidence
- Political scientists think “the party” will stop Trump. They shouldn’t be so sure. Vox · 23 September 2015
“And that's just what they found. In eight of ten competitive presidential primary contests between 1980 and 2004, endorsements showed that party insiders clearly backed one candidate before Iowa, and that candidate won the nomination. Endorsements were better at predicting the outcome than polls, fundraising numbers, or media coverage.”
- Polls or Pols? The real driving force behind presidential nominations | Brookings Brookings Institution · 28 July 2016
“Across all contested nominations since 1980, the final Gallup poll before the Iowa caucus explains around 90 percent of what happens in the state-by-state voting.”
- How Reliable Are the Early Presidential Polls? Pew Research Center · 14 February 2007
“In seven open Republican contests since 1960, the early front-runners held on to win the party nod six times.1 By contrast, early Democratic poll leaders won four out of eight open contests between 1960 and 2004.”
- Here’s who’s winning the Republican nomination contest Vox · 30 October 2015
“In six of 11 primaries without an incumbent, the candidate leading the fall before the election was the party’s nominee.”
Reasoning
E1 summarises the 'Party Decides' research. It says pre-Iowa endorsements identified the eventual nominee in eight of ten competitive contests from 1980 to 2004, and predicted the outcome better than polls, fundraising or media coverage. E4 says the leader in polls the fall before the election won in only six of 11 non-incumbent primaries, and E3 says early Democratic poll leaders won only four of eight. Both records are weaker than the one E1 gives for endorsements. However, E3 shows early Republican poll leaders won six of seven open contests, and E2 says the final pre-Iowa Gallup poll explained about 90 percent of later voting. So polls also had real predictive power in some periods and measures, which fits 'mostly true' rather than 'true'.
Cite this claim
Nate Silver, “In presidential primaries, endorsements and party elite support tend to be more reliable indicators of eventual success than early polls.” (said 2015). Verdict: mostly true. Reliability API, claim c_96436659e3a1, method 0.1.0+28da144b. https://epistacklabs.com/claims/c_96436659e3a1
Claims without a verdict
Is a verdict here wrong, or do you speak for Nate Silver? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.