Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
74 68 79 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 1 prediction resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 1 promise resolved, 5 needed for a score.
All types combined: 74 (likely 68 to 79, high confidence), from 97 claims: 97 factual claims. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Steven Pinker's claims
25 claims
“John Ioannidis, among the savviest epidemiologists (his 2005 article alerted us to the replicability crisis)”
Steven Pinker, on X 20 March 2020 Post by @sapinker on X, 2020-03-20 (X)
John Ioannidis published a 2005 article that alerted scientists to the replicability crisis.
Resolved true The record shows it happened or was so.
What would count as true or false
True: John Ioannidis published an article in 2005 (for example 'Why Most Published Research Findings Are False', PLoS Medicine) that is widely credited as a major early warning about the replicability crisis. The claim does not require that the article was the first such warning. Mostly true: the article exists and is so credited, but a minor detail such as the year is slightly off. Mixed: the article exists, but scholars widely dispute that it played a significant role in alerting scientists to the crisis. Mostly false: Ioannidis wrote on related topics, but no 2005 article of his is credited this way. False: no such article exists.
Evidence
- Why Most Published Research Findings Are False PMC (NCBI), reproducing PLoS Medicine article by John Ioannidis · 30 August 2005
“Citation: Ioannidis JPA (2005) Why most published research findings are false. PLoS Med 2(8): e124.”
- Why Most Published Research Findings Are False - Wikipedia Wikipedia · 23 January 2010
“"Why Most Published Research Findings Are False" is a 2005 essay written by John Ioannidis, a professor at the Stanford School of Medicine, and published in PLOS Medicine.[1] It is considered foundational to the field of metascience.”
- Why Most Published Research Findings Are False - Wikipedia Wikipedia · 23 January 2010
“While the general arguments in the paper recommending reforms in scientific research methodology were well-received, Ioannidis received criticism for the validity of his model and his claim that the majority of scientific findings are false.”
- Replication crisis - Wikipedia Wikipedia · 9 January 2015
“When publication bias is considered along with the fact that a majority of tested hypotheses might be false a priori, it is plausible that a considerable proportion of research findings might be false positives, as shown by metascientist John Ioannidis.”
Reasoning
E1 confirms that Ioannidis published "Why Most Published Research Findings Are False" in PLoS Medicine in 2005. E2 says this essay is considered foundational to metascience, and E4's entry on the replication crisis credits Ioannidis with showing that many research findings may be false positives. E3 reports criticism of the paper's model and its headline claim, but says its reform arguments were well received. It does not show that scholars dispute the paper's role in drawing attention to the crisis.
Cite this claim
Steven Pinker, “John Ioannidis published a 2005 article that alerted scientists to the replicability crisis.” (said 20 March 2020). Verdict: resolved true. Reliability API, claim c_1edef35b473c, method 0.1.0+28da144b. https://epistacklabs.com/claims/c_1edef35b473c
Claims without a verdict
Is a verdict here wrong, or do you speak for Steven Pinker? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.