ClaimsSteven Pinker

“There are studies that show that people, when evaluating data from a hypothetical experiment—if it's politically neutral, like the efficacy of a skin cream—do a decent job of interpreting the numbers.”

Steven Pinker, interviewee 22 March 2018 Steven Pinker Wants Enlightenment Now! (Reason)

Factual Philosophy, ethics and society

Studies show that people evaluating data from a politically neutral hypothetical experiment, such as a skin cream's efficacy, interpret the numbers reasonably well.

Mixed Partly true and partly false in roughly equal measure.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The second judge said mostly true; the verdict shown is the first judge's.

What would count as true or false

Judged as of 2018-03-22. True: published research (for example Kahan et al. 2013/2017, 'Motivated Numeracy') shows that participants, especially numerate ones, interpreted data from a neutral hypothetical skin-cream experiment reasonably well compared with a politically charged version of the same data. Mostly true: such studies exist and support the point, but with a minor qualification, for example that only the more numerate participants did well while many people overall answered wrongly. Mixed: the studies show neutral framing improved interpretation, but overall accuracy was low enough that 'a decent job' is a doubtful description. Mostly false: the cited research exists but the finding is substantially misstated. False: no such studies exist, or they found people interpreted neutral data poorly with no advantage from neutral framing.

Set before the research began.

Evidence (4)

  1. E1 Do the math? Only if I agree with it! - The Boston Globe The Boston Globe · 20 October 2013

    “With the skin rash question, the results were straightforward. Low-numerate people struggled to come to the correct, data-supported conclusion no matter their political leanings. They were likely to get it right no better than about 38 percent of the time, compared with a success rate of about 65 percent among high-numerate people.”
  2. E2 Do the math? Only if I agree with it! - The Boston Globe The Boston Globe · 20 October 2013

    “In fact, to look at the study’s results from a different perspective, nearly 60 percent of participants overall weren’t able to answer the question correctly, no matter which question they received.”
  3. E3 Do the math? Only if I agree with it! - The Boston Globe The Boston Globe · 20 October 2013

    “They were likely to get the question right about one-third of the time, compared to two-thirds of the time for the group with better math skills.”
  4. E4 We asked people to do climate change maths. Their answers depended on their politics Australian National Centre for the Public Awareness of Science, ANU (republished from The Conversation) · 19 June 2019

    “Participants in our study got the correct mathematical answer 48% of the time.”

Reasoning

The evidence confirms that such a study exists, with a skin-rash treatment version of the question (E1, E3). In that version, low-numerate participants answered correctly only about a third of the time (about 38%), and high-numerate participants about two-thirds of the time (about 65%) (E1, E3). Across the versions of the question, nearly 60% of participants answered incorrectly (E2). So the research supports the point only partly: on the skin-rash question, high-numerate participants answered correctly about 65% of the time but low-numerate participants only about 38% of the time (E1), and nearly 60% of all participants answered incorrectly whichever version they received (E2), so "a decent job" is a doubtful description of people in general.

Cite this claim

Steven Pinker, “Studies show that people evaluating data from a politically neutral hypothetical experiment, such as a skin cream's efficacy, interpret the numbers reasonably well.” (said 22 March 2018). Verdict: mixed. Reliability API, claim c_07a78a3aa171, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_07a78a3aa171

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Steven Pinker, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Steven Pinker

  1. Mostly true Factual 11 October 2026
    “But in other kinds violence, such as homicides, the progress has definitely continued.”

    Progress against homicide has definitely continued, with homicide rates for most countries and for the world as a whole better now than 15 years ago.

  2. Mostly true Factual 11 October 2026
    “I float a number of hypotheses as to why cooperation and human flourishing in general have increased.”

    Pinker said he floats a number of hypotheses as to why cooperation and human flourishing in general have increased.

  3. Mostly true Factual 11 October 2026
    “Those were as old as civilisation.”

    Slavery and imperialism were as old as civilisation, predating the Enlightenment.

  4. Mixed Factual 26 September 2026
    “Nuclear doomsday scenarios in the 1960s set off not disarmament but an arms race with the Soviets.”

    Nuclear doomsday scenarios in the 1960s set off an arms race with the Soviets rather than disarmament.

  5. Mixed Factual 24 September 2025
    “More countries are democratic than not, even though if it’s fewer than it was 20 years ago.”

    More countries are democratic than not, though fewer than 20 years ago.

All of them

Verdicts are made automatically; how verdicts are made.