Studies show that people evaluating data from a politically neutral hypothetical experiment, such as a skin cream's efficacy, interpret the numbers reasonably well.
Mixed Partly true and partly false in roughly equal measure.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge said mostly true; the verdict shown is the first judge's.
What would count as true or false
Judged as of 2018-03-22. True: published research (for example Kahan et al. 2013/2017, 'Motivated Numeracy') shows that participants, especially numerate ones, interpreted data from a neutral hypothetical skin-cream experiment reasonably well compared with a politically charged version of the same data. Mostly true: such studies exist and support the point, but with a minor qualification, for example that only the more numerate participants did well while many people overall answered wrongly. Mixed: the studies show neutral framing improved interpretation, but overall accuracy was low enough that 'a decent job' is a doubtful description. Mostly false: the cited research exists but the finding is substantially misstated. False: no such studies exist, or they found people interpreted neutral data poorly with no advantage from neutral framing.
Set before the research began.
Evidence (4)
-
E1 Do the math? Only if I agree with it! - The Boston Globe The Boston Globe · 20 October 2013
“With the skin rash question, the results were straightforward. Low-numerate people struggled to come to the correct, data-supported conclusion no matter their political leanings. They were likely to get it right no better than about 38 percent of the time, compared with a success rate of about 65 percent among high-numerate people.”
-
E2 Do the math? Only if I agree with it! - The Boston Globe The Boston Globe · 20 October 2013
“In fact, to look at the study’s results from a different perspective, nearly 60 percent of participants overall weren’t able to answer the question correctly, no matter which question they received.”
-
E3 Do the math? Only if I agree with it! - The Boston Globe The Boston Globe · 20 October 2013
“They were likely to get the question right about one-third of the time, compared to two-thirds of the time for the group with better math skills.”
-
E4 We asked people to do climate change maths. Their answers depended on their politics Australian National Centre for the Public Awareness of Science, ANU (republished from The Conversation) · 19 June 2019
“Participants in our study got the correct mathematical answer 48% of the time.”
Reasoning
The evidence confirms that such a study exists, with a skin-rash treatment version of the question (E1, E3). In that version, low-numerate participants answered correctly only about a third of the time (about 38%), and high-numerate participants about two-thirds of the time (about 65%) (E1, E3). Across the versions of the question, nearly 60% of participants answered incorrectly (E2). So the research supports the point only partly: on the skin-rash question, high-numerate participants answered correctly about 65% of the time but low-numerate participants only about 38% of the time (E1), and nearly 60% of all participants answered incorrectly whichever version they received (E2), so "a decent job" is a doubtful description of people in general.
Cite this claim
Steven Pinker, “Studies show that people evaluating data from a politically neutral hypothetical experiment, such as a skin cream's efficacy, interpret the numbers reasonably well.” (said 22 March 2018). Verdict: mixed. Reliability API, claim c_07a78a3aa171, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_07a78a3aa171
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Steven Pinker
-
Mostly true
“But in other kinds violence, such as homicides, the progress has definitely continued.”
-
Mostly true
“I float a number of hypotheses as to why cooperation and human flourishing in general have increased.”
-
Mostly true
“Those were as old as civilisation.”
Slavery and imperialism were as old as civilisation, predating the Enlightenment.
-
Mixed
“Nuclear doomsday scenarios in the 1960s set off not disarmament but an arms race with the Soviets.”
-
Mixed
“More countries are democratic than not, even though if it’s fewer than it was 20 years ago.”
More countries are democratic than not, though fewer than 20 years ago.
Verdicts are made automatically; how verdicts are made.