Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
72 65 79 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
66 54 78 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 1 promise resolved, 5 needed for a score.
All types combined: 71 (likely 64 to 77, high confidence), from 79 claims: 60 factual claims, 19 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Balaji Srinivasan's claims
37 claims
“As ad load rises, customer satisfaction falls.”
Balaji Srinivasan, writing on X 24 December 2019 Post by @balajis on X, 2019-12-24 (X)
As advertising load rises, customer satisfaction falls.
Mostly true True in substance, wrong in a detail.
What would count as true or false
The claim is general: as advertising load rises, customer satisfaction falls. Judge it against evidence as of 2019-12-24. True: empirical research (A/B tests, industry studies, academic papers) consistently finds that more ads per page, video or session lowers user satisfaction or engagement. Mostly true: the relationship generally holds but with modest exceptions or thresholds. Mixed: the findings are inconsistent, with a negative effect in some contexts and none in others. Mostly false: the evidence shows only weak or narrow effects and the general statement overstates them. False: the evidence shows no relationship or a positive one between ad load and satisfaction.
Evidence
- Pandora tested listeners’ tolerance for ads by experimenting on 35 million users Quartz (qz.com) · 1 May 2018
“The researchers found that the people who received more advertisements didn’t listen as much. One extra advertisement per hour led to about 2% less listening in the final month of the experiment.”
- Pandora tested listeners’ tolerance for ads by experimenting on 35 million users Quartz (qz.com) · 1 May 2018
“Breaking up the advertisements didn’t matter much, just the total time Pandora forced users to listen to them.”
- Pandora tested listeners’ tolerance for ads by experimenting on 35 million users Quartz (qz.com) · 1 May 2018
“For listeners 55 and older, each additional advertisement per hour made them 0.21% more likely to become subscribers. This was more than double the effect that an additional ad had on 18-24 year olds.”
- Pandora tested listeners’ tolerance for ads by experimenting on 35 million users Quartz (qz.com) · 1 May 2018
“At the same time, people under 55 were far more likely to stop listening altogether because of the new advertisements.”
Reasoning
Quartz reported in 2018 on a large Pandora experiment with 35 million users. Listeners who were given more ads listened less, with one extra ad per hour cutting listening by about 2% (E1). People under 55 were also more likely to stop listening altogether (E4). The effect followed total ad time rather than the number of ad breaks (E2), and for older listeners more ads raised the chance of buying an ad-free subscription (E3). That is a difference between age groups, not evidence that more ads raise satisfaction. This supports a generally negative link between ad load and engagement, with some variation, but it comes from a single study and does not show that findings are consistent across research.
Cite this claim
Balaji Srinivasan, “As advertising load rises, customer satisfaction falls.” (said 24 December 2019). Verdict: mostly true. Reliability API, claim c_38f157ddb25c, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_38f157ddb25c
Claims without a verdict
- Unresolvable 148
- Not yet due 21
- Own records only 2
- Not researched 227
- Not checkable 1,091
Is a verdict here wrong, or do you speak for Balaji Srinivasan? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.