Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
79 72 85 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
80 72 88 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 1 promise resolved, 5 needed for a score.
All types combined: 79 (likely 74 to 84, high confidence), from 102 claims: 64 factual claims, 38 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Gary Marcus's claims
42 claims
“They can be easily fooled.”
Gary Marcus, interviewee 20 September 2019 Gary Marcus on Why AI Needs a Reboot (Psychology Today)
Driverless cars that are not actually reliable can be easily fooled.
Resolved true The record shows it happened or was so.
What would count as true or false
Judged as of 2019-09-20. True: published research or documented incidents from up to that date show that driverless car perception systems then in use or under development could be misled by simple or cheap manipulations (e.g. stickers on stop signs, small road markings, projected images, adversarial patches) or by unusual situations. Mostly true: such vulnerabilities were shown, but mainly in lab or research settings rather than on deployed commercial vehicles, while still being easy to produce. Mixed: vulnerabilities were shown but required sophisticated or costly attacks, so 'easily' is only partly supported. Mostly false: the only evidence was narrow, single-component attacks that did not carry over to full driving systems, and the claim generalises from them. False: the evidence shows that 2019 driverless systems were robust to such manipulations.
Evidence
- Tencent Keen Security Lab: Experimental Security Research of Tesla Autopilot Tencent Keen Security Lab · 29 March 2019
“Based on the research, we proved that by placing interference stickers on the road, the Autopilot system will capture these information and make an abnormal judgement, which causes the vehicle to enter into the reverse lane.”
- Tencent Keen Security Lab: Experimental Security Research of Tesla Autopilot Tencent Keen Security Lab · 29 March 2019
“This is not a real-world concern given that a driver can easily override Autopilot at any time by using the steering wheel or brakes and should be prepared to do so at all times.”
- Physical Adversarial Examples for Object Detectors National Science Foundation Public Access Repository (hosting 12th USENIX Workshop on Offensive Technologies, WOOT 18) · 4 August 2018
“With a perturbation in the form of only black and white stickers, we attack a real stop sign, causing targeted misclassification in 100% of the images obtained in lab settings, and in 84.8% of the captured video frames obtained on a moving vehicle (field test) for the target classifier.”
- Researchers trick Tesla Autopilot into steering into oncoming traffic Ars Technica · 2 April 2019
“Researchers have devised a simple attack that might cause a Tesla to automatically steer into oncoming traffic under certain conditions.”
Reasoning
Before 2019-09-20, independent research showed that driving perception systems could be made to give wrong outputs by cheap manipulations such as stickers on stop signs or on the road [E1][E3]. Peer-reviewed work used black-and-white stickers on a real stop sign to cause targeted misclassification in 84.8% of video frames captured from a moving vehicle (E3). Tencent Keen Lab showed that stickers on the road made a production Tesla's Autopilot misjudge the lane and steer into the reverse lane (E1), and Ars Technica called this a simple attack (E4). The Keen Lab report also includes a statement saying the attack was not a real-world concern because a driver can override Autopilot (E2), but that does not change the finding that the system made an abnormal judgement, which is what the 'true' criterion asks for.
Cite this claim
Gary Marcus, “Driverless cars that are not actually reliable can be easily fooled.” (said 20 September 2019). Verdict: resolved true. Reliability API, claim c_0b47e96406f5, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_0b47e96406f5
Claims without a verdict
Is a verdict here wrong, or do you speak for Gary Marcus? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.