Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
83 77 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
67 49 83 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 1 promise resolved, 5 needed for a score.
All types combined: 81 (likely 76 to 86, high confidence), from 87 claims: 79 factual claims, 8 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Rodney Brooks's claims
42 claims
“Computer vision, even 3-D vision, is not completely accurate.”
Rodney Brooks, blog author 15 July 2018 [FoR&AI] Steps Toward Super Intelligence I, How We Got Here (rodneybrooks.com)
Computer vision, even 3-D vision, is not completely accurate.
Resolved true The record shows it happened or was so.
What would count as true or false
Judge as of July 2018. True: the evidence shows that computer vision systems, including 3-D vision such as stereo, depth sensing or lidar-based perception, had non-zero error rates in practice and on benchmarks, i.e. no system was perfectly accurate. Mostly true: this holds in general, but the evidence shows some narrow, controlled 3-D vision tasks at effectively perfect accuracy. Mixed: the evidence is split on whether 3-D vision in particular was accurate enough to count as complete in common uses. Mostly false: credible sources show that 2-D or 3-D vision had in fact been made completely accurate in broad classes of tasks. False: computer vision, including 3-D vision, was generally shown to be completely accurate.
Evidence
- Error Analysis in a Stereo Vision-Based Pedestrian Detection Sensor for Collision Avoidance Applications PMC (National Library of Medicine), peer-reviewed journal article · 13 April 2010
“For example, at 15 m the depth error is about ±1.5 m, at 10 m is about ±0.7 m and at 5 m is lower than ±0.2 m.”
- Obstacle Classification and 3D Measurement in Unstructured Environments Based on ToF Cameras PMC (National Library of Medicine), peer-reviewed journal article · 14 February 2014
“As shown in Table 10, the recognition accuracy of obstacles reaches 93%.”
- Obstacle Classification and 3D Measurement in Unstructured Environments Based on ToF Cameras PMC (National Library of Medicine), peer-reviewed journal article · 14 February 2014
“Secondly, the relative error illustrated in Tables 2, 3, 4, 5 and 6 is usually lower than 5% except for some special overlapped or very irregular cases in Tables 2 and 3.”
- Google develops computer vision accurate enough to solve its own CAPTCHAs The Verge · 16 April 2014
“Despite being near perfect when it comes to CAPTCHAs — a feat that plenty of humans can’t even manage — the new system’s analysis of Street View imagery isn’t quite as accurate, correctly identifying the text just over 90 percent of the time.”
Reasoning
Peer-reviewed studies from before July 2018 report measurable error in 3-D vision. A stereo-vision pedestrian sensor had depth errors of about ±1.5 m at 15 m [E1]. A time-of-flight camera system reached 93% obstacle recognition accuracy, with relative errors usually below 5% and larger errors in some overlapped or irregular cases [E2, E3]. For 2-D vision, Google's text recognition on Street View imagery was correct just over 90% of the time [E4]. None of the evidence shows a computer vision system that was completely accurate, so the claim is resolved true.
Cite this claim
Rodney Brooks, “Computer vision, even 3-D vision, is not completely accurate.” (said 15 July 2018). Verdict: resolved true. Reliability API, claim c_3b809e3acbf6, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_3b809e3acbf6
Claims without a verdict
Is a verdict here wrong, or do you speak for Rodney Brooks? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.