Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
76 69 82 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
56 42 70 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 4 promises resolved, 5 needed for a score.
All types combined: 72 (likely 66 to 78, high confidence), from 93 claims: 76 factual claims, 17 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Dario Amodei's claims
12 claims
“For almost a decade now, we’ve had self-driving cars that are 99.9% safe.”
Dario Amodei, OpenAI researcher, interview answer 21 July 2017 Dario Amodei on OpenAI and how AI will change the world for good and ill (80,000 Hours)
For almost a decade before 2017, self-driving cars have existed that are 99.9% safe.
Mixed Partly true and partly false in roughly equal measure.
What would count as true or false
Judge as of 2017-07-21. The claim is that self-driving cars that were '99.9% safe' had existed since about 2007–2008. True: evidence shows autonomous vehicles from about 2007–2009 (e.g. DARPA Urban Challenge entrants, early Google self-driving prototypes) achieved a safety or reliability level reasonably described as 99.9%, such as completing about 99.9% of driving situations or miles without failure or intervention. Mostly true: such systems existed from slightly later (e.g. 2009–2010), or the 99.9% figure is a reasonable loose characterisation of the reliability data of the time. Mixed: capable prototypes existed for about that period, but no metric supports a 99.9% figure. Mostly false: the figure distorts a narrow result (e.g. one closed-course demonstration) into a general claim, or such systems date only from much later. False: evidence shows no self-driving cars of that era approached that reliability.
Evidence
- DARPA Urban Challenge | DARPA DARPA (U.S. Defense Advanced Research Projects Agency) · 2 January 2007
“At 1:43 pm, Boss, the entry of the Carnegie Mellon Team, Tartan Racing, crossed the finish line first with a run time of just over four hours.”
- The MIT – Cornell Collision and Why It Happened MIT DSpace (Springer Tracts in Advanced Robotics, The DARPA Urban Challenge) · November 2009
“one of the first well-documented collisions between two full-size autonomous vehicles”
- Where to? A History of Autonomous Vehicles Computer History Museum · 8 May 2014
“The first year’s crop of entrants failed miserably, traveling barely a few miles before crashing.”
- Where to? A History of Autonomous Vehicles Computer History Museum · 8 May 2014
“Google’s system has guided a fleet of Prius and Lexus vehicles over half a million miles without causing any accidents, and the firm is a leading advocate for fully self-driving cars.”
Reasoning
E1 shows that capable autonomous vehicles existed by the 2007 DARPA Urban Challenge, where Carnegie Mellon's Boss finished first after a run of about four hours. E4 reports that Google's fleet had driven over half a million miles without causing accidents by 2014. However, E2 documents a collision between two autonomous vehicles in the DARPA Urban Challenge, and none of the evidence gives a metric that supports a figure of 99.9% for systems from about 2007–2008. This fits the "mixed" criterion: capable prototypes existed for about that period, but no metric supports the 99.9% figure.
Cite this claim
Dario Amodei, “For almost a decade before 2017, self-driving cars have existed that are 99.9% safe.” (said 21 July 2017). Verdict: mixed. Reliability API, claim c_91363172d61f, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_91363172d61f
Claims without a verdict
- Unresolvable 157
- Not yet due 40
- Own records only 43
- Not researched 134
- Not checkable 864
Is a verdict here wrong, or do you speak for Dario Amodei? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.