For almost a decade before 2017, self-driving cars have existed that are 99.9% safe.
Mixed Partly true and partly false in roughly equal measure.
Factual: Statements about the present or the past, checked against the record: did they hold up?
What would count as true or false
Judge as of 2017-07-21. The claim is that self-driving cars that were '99.9% safe' had existed since about 2007–2008. True: evidence shows autonomous vehicles from about 2007–2009 (e.g. DARPA Urban Challenge entrants, early Google self-driving prototypes) achieved a safety or reliability level reasonably described as 99.9%, such as completing about 99.9% of driving situations or miles without failure or intervention. Mostly true: such systems existed from slightly later (e.g. 2009–2010), or the 99.9% figure is a reasonable loose characterisation of the reliability data of the time. Mixed: capable prototypes existed for about that period, but no metric supports a 99.9% figure. Mostly false: the figure distorts a narrow result (e.g. one closed-course demonstration) into a general claim, or such systems date only from much later. False: evidence shows no self-driving cars of that era approached that reliability.
Set before the research began.
Evidence (4)
-
E1 DARPA Urban Challenge | DARPA DARPA (U.S. Defense Advanced Research Projects Agency) · 2 January 2007
“At 1:43 pm, Boss, the entry of the Carnegie Mellon Team, Tartan Racing, crossed the finish line first with a run time of just over four hours.”
-
E2 The MIT – Cornell Collision and Why It Happened MIT DSpace (Springer Tracts in Advanced Robotics, The DARPA Urban Challenge) · November 2009
“one of the first well-documented collisions between two full-size autonomous vehicles”
-
E3 Where to? A History of Autonomous Vehicles Computer History Museum · 8 May 2014
“The first year’s crop of entrants failed miserably, traveling barely a few miles before crashing.”
-
E4 Where to? A History of Autonomous Vehicles Computer History Museum · 8 May 2014
“Google’s system has guided a fleet of Prius and Lexus vehicles over half a million miles without causing any accidents, and the firm is a leading advocate for fully self-driving cars.”
Reasoning
E1 shows that capable autonomous vehicles existed by the 2007 DARPA Urban Challenge, where Carnegie Mellon's Boss finished first after a run of about four hours. E4 reports that Google's fleet had driven over half a million miles without causing accidents by 2014. However, E2 documents a collision between two autonomous vehicles in the DARPA Urban Challenge, and none of the evidence gives a metric that supports a figure of 99.9% for systems from about 2007–2008. This fits the "mixed" criterion: capable prototypes existed for about that period, but no metric supports the 99.9% figure.
Cite this claim
Dario Amodei, “For almost a decade before 2017, self-driving cars have existed that are 99.9% safe.” (said 21 July 2017). Verdict: mixed. Reliability API, claim c_91363172d61f, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_91363172d61f
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Dario Amodei
-
Mixed
“It’s easy to dismiss this as a one-off or curiosity, but we’ve repeatedly seen a pattern where AI performance in new intellectual domains goes from weak to superhuman in a matter of a few years.”
-
Mixed
“we were measuring these trends back when models cost $1,000 or $10,000 to train”
Amodei's group measured AI scaling trends when models cost $1,000 or $10,000 to train.
-
Mixed
“a lot of the other reasoning models in the market are trained primarily on math and competition coding,”
-
Mostly true
“I do think AI coding is moving the fastest of all the other areas.”
Amodei said he thinks AI coding is moving the fastest of all the areas of AI.
-
Mostly true
“Because when it knows that it doesn't get any gain out of thinking further, it doesn't think for longer.”
Verdicts are made automatically; how verdicts are made.