Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
78 72 83 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
64 43 83 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 0 promises resolved, 5 needed for a score.
All types combined: 77 (likely 71 to 82, high confidence), from 84 claims: 79 factual claims, 5 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Yann LeCun's claims
55 claims
“Probably not. No. But it can potentially recognize people among hundreds of millions.”
Yann LeCun, Facebook AI director, interviewee 18 February 2015 Facebook AI Director Yann LeCun on His Quest to Unleash Deep Learning (IEEE Spectrum)
The system would probably not be more accurate, but it can potentially recognize people among hundreds of millions.
Mostly true True in substance, wrong in a detail.
The second judge would not resolve this claim; the verdict shown is the first judge's.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Concerns Facebook's face-recognition system (DeepFace) as of 2015-02-18. True if that system was not more accurate than humans (or than the comparison in the question) at face verification, and was able, or plausibly able, to identify people across a population of hundreds of millions (for example, Facebook's user base). Mostly true if both parts broadly hold with a small qualification (for example, accuracy roughly equal to humans). Mixed if one part holds and the other does not. Mostly false if the system was clearly more accurate and the scale claim is only loosely supported. False if both parts are contradicted.
Evidence
- Facebook's facial recognition software is now as accurate as the human brain, but what now? ExtremeTech · 19 March 2014
“Humans, performing the same verification test on the same set of photos, scored slightly higher at 97.53%.”
- [PDF] Closing the Gap to Human-Level Performance in Face Verification Facebook AI Research (DeepFace paper, CVPR 2014; authors Taigman, Yang, Ranzato, Wolf) · 2014 Own record
“Our method reaches an accuracy of 97.35% on the Labeled Faces in the Wild (LFW) dataset, reducing the error of the current state of the art by more than 27%, closely approaching human-level performance.”
- [PDF] Closing the Gap to Human-Level Performance in Face Verification Facebook AI Research (DeepFace paper, CVPR 2014; authors Taigman, Yang, Ranzato, Wolf) · 2014 Own record
“The error rate rises to 8.7% for 4K persons with 4.4M images, showing the network scales comfortably to more persons.”
- Facebook’s new algorithm can recognize you even if your face is hidden | Fortune Fortune · 23 June 2015
“Using its existing algorithms, Facebook has said that it can recognize you with 98% accuracy—in fact, its software can identify you in one picture out of 800 million in less than 5 seconds.”
Reasoning
The DeepFace paper reports 97.35% accuracy on LFW, described as closely approaching human-level performance (E2), and ExtremeTech reports humans scored slightly higher at 97.53% on the same test (E1), so the system was not more accurate than humans, though nearly equal. On scale, the paper shows the network scaling to about 4,000 persons (E3), and Fortune reports Facebook's statement that its software could identify a person in one picture out of 800 million (E4), making recognition among hundreds of millions plausible. The scale support rests partly on Facebook's own statement reported after the claim date, so the verdict is mostly true.
Cite this claim
Yann LeCun, “The system would probably not be more accurate, but it can potentially recognize people among hundreds of millions.” (said 18 February 2015). Verdict: mostly true. Reliability API, claim c_5e14ac1ed01e, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_5e14ac1ed01e
Claims without a verdict
- Unresolvable 110
- Not yet due 3
- Not researched 309
- Not checkable 669
Is a verdict here wrong, or do you speak for Yann LeCun? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.