LeCun said Facebook AI had created and open sourced SEER, a billion-parameter self-supervised computer vision model that he described as proven to work efficiently with complex, high-dimensional image data.
Mostly true True in substance, wrong in a detail.
Factual: Statements about the present or the past, checked against the record: did they hold up?
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
Judge as of 2021-03-04. Tested parts: Facebook AI created SEER; it is a self-supervised computer-vision model; it has about one billion parameters; it was open sourced by the date of the statement; it handles complex, high-dimensional image data. True: Facebook AI's SEER announcement or paper (around March 2021) shows a self-supervised CV model of about 1 billion parameters (about 1.3B counts) and a public code or model release (e.g. the VISSL library or released weights) by 2021-03-04. Mostly true: everything holds but the open-source release was of the training code or library rather than the full model, or had a small timing gap. Mixed: the model existed as described but nothing related had been open sourced by that date. Mostly false: SEER existed but differs in a key qualifier (not self-supervised, far from a billion parameters). False: no such Facebook model existed. The "works efficiently" part counts as met if the published results show strong performance on large image datasets such as ImageNet or Instagram images.
Set before the research began.
Evidence (4)
-
E1 Facebook's new computer vision model achieves state-of-the-art performance by learning from random images VentureBeat · 4 March 2021
“Facebook claims to have made a step toward this with a computer vision model called SEER, which stands for SElf-supERvised. SEER contains a billion parameters and can learn from any random group of images on the internet without the need for curation or annotation.”
-
E2 Facebook's new computer vision model achieves state-of-the-art performance by learning from random images VentureBeat · 4 March 2021
“VISSL, which Facebook is open-sourcing today, allows for self-supervised training with a variety of modern machine learning methods.”
-
E3 Facebook's new computer vision model achieves state-of-the-art performance by learning from random images VentureBeat · 4 March 2021
“That said, Facebook doesn't plan to share the images or the SEER model itself, in part because the model might contain unintended biases.”
-
E4 Facebook's new computer vision model achieves state-of-the-art performance by learning from random images VentureBeat · 4 March 2021
“When trained with just 10% of the examples in the popular ImageNet dataset, SEER still managed to hit 77.9% accuracy.”
Reasoning
An independent report from the announcement date says Facebook built SEER, a self-supervised computer vision model with a billion parameters (E1). It also reports strong ImageNet results, 77.9% accuracy when trained on only 10% of the labelled examples (E4). That meets the "works efficiently" part. However, what was open-sourced that day was the VISSL training library, and Facebook did not plan to release the SEER model itself (E2, E3). The criteria call this case mostly true.
Cite this claim
Yann LeCun, “LeCun said Facebook AI had created and open sourced SEER, a billion-parameter self-supervised computer vision model that he described as proven to work efficiently with complex, high-dimensional image data.” (said 4 March 2021). Verdict: mostly true. Reliability API, claim c_66ec97f306d7, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_66ec97f306d7
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Yann LeCun
-
Mostly true
“For starters, transformers are equivariant to permutations.”
Transformers are equivariant to permutations, as ConvNets are equivariant to translations.
-
Mostly true
“If it were the case, we would have AI systems that could teach themselves to drive a car in 20 hours of practice, like any 17 year-old.”
-
Mostly true
“The architecture is good, the architecture of the encoder is good, but the fact that you train the system to reconstruct images does not lead it to produce to long, good generic features of images.”
-
Mostly true
“LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world.”
-
Mostly true
“No, there’s one thing that autoregressive LLMs or that LLMs in general, not just the autoregressive one, but including the bird style bidirectional ones, are exploiting and its self supervised…”
Verdicts are made automatically; how verdicts are made.