Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
78 72 83 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
64 43 83 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 0 promises resolved, 5 needed for a score.
All types combined: 77 (likely 71 to 82, high confidence), from 84 claims: 79 factual claims, 5 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Yann LeCun's claims
55 claims
“And we’ve deployed XLM-R, a model that leverages our RoBERTa architecture, to improve our hate speech classifiers in multiple languages across Facebook and Instagram.”
Meta AI blog post, byline VP and Chief AI Scientist (LeCun) 4 March 2021 Self-supervised learning: The dark matter of intelligence (Meta AI)
Facebook has deployed XLM-R, a model based on its RoBERTa architecture, to improve hate speech classifiers in multiple languages across Facebook and Instagram.
Mostly true True in substance, wrong in a detail.
The second judge would not resolve this claim; the verdict shown is the first judge's.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
True if Facebook/Meta records or credible reports from on or before 2021-03-04 show that XLM-R, a model built on RoBERTa, had been deployed in production to improve hate speech classifiers in more than one language on both Facebook and Instagram. Mostly true if it was deployed for hate speech in multiple languages but a minor detail differs, such as the deployment being confirmed on only one platform or XLM-R being described somewhat differently in relation to RoBERTa. Mixed if it was deployed but for a materially different purpose or in only one language. Mostly false if XLM-R was only tested or announced as planned for this use, not deployed, by that date. False if there is evidence it was not deployed for hate speech classification at all.
Evidence
- Community Standards Enforcement Report, Fourth Quarter 2020 Meta (about.fb.com) · 11 February 2021
“26.9 million pieces of hate speech content, up from 22.1 million in Q3 due in part to updates in our technology in Arabic, Spanish and Portuguese”
- facebook, inc. community standards enforcement report, q4 ... Meta (about.fb.com, press call transcript) · 11 February 2021
“We have a new architecture called Linformer, which we put into production last October that allows AI models to train on larger and more complex pieces of text.”
- Facebook details AI advances in catching misinformation and hate speech | TechCrunch TechCrunch · 19 November 2020
“One improvement is in the language analysis systems Facebook employs to detect things like hate speech.”
- FACEBOOK, INC. COMMUNITY STANDARDS ENFORCEMENT REPORT, Q4 2021 (heading as printed on the page; the page has no separate title) Facebook, Inc. · 11 February 2021 Own record
“We also saw progress in the way our systems operate in multiple languages thanks largely to improvements in Spanish and Arabic, the number of pieces of hate speech content that were taken down increased from 26.9 million up from 22.1 million in the previous quarter.”
- [PDF] FACEBOOK, INC. November 19, 2020 11:30 a.m. ET Operator Facebook, Inc. (Community Standards Enforcement Report Q3 2020 call transcript) · 19 November 2020 Own record
“In November of 2019, we announced new state of the art research, XLM-R, and a year later, it's in production helping us detect harmful content in multiple languages across Facebook and Instagram.”
- Facebook hopes its new AI moderation tools can further counter hate speech - Engadget Engadget · 19 November 2020
“In addition to Facebook's existing array of tools including semi-supervised self-learning models and XLM-R, the company unveiled and implemented a pair of new technologies.”
- AI gets better every day. Here’s what that means for stopping hate speech Meta AI (Facebook AI blog) · 11 February 2021 Own record
“Thanks largely to improvements in the way our AI tools can detect violating content in widely spoken languages like Spanish and Arabic, the amount of hate speech content that was taken down reached 26.9 million, up from 22.1 million in the previous quarter.”
Reasoning
Facebook's official transcript of its November 2020 Community Standards Enforcement Report call says XLM-R was "in production helping us detect harmful content in multiple languages across Facebook and Instagram" (E5). Engadget, an independent outlet, reported the same day that XLM-R was among Facebook's existing tools for countering hate speech (E6). Both items are dated before 2021-03-04. However, E5 says "harmful content" rather than hate speech classifiers specifically, and none of the evidence describes XLM-R's link to RoBERTa, so minor details are not fully confirmed.
Cite this claim
Yann LeCun, “Facebook has deployed XLM-R, a model based on its RoBERTa architecture, to improve hate speech classifiers in multiple languages across Facebook and Instagram.” (said 4 March 2021). Verdict: mostly true. Reliability API, claim c_433dd1ad9a5c, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_433dd1ad9a5c
Claims without a verdict
- Unresolvable 110
- Not yet due 3
- Not researched 309
- Not checkable 669
Is a verdict here wrong, or do you speak for Yann LeCun? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.