Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
80 74 86 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
Insufficient record: 4 predictions resolved, 5 needed for a score.
-
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
85 74 94 -
Guidance
A company's own figures for its results over a period, checked against what it then reported.
Insufficient record: 0 guidance claims resolved, 5 needed for a score.
All types combined: 81 (likely 76 to 86, high confidence), from 86 claims: 70 factual claims, 16 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Mark Zuckerberg's claims
42 claims
“We have a roadmap of new releases coming that are going to bring multimodality, more multi-linguality, and bigger context windows as well.”
Mark Zuckerberg, Meta CEO 18 April 2024 Mark Zuckerberg - Llama 3, Open Sourcing $10b Models, & Caesar Augustus (Dwarkesh Podcast)
Meta has a roadmap of new Llama releases bringing multimodality, more multilinguality and bigger context windows.
Resolved true The record shows it happened or was so.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
The test is whether Llama releases after 18 April 2024 delivered three features: multimodality (image or other non-text input), more multilinguality (official support for more languages than Llama 3's English focus), and bigger context windows (longer than Llama 3's 8K tokens). Delivery counts when publicly released models, such as Llama 3.1, 3.2 or 4, have these features as documented in Meta's model cards or release announcements. True: all three were delivered in subsequent releases. Mixed: two of the three were delivered. Mostly false: only one was delivered. False: none was delivered, or the roadmap was abandoned without any of them.
Evidence
- Llama 3.1 - 405B, 70B & 8B with multilinguality and long context Hugging Face · 23 July 2024
“All the variants support a context length of 128K tokens and 8 languages, including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai.”
- Announcing Llama 3.1 405B, 70B, and 8B models from Meta in Amazon Bedrock | Amazon Web Services Amazon Web Services · 23 July 2024
“All Llama 3.1 models support a 128K context length (an increase of 120K tokens from Llama 3)”
- llama-models/models/llama3_2/MODEL_CARD.md at main · meta-llama/llama-models GitHub (Meta Llama repository) Own record
“Supported Languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai are officially supported. Llama 3.2 has been trained on a broader collection of languages than these 8 supported languages.”
- Unmatched Performance and Efficiency | Llama 4 Meta (dev.meta.ai) Own record
“All Llama 4 models are designed with native multimodality, leveraging early fusion that allows us to pre-train the model with large amounts of unlabeled text and vision tokens”
Reasoning
Independent launch coverage of Llama 3.1, released after the claim date, says all variants support a 128K-token context length (up from Llama 3's 8K) and eight officially supported languages (E1, E2). Meta's Llama 3.2 model card confirms the eight officially supported languages (E3). Meta's Llama 4 release page says all Llama 4 models are natively multimodal and were pre-trained on text and vision tokens (E4). Under the criteria, a release announcement or model card from Meta counts as documentation, so all three promised features were delivered. There was no deadline, so on_time is null.
Cite this claim
Mark Zuckerberg, “Meta has a roadmap of new Llama releases bringing multimodality, more multilinguality and bigger context windows.” (said 18 April 2024). Verdict: resolved true. Reliability API, claim c_9d661e4a1568, method 0.1.0+3f84d14d. https://epistacklabs.com/claims/c_9d661e4a1568
Claims without a verdict
- Unresolvable 144
- Not yet due 17
- Own records only 41
- Not researched 223
- Not checkable 1,060
Is a verdict here wrong, or do you speak for Mark Zuckerberg? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.