ClaimsMark Zuckerberg

“when we go from Llama 4 to Llama 4.1 when we have that, we expect that just -- the models are inherently pretty general.”

Mark Zuckerberg, Meta CEO, answering analyst on call 30 July 2025 Meta Q2 2025 Results Conference Call (Meta Investor Relations)

Prediction AI capabilities

Meta expects its updated models, such as Llama 4.1, to be generally better since the models are inherently general.

Unresolvable The public record could not settle it.

Prediction: Statements about events outside the person's control, checked once they fell due: did they come true?

The second judge would not resolve this claim; the verdict shown is the first judge's.

Said for an organisation they lead or work for; it counts on both records.

What would count as true or false

Judge at 2026-07-30, one year after the statement. The prediction is that a Llama 4 update (Llama 4.1 or an equivalent successor) would be generally better across tasks, because the models are general-purpose. True: Meta released Llama 4.1 or an equivalent successor, and benchmarks (Meta's model card plus independent evaluations) show broad improvement over Llama 4 across most standard task categories. Mostly true: it was released and improved on most categories, with a few regressions. Mixed: it was released, but gains were confined to roughly half of the categories, with others flat or worse. Mostly false: it was released but improved only narrowly; or Meta publicly dropped Llama 4.1 and the Llama 4 line in favour of different models, so the expected update never arrived. False: the release performed generally worse than Llama 4.

Set before the research began.

Evidence (4)

  1. E1 Llama 4 vs. Qwen 3.5 vs. DeepSeek V4: Which Open-Source Model for Local Enterprise AI? (Q4 2026 Update) WZ-IT · 1 May 2026

    “Llama 4 has not received new weights since April 2025; the Llama 4 models on Hugging Face date from the release on 5 April 2025.”
  2. E2 Llama 5: Meta's Return to the Frontier Swfte · 30 June 2026

    “Meta released Llama 5 on June 30, 2026, and for the first time in a while the release matters beyond the open-source crowd.”
  3. E3 Llama 5: Meta's Return to the Frontier Swfte · 30 June 2026

    “The comparison that tells the story is the last two rows. Llama 5 gains more than six points of MMLU-Pro and eight points of SWE-bench Verified over Llama 4 Maverick, while widening language coverage from a dozen to more than forty.”
  4. E4 The Future of Meta Superintelligence: A 1 Year Progress Update SemiAnalysis · 9 July 2026

    “Muse Spark, despite also being closed source, lagged both DeepSeek v4 Pro and Kimi K2.6—open source models released around the same time—on most benchmarks.”

Reasoning

E2 and E3 report that Meta released Llama 5 and that it improved over Llama 4 Maverick on MMLU-Pro, SWE-bench Verified and language coverage, but no evidence item shows improvement across most standard task categories or includes a Meta model card. E1 and E4 do not establish whether Llama 4.1 appeared or whether Meta dropped the Llama 4 line, so the criteria cannot be applied.

Cite this claim

Mark Zuckerberg, “Meta expects its updated models, such as Llama 4.1, to be generally better since the models are inherently general.” (said 30 July 2025). Verdict: unresolvable. Reliability API, claim c_634af471dfbf, method 0.1.0+3f84d14d, dataset release v1.1.2. https://epistacklabs.com/claims/c_634af471dfbf

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Mark Zuckerberg, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More prediction claims by Mark Zuckerberg

  1. Mixed Prediction 10 January 2025
    “it will also mean that we will dramatically reduce the amount of people whose accounts were taking off for a mistake, which is just a terrible experience.”

    Requiring more confidence for takedowns will dramatically reduce the number of people whose Meta accounts are removed by mistake.

  2. Mostly true Prediction 10 January 2025
    “changing the content filters to have to require higher confidence and precision is actually going to be the thing that reduces the vast majority of the censorship mistakes that we make.”

    Changing Meta's content filters to require higher confidence and precision will reduce the vast majority of Meta's censorship mistakes.

  3. Resolved true Prediction 18 April 2024
    “This is only a matter of time but it's not going to be next year.”

    A 1GW data center will be built eventually, but not in 2025 (next year).

  4. Mostly true Prediction 28 September 2023
    “I think Quest 3 is going to be the first device like this that millions of people are going to get that’s mixed reality.”

    Zuckerberg said he thinks Quest 3 is going to be the first mixed reality device that millions of people get.

All of them

Verdicts are made automatically; how verdicts are made.