Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
70 61 80 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
46 33 59 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
53 43 64 -
Guidance
A company's own figures for its results over a period, checked against what it then reported.
44 24 66
All types combined: 58 (likely 52 to 63, high confidence), from 94 claims: 35 factual claims, 21 predictions, 33 promises, 5 guidance claims. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Elon Musk's claims
21 claims
“The open models only lack what may be a year behind the closed models.”
Elon Musk, interviewee at Davos 27 January 2026 Transcript: Elon Musk at Davos World Economic Forum, Jan. 2026 (What's Up Tesla)
Open AI models may be about a year behind closed AI models.
Mostly false False in substance, right in a detail.
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
The claim, hedged with 'may be', is that the best open-weight AI models were about a year behind the best closed models as of January 2026. TRUE: credible benchmark-based estimates (for example Epoch AI, Artificial Analysis, LMArena) put the lag at roughly 9 to 15 months. MOSTLY TRUE: estimates put it at roughly 6 to 9 or 15 to 18 months. MIXED: credible estimates disagree widely, with some near a year and others far from it. MOSTLY FALSE: estimates put the gap under 6 months or between 18 and 30 months. FALSE: open models were at parity with or ahead of closed models, or more than 2.5 years behind.
Evidence
- Open models lag state-of-the-art closed models by 4 months Epoch AI · 29 May 2026
“Since January 2026, the most capable open-weight models have lagged frontier closed models by an average of four months in the Epoch Capabilities Index (ECI), our aggregate measure of model capability.”
- Open models lag state-of-the-art closed models by 4 months Epoch AI · 29 May 2026
“This gap between open and closed models is slightly larger than the one we identified in our October 2025 Data Insight, which found that open models lagged by an average of three months between January 2023 and October 2025.”
- Open vs. closed AI: How behind are open models? Samaritan Research · 9 June 2023
“In terms of benchmark performance, the best open large language models (LLMs) have lagged the best closed LLMs by 5 to 22 months.”
- Technical Performance Stanford HAI, AI Index 2026
“As of March 2026, the top closed model leads the top open model by 3.3%, up from 0.5% in August 2024.”
Reasoning
Epoch AI estimates that since January 2026, the most capable open-weight models have lagged frontier closed models by an average of four months on its Epoch Capabilities Index [E1]. Its earlier analysis put the average lag at three months for January 2023 to October 2025 [E2]. Both figures fall in the criteria's 'under 6 months' band, not near a year. The Stanford AI Index gives only a percentage gap between the top closed and top open model, not a time lag [E4], and the 2023 Samaritan estimate of a 5 to 22 month lag predates January 2026 [E3].
Cite this claim
Elon Musk, “Open AI models may be about a year behind closed AI models.” (said 27 January 2026). Verdict: mostly false. Reliability API, claim c_0f5d6334304b, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_0f5d6334304b
Claims without a verdict
Is a verdict here wrong, or do you speak for Elon Musk? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.