Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
83 77 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
67 49 83 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 1 promise resolved, 5 needed for a score.
All types combined: 81 (likely 76 to 86, high confidence), from 87 claims: 79 factual claims, 8 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Rodney Brooks's claims
39 claims
“The web has provided massive amounts of text for machine learning which has given rise to LLMs.”
Rodney Brooks, blog author 29 September 2024 Tips For Building and Deploying Robots (rodneybrooks.com)
The web has provided massive amounts of text for machine learning, which has given rise to LLMs.
Mostly true True in substance, wrong in a detail.
What would count as true or false
True if documentation of large language models shows that their training data consists mainly of large-scale web text (for example Common Crawl and WebText) and that this data was an essential enabler of LLMs. Mostly true if web text is a major contributor but other sources, such as books and code, are also significant enough that the claim simplifies slightly. Mixed if web data is only one of several equally important factors. Mostly false if web data played only a minor role. False if LLMs did not rely substantially on web text.
Evidence
- Language Models are Few-Shot Learners NeurIPS Proceedings (Advances in Neural Information Processing Systems 33) · 2020
“We also identify some datasets where GPT-3's few-shot learning still struggles, as well as some datasets where GPT-3 faces methodological issues related to training on large web corpora.”
- GPT-3 - Wikipedia Wikipedia · 31 July 2020
“Sixty percent of the weighted pre-training dataset for GPT-3 comes from a filtered version of Common Crawl consisting of 410 billion byte-pair-encoded tokens.”
- Algorithmic bias: sexualized violence against women in GPT-3 models - AI and Ethics Springer (AI and Ethics journal) · 15 January 2025
“Common Crawl was the main contributor within the GPT-3 training dataset, and at the time of writing is the largest non-curated web corpus available”
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher arXiv (DeepMind authors) · 1 April 2018
“We train the Gopher family of models on MassiveText, a collection of large English-language text datasets from multiple sources: web pages, books, news articles, and code.”
- LLaMA: Open and Efficient Foundation Language Models arXiv (Meta AI authors) · 31 January 2026
“Unlike Chinchilla, PaLM, or GPT-3, we only use publicly available data, making our work compatible with open-sourcing, while most existing models rely on data which is either not publicly available or undocumented”
Reasoning
The GPT-3 paper notes the model was trained on large web corpora (E1). Two independent sources say filtered Common Crawl, a web-scraped corpus, made up 60% of GPT-3's weighted pre-training data and was its main contributor (E2, E3). Gopher's MassiveText likewise draws on web pages, but also on books, news and code (E4). Web text was the largest source for GPT-3 (E2, E3), and Gopher also drew on books, news and code (E4), but none of these sources explicitly says web text was the essential enabler, so the claim simplifies slightly.
Cite this claim
Rodney Brooks, “The web has provided massive amounts of text for machine learning, which has given rise to LLMs.” (said 29 September 2024). Verdict: mostly true. Reliability API, claim c_8a9955548599, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_8a9955548599
Claims without a verdict
Is a verdict here wrong, or do you speak for Rodney Brooks? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.