Nobody programmed world knowledge into large language models; they appear to acquire it implicitly from patterns in hundreds of billions of words of text.
Not researched Checkable, but outside the sample that was researched.
Factual: Statements about the present or the past, checked against the record: did they hold up?
Cite this claim
Steven Pinker, “Nobody programmed world knowledge into large language models; they appear to acquire it implicitly from patterns in hundreds of billions of words of text.” (said 2023). Verdict: not researched. Reliability API, claim c_d9fc450affcb, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_d9fc450affcb
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Steven Pinker
-
Mostly true
“A major fact about language, known for decades, is that people don’t blurt out what they mean”
-
Mostly true
“Computers have always been better at some of the things that humans do, otherwise we never would have adopted them”
-
Resolved true
“then it is very much unlike AlphaGo, with this closed universe governed by fixed rules.”
AlphaGo operated in a closed universe governed by fixed rules, unlike the open-loop real world.
-
Mostly true
“The capabilities of LLMs trained on gargantuan datasets are more general than I (and almost everyone else) would have guessed at the time.”
-
Mostly true
“There are some features in large language models that actually implicitly build in some of the insight of linguistics.”
Verdicts are made automatically; how verdicts are made.