Marcus fully expected GPT-4 to be the shiniest model so far, but said that this does not mean it is a critical step on the optimal path to AI that can be trusted.
Unresolvable The public record could not settle it.
Prediction: Statements about events outside the person's control, checked once they fell due: did they come true?
Reasoning
'Critical step on the optimal path' is a counterfactual, subjective judgment.
Cite this claim
Gary Marcus, “Marcus fully expected GPT-4 to be the shiniest model so far, but said that this does not mean it is a critical step on the optimal path to AI that can be trusted.” (said 25 December 2022). Verdict: unresolvable. Reliability API, claim c_7eaa0c9559d9, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_7eaa0c9559d9
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More prediction claims by Gary Marcus
-
Mostly true
“Some of its advice will be head-scratchingly bad.”
-
Mostly true
“GPT-5 will surely be better, a lot better than GPT-4.”
-
Resolved true
“GPT-5 really is about to drop, no foolin’.”
-
Resolved true
“It will still make a significant number of shake-your-head stupid errors, in ways that are hard to fully predict.”
GPT-5 will still make a significant number of obvious errors that are hard to predict.
-
Mostly true
“Neurosymbolic AI will become much more prominent.”
Verdicts are made automatically; how verdicts are made.