Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
79 72 85 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
80 72 88 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
Insufficient record: 1 promise resolved, 5 needed for a score.
All types combined: 79 (likely 74 to 84, high confidence), from 102 claims: 64 factual claims, 38 predictions. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Gary Marcus's claims
215 claims · page 3 of 3
“So Alpha Ego is an example of that.”
Gary Marcus, podcast guest 14 November 2019 EP25 Gary Marcus on Rebooting AI (The Jim Rutt Show)
AlphaGo is a hybrid system that uses deep learning for pattern recognition and Monte Carlo tree search, a symbolic operation, to search possibilities.
Resolved true The record shows it happened or was so.
What would count as true or false
This is a factual claim judged as of 2019-11-14 against the published description of AlphaGo's architecture. It is true if AlphaGo (as described in Silver et al. 2016 and related DeepMind publications) combines deep neural networks (policy and value networks) with Monte Carlo tree search to explore possible moves. Whether MCTS counts as a 'symbolic' operation is Marcus's characterization. It should be accepted as true if MCTS works by explicit search over a tree of discrete game states, which is a classical (non-neural) search algorithm. Mostly true: the architecture is as described but some minor detail is overstated. Mixed: AlphaGo used MCTS, but it is widely and substantively argued that MCTS is not symbolic in the sense intended, so the 'hybrid' framing is contested. Mostly false: the description fits only some versions of the system, or misstates the role of the components. False: AlphaGo did not use tree search, or used no deep learning.
Evidence
- Mastering the game of Go with deep neural networks and tree search - Nature Nature (Silver et al.) · 27 January 2016
“We also introduce a new search algorithm that combines Monte Carlo simulation with value and policy networks.”
- Mastering the game of Go with deep neural networks and tree search - Nature Nature (Silver et al.) · 27 January 2016
“Here we introduce a new approach to computer Go that uses ‘value networks’ to evaluate board positions and ‘policy networks’ to select moves.”
- AlphaGo Google DeepMind
“We created AlphaGo, an AI system that combines deep neural networks with advanced search algorithms.”
- Mastering the game of Go without human knowledge UCL Discovery (repository record for Silver et al., Nature 2017) · 19 October 2017
“The tree search in AlphaGo evaluated positions and selected moves using deep neural networks.”
Reasoning
The 2016 Nature paper by Silver et al. describes policy and value networks used to select moves and evaluate positions (E2). It also describes a search algorithm that combines Monte Carlo simulation with those networks (E1). The 2017 follow-up paper says AlphaGo's tree search used deep neural networks to evaluate positions and select moves (E4), and DeepMind's overview describes AlphaGo as combining deep neural networks with search algorithms (E3). The criteria say to accept Marcus's "symbolic" label if MCTS is an explicit search over a tree of game states; the cited sources describe AlphaGo as using a tree search that evaluates positions and selects moves, combining Monte Carlo simulation with value and policy networks [E1][E4], so the claim matches the published architecture.
Cite this claim
Gary Marcus, “AlphaGo is a hybrid system that uses deep learning for pattern recognition and Monte Carlo tree search, a symbolic operation, to search possibilities.” (said 14 November 2019). Verdict: resolved true. Reliability API, claim c_f9d0dbb18e39, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_f9d0dbb18e39
Claims without a verdict
Is a verdict here wrong, or do you speak for Gary Marcus? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.