Hassabis said he thinks Google DeepMind helped pioneer RLHF.
Resolved true The record shows it happened or was so.
Factual: Statements about the present or the past, checked against the record: did they hold up?
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
The claim is that Google DeepMind (including its predecessor DeepMind) was among those who helped pioneer reinforcement learning from human feedback, not that it was the sole originator. True if DeepMind researchers made foundational early contributions to RLHF, for example as co-authors of the 2017 paper 'Deep reinforcement learning from human preferences' (Christiano et al.) or of other seminal early RLHF work. Mostly true if DeepMind's contribution was real and early but secondary to another lab's. Mixed if DeepMind's early role was minor or disputed. Mostly false if DeepMind's RLHF work came only after the technique was established elsewhere. False if DeepMind had no part in developing RLHF.
Set before the research began.
Evidence (4)
-
E1 Deep Reinforcement Learning from Human Preferences arXiv (Christiano, Leike, Brown, Martic, Legg, Amodei)
“Jan Leike DeepMind leike@google.com Tom B Brown nottombrown@gmail.com Miljan Martic DeepMind miljanm@google.com Shane Legg DeepMind legg@google.com”
-
E2 Learning through human feedback DeepMind · 12 June 2017 Own record
“This research was done as part of an ongoing collaboration between Jan Leike, Miljan Martic, and Shane Legg at DeepMind and Paul Christiano, Dario Amodei, and Tom Brown at OpenAI.”
-
E3 A Tiny History of RLHF | RLHF and Post-Training Book by Nathan Lambert RLHF and Post-Training Book (Nathan Lambert)
“One of the first papers with an approach similar to modern RLHF was TAMER. TAMER: Training an Agent Manually via Evaluative Reinforcement proposed an approach in which humans iteratively scored an agent’s actions to learn a reward model, which was used to learn the action policy [4].”
-
E4 A Survey of Reinforcement Learning from Human Feedback arXiv
“Comparisons were first used for direct policy learning (Akrour et al., 2011; Cheng et al., 2011), but were later extended to the reward-learning setting (Wirth et al., 2016; Christiano et al., 2017).”
Reasoning
The 2017 paper 'Deep Reinforcement Learning from Human Preferences' lists three DeepMind-affiliated co-authors: Jan Leike, Miljan Martic and Shane Legg (E1). DeepMind's 2017 blog post describes the work as a collaboration between DeepMind and OpenAI (E2). The criteria name co-authorship of this paper as an example of a foundational early contribution. Earlier preference-based methods existed (E3, E4), but the claim is only that DeepMind helped pioneer RLHF, not that it was the sole originator, so the claim resolves true.
Cite this claim
Demis Hassabis, “Hassabis said he thinks Google DeepMind helped pioneer RLHF.” (said 28 February 2024). Verdict: resolved true. Reliability API, claim c_9e8fdd0460e3, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_9e8fdd0460e3
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Demis Hassabis
-
Mostly true
“Performs better than 3.1 Pro on coding & agentic tasks”
Gemini 3.5 Flash performs better than Gemini 3.1 Pro on coding and agentic tasks.
-
Mostly true
“It can take photos, video & audio and build entirely new scenes.”
Gemini Omni can take photos, video and audio and build entirely new scenes.
-
Mostly true
“I didn’t feel like that was proper AI because that system, let’s take Deep Blue, okay, it’s world champion level at chess, at chess, but it can’t do anything else.”
Deep Blue was world-champion level at chess but could not do anything else.
-
Resolved true
“And it uses AI to actually digitally watermark any generated image.”
-
Mostly true
“They still can't really yet go beyond asking a new novel question or a new novel conjecture or coming up with a new hypothesis that has not been thought of before.”
Verdicts are made automatically; how verdicts are made.