| Not checkable |
Not checkable |
28 Feb 2024 |
So I think we are going to need some automated testing.
Not checkable · 28 Feb 2024 |
|
| Own records only |
Factual |
28 Feb 2024 |
Google DeepMind devotes about half its effort to scaling and half to inventing next architectures and algorithms.
Factual · 28 Feb 2024 |
Their own work or organisation |
| Not checkable |
Not checkable |
28 Feb 2024 |
That’s what I think true multimodality is.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
I’m very optimistic about that.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
I think we’re still in the early days of those kinds of systems being at risk.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
You don’t want to be live A/B testing out in the world with these very consequential systems because unintended consequences may be quite…
Not checkable · 28 Feb 2024 |
|
| Own records only |
Factual |
28 Feb 2024 |
Hassabis said that "we" have a lot of processes in place to make sure that only people who need access have access.
Factual · 28 Feb 2024 |
AI safety and alignment |
| Not checkable |
Not checkable |
28 Feb 2024 |
I think that maybe in the next three, four, five years, we would also want air gaps and various other things that are known in the security…
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
I think no one knows.
Not checkable · 28 Feb 2024 |
|
| Mostly true |
Factual |
28 Feb 2024 |
DeepMind has always bet on generality and learning as the core of its techniques, focusing on reinforcement learning, search and deep learning.
Factual · 28 Feb 2024 |
Their own work or organisation |
| Not checkable |
Not checkable |
28 Feb 2024 |
The brain is an existence proof that general intelligence is possible at all.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
One order of magnitude is probably about the maximum that you want to do between each era.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
In a way, I look at the large models today and I think they’re almost unreasonably effective for what they are.
Not checkable · 28 Feb 2024 |
|
| Mostly true |
Factual |
28 Feb 2024 |
Demis Hassabis thinks human brains plan moves differently from AlphaGo because brains are not built for Monte Carlo tree search.
Factual · 28 Feb 2024 |
Science and research methods |
| Unresolvable |
Prediction |
28 Feb 2024 |
Self-play ideas could be used to automatically test boundary conditions of new AI systems.
Prediction · 28 Feb 2024 |
AI safety and alignment |
| Not checkable |
Not checkable |
28 Feb 2024 |
It’s been fantastic actually, over the last year.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
I think we’ve got to push scaling as hard as we can and that’s what we’re doing here.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
It is more challenging because of the data problem.
Not checkable · 28 Feb 2024 |
|
| Unresolvable |
Prediction |
28 Feb 2024 |
Large predictive world models are a necessary but probably insufficient component of an AGI system.
Prediction · 28 Feb 2024 |
AI timelines and forecasting |
| Not checkable |
Not checkable |
28 Feb 2024 |
I haven’t heard a compelling, clear answer to that from proponents of just open sourcing everything.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
So that’s very useful already for many of the problems we deal with today, but not the most high-level creative problems.
Not checkable · 28 Feb 2024 |
|
| Research failed |
Factual |
28 Feb 2024 |
Early signs show large models becoming transferable to robotics.
Factual · 28 Feb 2024 |
AI capabilities |
| Not researched |
Factual |
28 Feb 2024 |
Since DeepMind's founding, it has said that it does not have to wait for AGI to bring incredible benefits to the world.
Factual · 28 Feb 2024 |
Their own work or organisation |
| Mostly true |
Factual |
28 Feb 2024 |
Demis Hassabis thinks that improving in one specific domain sometimes produces surprising improvement in other domains; as an example, he said that when large models improve at coding, that can improve their general reasoning.
Factual · 28 Feb 2024 |
AI capabilities |
| Unresolvable |
Prediction |
28 Feb 2024 |
Demis Hassabis's bet is that the final AGI system will include large multimodal models, but that they probably won't be enough alone and will need added planning and search on top.
Prediction · 28 Feb 2024 |
AI timelines and forecasting |
| Not researched |
Factual |
28 Feb 2024 |
DeepMind joined forces with Google in 2014.
Factual · 28 Feb 2024 |
Their own work or organisation |
| Unresolvable |
Factual |
28 Feb 2024 |
Google DeepMind has covered the secure-model requirement through world-class cybersecurity and monitoring.
Factual · 28 Feb 2024 |
AI safety and alignment |
| Not checkable |
Not checkable |
28 Feb 2024 |
I think they’re not reliable yet enough to do things like science with them.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
So I think the world’s about to become very exciting in the next few years as we start getting used to the idea of what true multimodality…
Not checkable · 28 Feb 2024 |
|
| Not researched |
Factual |
28 Feb 2024 |
When large AI models improve at coding, their general reasoning can also improve.
Factual · 28 Feb 2024 |
AI capabilities |
| Unresolvable |
Prediction |
28 Feb 2024 |
In Hassabis's opinion, the AI systems around at the time were not dangerous, but in a few years they might have the potential to be.
Prediction · 28 Feb 2024 |
AI safety and alignment |
| Not researched |
Factual |
28 Feb 2024 |
RL agents like AlphaZero and AlphaGo are active learners whose decisions determine what data or experience they get next.
Factual · 28 Feb 2024 |
AI capabilities |
| Not checkable |
Not checkable |
28 Feb 2024 |
I think that suggests there must be high-level common algorithmic themes around how the brain processes the world around us.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
I think we’re just at the beginning of actually understanding how exciting that might be to interact with a full multimodal model system.
Not checkable · 28 Feb 2024 |
|
| Not researched |
Factual |
28 Feb 2024 |
Downstream capabilities such as MMLU or math performance sometimes don't follow from predictable improvements in training loss.
Factual · 28 Feb 2024 |
Science and research methods |
| Not checkable |
Not checkable |
28 Feb 2024 |
That pushes us in very interesting research directions that we think are going to be useful anyway: sampling efficiency and data efficiency…
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
I think this has to be a big collaboration with many stakeholders from civil society, academia, government, etc.
Not checkable · 28 Feb 2024 |
|
| Not yet due |
Prediction |
28 Feb 2024 |
Hassabis said that DeepMind, started in 2010, was conceived as a 20-year project, which points to about 2030, and that he thinks it is on track.
Prediction · 28 Feb 2024 |
AI timelines and forecasting |
| Not checkable |
Not checkable |
28 Feb 2024 |
I think that we’re making great progress with math and things like theorem proving and coding.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
We’re very excited about our progress with things like Gato and RT-2.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
I sometimes like to call it virtual brain analytics.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
The only thing I worry about is that I want to make sure that, as a field, we act responsibly and thoughtfully and scientifically about…
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
As any top scientist will tell you, the hardest part of science is actually asking the right question.
Not checkable · 28 Feb 2024 |
|
| Unresolvable |
Factual |
28 Feb 2024 |
Google DeepMind operates behind Google's firewall and cloud protection, which Hassabis said he thinks is best in class corporately.
Factual · 28 Feb 2024 |
AI safety and alignment |
| Not checkable |
Not checkable |
28 Feb 2024 |
And of course, if we ever want to be good at things like robotics, we’re going to have to understand how to act in the real world.
Not checkable · 28 Feb 2024 |
|
| Mostly true |
Factual |
28 Feb 2024 |
DeepMind and Google Brain previously collaborated project by project, and now collaborate more deeply and broadly.
Factual · 28 Feb 2024 |
Their own work or organisation |
| Not checkable |
Not checkable |
28 Feb 2024 |
So I want us to move away, as a field, from a sort of “move fast and break things attitude”
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
We’re still working on those kinds of systems, but you can imagine we’re trying to build those ideas into our future generations of Gemini…
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
I think we can bring that to bear for security and safety as well.
Not checkable · 28 Feb 2024 |
|
| Mostly true |
Factual |
28 Feb 2024 |
Gemini is the first product of the DeepMind–Google Brain collaboration, and its name implies twins.
Factual · 28 Feb 2024 |
Their own work or organisation |
| Not checkable |
Not checkable |
28 Feb 2024 |
I don’t have prescribed specific numbers to it because I think there’s so many unknowns and uncertainties.
Not checkable · 28 Feb 2024 |
|
| Not researched |
Factual |
28 Feb 2024 |
Google DeepMind is still carrying out robotics research.
Factual · 28 Feb 2024 |
Their own work or organisation |
| Unresolvable |
Prediction |
28 Feb 2024 |
AI systems could become quite good at designing and helping build future versions of themselves.
Prediction · 28 Feb 2024 |
AI capabilities |
| Unresolvable |
Prediction |
28 Feb 2024 |
Hassabis said he thinks Google DeepMind will have the most compute by far of any research lab in 2024.
Prediction · 28 Feb 2024 |
AI compute, hardware and data |
| Mixed |
Factual |
28 Feb 2024 |
Large models of the Gemini and GPT-4 generation generalize to new constructs rather than merely memorizing.
Factual · 28 Feb 2024 |
AI capabilities |
| Resolved true |
Prediction |
28 Feb 2024 |
Hassabis said he thought the next versions of these systems, over the next year to 18 months, might have some contextual understanding of the user's environment through a camera, phone or glasses.
Prediction · 28 Feb 2024 |
AI timelines and forecasting |
| Not checkable |
Not checkable |
28 Feb 2024 |
Then you would ideally pause and really get to the bottom of why it was doing those things before one continued.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
But we also have to make sure these systems are sort of understandable and controllable.
Not checkable · 28 Feb 2024 |
|
| Resolved true |
Factual |
28 Feb 2024 |
Hassabis said he thinks Google DeepMind helped pioneer RLHF.
Factual · 28 Feb 2024 |
AI capabilities |
| Own records only |
Factual |
28 Feb 2024 |
Hassabis said he thinks Gemini 1 used roughly the same amount of compute as was rumored for GPT-4, maybe slightly more, though he said he did not know exactly what was used for GPT-4.
Factual · 28 Feb 2024 |
AI compute, hardware and data |
| Not checkable |
Not checkable |
28 Feb 2024 |
Theoretically, I think there’s no reason why you couldn’t go full AlphaZero-like on it.
Not checkable · 28 Feb 2024 |
|
| Unresolvable |
Prediction |
28 Feb 2024 |
Once AGI exists, it could speed up further AI research, depending on what society uses early AGI systems for.
Prediction · 28 Feb 2024 |
AI timelines and forecasting |
| Not checkable |
Not checkable |
28 Feb 2024 |
So it kind of keeps you honest and pushes you to keep nudging and steering your research directions to make sure they’re on the right path.
Not checkable · 28 Feb 2024 |
|
| Not yet due |
Prediction |
28 Feb 2024 |
Hassabis said he would not be surprised if AGI-like systems existed within the next decade.
Prediction · 28 Feb 2024 |
AI timelines and forecasting |
| Not checkable |
Not checkable |
28 Feb 2024 |
But I think it would need to be fixed before it was deployed generally, for sure, if that was an exposure surface.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
AlphaGo, I think, was a big moment for inspiring many others to think “oh, actually, these systems are ready to scale.”
Not checkable · 28 Feb 2024 |
|
| Not researched |
Factual |
28 Feb 2024 |
Google DeepMind and Google have published thousands of papers, including AlphaFold, transformers and AlphaGo.
Factual · 28 Feb 2024 |
Their own work or organisation |
| Not checkable |
Not checkable |
28 Feb 2024 |
I think the other reason from the point of view of AGI specifically is that it battle tests your ideas.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
My personal passion especially has been AI for science and health.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
That’s why I think about things like deception as being quite root node traits that you don’t want.
Not checkable · 28 Feb 2024 |
|
| Unresolvable |
Prediction |
28 Feb 2024 |
Demis Hassabis said he thinks "our systems" are going to start to understand the physics of the real world better.
Prediction · 28 Feb 2024 |
AI capabilities |
| Not checkable |
Not checkable |
28 Feb 2024 |
We thought that was the sort of failure mode of the efforts to build AI in the 90s in places like MIT.
Not checkable · 28 Feb 2024 |
|
| Not researched |
Factual |
28 Feb 2024 |
AlphaZero and AlphaGo may look at around tens of thousands of possible positions to decide their next move.
Factual · 28 Feb 2024 |
AI capabilities |
| Not checkable |
Not checkable |
28 Feb 2024 |
I think that’s a super promising direction.
Not checkable · 28 Feb 2024 |
|
| Not checkable |
Not checkable |
28 Feb 2024 |
It’s a little bit more chaotic because there’s so many more things going on, and there’s so much VC money going into it, and everyone’s…
Not checkable · 28 Feb 2024 |
|
| Resolved true |
Promise |
28 Feb 2024 |
Google DeepMind will start publishing its safety checks and capability-based safeguards, having already internal checks and balances.
Promise · 28 Feb 2024 |
AI policy and governance |
| Not researched |
Factual |
28 Feb 2024 |
Scaling laws require scaling up hyperparameters and new innovations at each new scale, not just repeating the same recipe.
Factual · 28 Feb 2024 |
Science and research methods |
| Not checkable |
Not checkable |
28 Feb 2024 |
For me, yes, it’s already priced into my world model of how things were going to go, at least from the technology side.
Not checkable · 28 Feb 2024 |
|
| Mostly true |
Promise |
20 Apr 2023 |
Google DeepMind is creating a new Scientific Board, led by Koray Kavukcuoglu with representatives from across the orgs, to oversee research progress and direction.
Promise · 20 Apr 2023 |
Their own work or organisation |
| Unresolvable |
Prediction |
20 Apr 2023 |
In the coming years AI, and ultimately AGI, has the potential to drive one of the greatest social, economic and scientific transformations in history.
Prediction · 20 Apr 2023 |
AI timelines and forecasting |
| Resolved true |
Factual |
20 Apr 2023 |
Zoubin Ghahramani will join the Google DeepMind research leadership team reporting to Koray Kavukcuoglu.
Factual · 20 Apr 2023 |
Their own work or organisation |
| Own records only |
Promise |
20 Apr 2023 |
Jeff, Koray, Zoubin, Shane and Demis Hassabis will finalise the composition of the new Google DeepMind Scientific Board in the coming days.
Promise · 20 Apr 2023 |
Their own work or organisation |
| Resolved true |
Factual |
20 Apr 2023 |
Google DeepMind brings together DeepMind and Brain AI talent with Google's computing power, infrastructure and resources.
Factual · 20 Apr 2023 |
Their own work or organisation |
| Unresolvable |
Prediction |
20 Apr 2023 |
The work of the combined Google DeepMind unit will create the next wave of world-changing breakthroughs.
Prediction · 20 Apr 2023 |
AI timelines and forecasting |
| Not checkable |
Not checkable |
20 Apr 2023 |
For that, we need to work with greater speed, stronger collaboration and execution, and to simplify the way we make decisions to focus on…
Not checkable · 20 Apr 2023 |
|
| Resolved true |
Factual |
20 Apr 2023 |
On 20 April 2023 Sundar Pichai announced that DeepMind and Google Research's Brain team would join as a single unit called Google DeepMind.
Factual · 20 Apr 2023 |
Their own work or organisation |
| Not checkable |
Not checkable |
20 Apr 2023 |
we will be working hard to provide clarity for everyone as rapidly as possible.
Not checkable · 20 Apr 2023 |
|
| Not checkable |
Not checkable |
20 Apr 2023 |
we have a real opportunity to deliver AI research and products that dramatically improve the lives of billions of people, transform…
Not checkable · 20 Apr 2023 |
|
| Not checkable |
Not checkable |
20 Apr 2023 |
I’m thrilled to be on this journey with you and look forward to seeing everyone soon.
Not checkable · 20 Apr 2023 |
|
| Not checkable |
Not checkable |
20 Apr 2023 |
Now, we live in a time in which AI research and technology is advancing exponentially.
Not checkable · 20 Apr 2023 |
|
| Unresolvable |
Prediction |
20 Apr 2023 |
Combining DeepMind and Brain will accelerate progress towards a world where AI helps solve humanity's biggest challenges.
Prediction · 20 Apr 2023 |
AI timelines and forecasting |
| Mostly true |
Factual |
20 Apr 2023 |
Eli Collins will join Demis Hassabis's leads team at Google DeepMind as VP of Product.
Factual · 20 Apr 2023 |
Field building and careers |
| Not checkable |
Not checkable |
20 Apr 2023 |
Building ever more capable and general AI, safely and responsibly, demands that we solve some of the hardest scientific and engineering…
Not checkable · 20 Apr 2023 |
|
| Mostly true |
Factual |
20 Apr 2023 |
When DeepMind launched in 2010, many people thought general AI was farfetched science fiction decades away.
Factual · 20 Apr 2023 |
Their own work or organisation |
| Mostly true |
Factual |
20 Apr 2023 |
Research advances from the Brain and DeepMind teams, from Deep Reinforcement Learning to Transformers, laid much of the foundations of the current AI industry.
Factual · 20 Apr 2023 |
Their own work or organisation |
| Not checkable |
Not checkable |
20 Apr 2023 |
I’m incredibly excited to be leading this unit and working with all of you to build it.
Not checkable · 20 Apr 2023 |
|
| Own records only |
Factual |
20 Apr 2023 |
Sundar Pichai, Jeff Dean, James Manyika and Demis Hassabis coordinated their efforts over recent months and built a partnership.
Factual · 20 Apr 2023 |
Their own work or organisation |
| Not checkable |
Not checkable |
9 Mar 2023 |
we are thrilled to be building AGI together!
Not checkable · 9 Mar 2023 |
|
| Resolved true |
Factual |
9 Mar 2023 |
Clement (@clmt) joined DeepMind.
Factual · 9 Mar 2023 |
Field building and careers |
| Not checkable |
Not checkable |
9 Mar 2023 |
We've known Clement for a long time, he is one of the most talented people in AI
Not checkable · 9 Mar 2023 |
|