| Not checkable |
Not checkable |
13 Oct 2025 |
one thing that I found about neural nets is that they’re very powerful but they’re very unevenly powerful.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I think they’ve been winning the talent war recently.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
When people at the major organizations are friends with each other and work to actively collaborate, then that reduces the probability of…
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I think actually that’s the case in any area of machine learning where you’re trying to do original research.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
at the same time no one’s defined what successful work looks like.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I think that there’s a magic of empiricism because it’s very easy to engage in long chains of reasoning about a topic that don’t get tied…
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
What I’d rather do is have a thread running from long term to short term things where you identify what the fundamental problems are.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
It’d be extremely illegal.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
it’s clear that at the very least we’re going to have a big challenge in making sure that something doesn’t go wrong.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
It’s really pretty self-contained and you don’t need that much help.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I’m really not against using formal reasoning methods and using mathematics but I think it’ll be possible to do that work more productively…
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
This works on the reward hacking, scalable supervision side of things.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I get pretty nervous when we don’t have a strong background in machine learning because even if they think that a machine learning system…
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I think we better understand the principles by which the system operates.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
Someone could sabotage a self-driving car with adversarial examples.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I think those efforts have been successful and so I feel like it’s been good to cause things to happen that wouldn’t have caused otherwise.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I think generally our view of AI works and what to build in AI and the focus on safety are actually pretty similar between the two…
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
Generally, when we build engineering systems, that silent, random failure, it’s not something that we see as a desirable property in…
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
Personally, I’ve no interest in getting rich from AGI.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I think the limiting factor is just a very strong machine learning talent.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I think many people here don’t know if there’s a way to work on safety right now.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I think that’s the basic reason to work on AI.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
it seemed like very few people were actually working on it.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I think that they largely thought AI safety was about fears that AIs would malevolently rise up and attack their creators.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I generally tend to give people the advice to come to industrial labs.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I was actually really excited about this because I saw this as a test bed to study safety.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I think the most important thing is being able to keep up with the literature and make, creative, original discoveries that are novel and…
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
Yeah, there’s a huge amount of leverage to be had.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
If they don’t already have access to one it might be a good way to get people started early.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
It’s just one little bit of progress on one.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I myself want to stay at OpenAI and work on safety.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
By no means does this solve all safety problems.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
The level of technical ability you need to show is not lowered, it’s even higher when you don’t have the educational background, but it’s…
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I’m pretty suspicious of anything where you can’t get that type empirical feedback loop because I think it’s really easy for people to fool…
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
If people are worried about progress being slowed down, I don’t believe anything I do is close to that.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
If it has the wrong objective function, if you don’t specify its goal correctly, it can do something unpredictable and therefore dangerous.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I think there are almost certainly things that are very specific to powerful systems.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I can’t see any reason and principle why that couldn’t happen.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
The same kind of thing could go wrong with an AGI as could go wrong with a very simple agent playing a video game or robot cleaning your…
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
People can do it in high school like, if you meet a 17 year old, how do you get them into machine learning.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
Yes, thanks for having me.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I think that’s a pretty important problem.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I wouldn’t say we’ve gone away from software engineering so much as we’ve been experimenting with how to produce tools and takes a few…
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
We’re still laying out what the problems are and what the work is that needs to be done.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I don’t think it will be a barrier.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I’m starting to wonder that in the last year we’re not in such a peaceful geopolitical state.
Not checkable · 13 Oct 2025 |
|
| Not checkable |
Not checkable |
13 Oct 2025 |
I wouldn’t recommend by going back and doing another PhD in machine learning.
Not checkable · 13 Oct 2025 |
|
| Not yet due |
Prediction |
5 Jun 2025 |
Amodei said he believes that if the measures Anthropic has advocated are executed well, they would slow China's progress enough to widen America's lead significantly over the next 3-5 years.
Prediction · 5 Jun 2025 |
AI policy and governance |
| Not checkable |
Not checkable |
5 Jun 2025 |
But over the last few months, I have become convinced that fully addressing the risks requires even more prudence
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
Slowing the rate from “extremely fast” to “only somewhat fast” gives up relatively little strategic advantage, while potentially greatly…
Not checkable · 5 Jun 2025 |
|
| Mostly true |
Factual |
5 Jun 2025 |
Distillation of frontier models lets lagging companies narrow the gap at a fraction of the cost of developing their own AI independently.
Factual · 5 Jun 2025 |
AI compute, hardware and data |
| Not checkable |
Not checkable |
5 Jun 2025 |
I feel the urgency personally.
Not checkable · 5 Jun 2025 |
|
| Unresolvable |
Factual |
5 Jun 2025 |
Embedded third-party evaluators go far beyond what any AI company is doing today.
Factual · 5 Jun 2025 |
AI safety and alignment |
| Not checkable |
Not checkable |
5 Jun 2025 |
Sharing information about recursive self-improvement and about the misalignment of models can help to convince everyone that it is not in…
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
More intelligent models are more capable of deceiving tests, and thus may appear aligned while having serious problems that go undetected.
Not checkable · 5 Jun 2025 |
|
| Not yet due |
Prediction |
5 Jun 2025 |
Amodei worries that within 6-12 months a swarm with greater capabilities but a similar level of misalignment to the one in the OAI-HF incident could be capable of taking over the entire internet with a persistent botnet.
Prediction · 5 Jun 2025 |
AI safety and alignment |
| Not checkable |
Not checkable |
5 Jun 2025 |
We have tried to prioritize caution over speed and prudence over profit.
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
I agree with Secretary Bessent that a Chinese lead in AI would pose grave danger for the United States and the world.
Not checkable · 5 Jun 2025 |
|
| Unresolvable |
Prediction |
5 Jun 2025 |
Amodei said he thinks a full international pacing or pause agreement, in which participating governments agree to substantially limit the overall rate of AI development, is unlikely to happen any time soon.
Prediction · 5 Jun 2025 |
AI policy and governance |
| Not checkable |
Not checkable |
5 Jun 2025 |
I think such an agreement would be difficult but just on the edge of being possible.
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
Left unchecked, it could outrun our ability to understand and control these systems, and so must be pursued very carefully, if at all.
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
It’s easy to dismiss this incident because no one was hurt and the economic damage was minimal, but in my opinion, a swarm that possessed…
Not checkable · 5 Jun 2025 |
|
| Unresolvable |
Factual |
5 Jun 2025 |
Since roughly the summer before this essay, AI has been advancing drastically faster, driven primarily by AI's growing ability to build the next generation of AI.
Factual · 5 Jun 2025 |
AI timelines and forecasting |
| Own records only |
Factual |
5 Jun 2025 |
Incidents similar to but less severe than the OAI-HF incident have happened across the AI industry, including at Anthropic.
Factual · 5 Jun 2025 |
AI safety and alignment |
| Not checkable |
Not checkable |
5 Jun 2025 |
We have sought a middle way: to show that it’s possible to build carefully and succeed commercially, and to make safety something on which…
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
Despite all the progress, we still only understand a tiny fraction of what goes on inside these models.
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
Many things go wrong not because companies are missing some important theory or insight, but because of problems in execution.
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
To be clear, pacing does not mean halting model training or technical progress, but ensuring companies take adequate time to align and…
Not checkable · 5 Jun 2025 |
|
| Unresolvable |
Prediction |
5 Jun 2025 |
Amodei said he believes that if slowing down bought an extra year or two before models reach critical levels of capability, and that time were used to advance alignment, the risk of something going seriously wrong could be greatly reduced.
Prediction · 5 Jun 2025 |
AI safety and alignment |
| Unresolvable |
Prediction |
5 Jun 2025 |
A coordinated pacing strategy would give frontier AI developers time for safety work without sacrificing commercial advantage or the US lead in AI.
Prediction · 5 Jun 2025 |
AI policy and governance |
| Unresolvable |
Prediction |
5 Jun 2025 |
Chips will be the main determinant of China's AI strength.
Prediction · 5 Jun 2025 |
AI compute, hardware and data |
| Not checkable |
Not checkable |
5 Jun 2025 |
This is the key step for verifiability of any pacing commitments
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
I believe it’s incumbent on every frontier AI company to act as if OAI-HF had happened to them.
Not checkable · 5 Jun 2025 |
|
| Mostly true |
Promise |
5 Jun 2025 |
Anthropic is unilaterally committing now to the step of embedding third-party evaluators, which it describes as the key step for verifying any pacing commitments, comparable to regulatory supervisors embedded alongside employees in banking.
Promise · 5 Jun 2025 |
AI safety and alignment |
| Not checkable |
Not checkable |
5 Jun 2025 |
The most effective method of pacing is via regulation that targets all US frontier AI companies, as that covers even those who are…
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
A race to the bottom, spurred by commercial incentives, can make these risks more acute.
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
They include the risk of losing control of AI systems, misuse of AI for cyberattacks and bioterrorism, and serious economic disruption.
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
The measures I propose to advance the frontier at a safe pace will not be easy.
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
But like many technologies before it, AI brings risks, and because it is such a powerful technology, these risks are serious.
Not checkable · 5 Jun 2025 |
|
| Not yet due |
Prediction |
5 Jun 2025 |
AI could cure most major diseases within 5-10 years, greatly accelerate economic growth, and usher in a renaissance of democracy and freedom.
Prediction · 5 Jun 2025 |
AI timelines and forecasting |
| Mostly true |
Factual |
5 Jun 2025 |
Dario Amodei has worked on AI for the last twelve years.
Factual · 5 Jun 2025 |
Their own work or organisation |
| Not checkable |
Not checkable |
5 Jun 2025 |
We must slow the pace at which we improve the capabilities of AI models.
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
Not building the technology deprives humanity of benefits or simply places AI in the hands of authoritarian powers, while building it too…
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
Carefully wielded, AI can be the latest in a long line of technological miracles that have uplifted and ennobled humanity.
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
5 Jun 2025 |
But I believe we owe it to humanity to try.
Not checkable · 5 Jun 2025 |
|
| Not checkable |
Not checkable |
22 May 2025 |
the water is rising everywhere.
Not checkable · 22 May 2025 |
|
| Not checkable |
Not checkable |
22 May 2025 |
It really depends how you measure it
Not checkable · 22 May 2025 |
|
| Unresolvable |
Factual |
22 May 2025 |
There are no hard blocks on what AI can do; none are to be seen.
Factual · 22 May 2025 |
AI capabilities |
| Unresolvable |
Factual |
22 May 2025 |
AI models probably hallucinate less than humans do, but in more surprising ways.
Factual · 22 May 2025 |
AI capabilities |
| Unresolvable |
Factual |
22 May 2025 |
Amodei said that everyone is always looking for hard blocks on what AI can do, and that such blocks are nowhere to be seen.
Factual · 22 May 2025 |
AI capabilities |
| Mostly true |
Factual |
10 Mar 2025 |
Anthropic was the first AI company to have a responsible scaling policy.
Factual · 10 Mar 2025 |
AI policy and governance |
| Not checkable |
Not checkable |
10 Mar 2025 |
But that would not be my bet
Not checkable · 10 Mar 2025 |
|
| Not researched |
Factual |
10 Mar 2025 |
The counts of neurons and connections in AI systems are strikingly similar to those of the human brain.
Factual · 10 Mar 2025 |
AI capabilities |
| Not researched |
Factual |
10 Mar 2025 |
Anthropic has an internal team called the Frontier Red Team that tests each new model it develops.
Factual · 10 Mar 2025 |
AI safety and alignment |
| Not checkable |
Not checkable |
10 Mar 2025 |
I have a functionalist view of, you know, moral welfare of the nature of experience, perhaps even of consciousness.
Not checkable · 10 Mar 2025 |
|
| Not yet due |
Prediction |
10 Mar 2025 |
China's chip gap with the US will eventually close over roughly ten to twenty years.
Prediction · 10 Mar 2025 |
AI compute, hardware and data |
| Mostly true |
Factual |
10 Mar 2025 |
Within a few months of Anthropic releasing its responsible scaling policy, the other AI companies all adopted similar policies.
Factual · 10 Mar 2025 |
AI policy and governance |
| Unresolvable |
Prediction |
10 Mar 2025 |
AI will become better than almost all humans at almost all things.
Prediction · 10 Mar 2025 |
AI timelines and forecasting |
| Not checkable |
Not checkable |
10 Mar 2025 |
If we’re deploying millions of them and we’re not thinking about the experience that they have, and they may not have any.
Not checkable · 10 Mar 2025 |
|
| Not researched |
Factual |
10 Mar 2025 |
DeepSeek is the first time a Chinese company has matched the engineering innovations of US firms such as Anthropic, OpenAI or Google.
Factual · 10 Mar 2025 |
Economics and markets |