| Unresolvable |
Factual |
12 Apr 2024 |
Amodei and colleagues found regular scaling patterns and predicted that raising investment from about $10,000 to hundreds of millions of dollars would bring huge change and economic value.
Factual · 12 Apr 2024 |
AI capabilities |
| Unresolvable |
Factual |
12 Apr 2024 |
Anthropic's Claude 3 Opus reaches roughly 99.9% accuracy on 20-digit addition, well beyond what common internet data would give.
Factual · 12 Apr 2024 |
AI capabilities |
| Resolved true |
Factual |
12 Apr 2024 |
Anthropic's models are currently at AI Safety Level ASL-2.
Factual · 12 Apr 2024 |
Their own work or organisation |
| Not yet due |
Prediction |
12 Apr 2024 |
Amodei said he thinks the cost of training AI models may reach $5 billion to $10 billion in 2025 to 2026.
Prediction · 12 Apr 2024 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
12 Apr 2024 |
A ten-year pause in AI development would be very difficult because other countries would keep developing these models, people might break the law, and the economic pressure would be enormous.
Prediction · 12 Apr 2024 |
AI policy and governance |
| Unresolvable |
Prediction |
12 Apr 2024 |
If human-AI collaboration does not arise naturally, it will eventually be achieved.
Prediction · 12 Apr 2024 |
AI capabilities |
| Unresolvable |
Prediction |
12 Apr 2024 |
AI systems may fundamentally change industries and professions one after another, in hard-to-predict ways.
Prediction · 12 Apr 2024 |
AI, the economy and work |
| Own records only |
Factual |
12 Apr 2024 |
Anthropic has already secured the compute it needs for 2024, and Amodei expects next year's compute to be sufficient too.
Factual · 12 Apr 2024 |
AI compute, hardware and data |
| Own records only |
Factual |
12 Apr 2024 |
In Amodei's short-term personal experience, he has always found a workflow in which AI tools assist him.
Factual · 12 Apr 2024 |
Their own work or organisation |
| Not yet due |
Prediction |
8 Aug 2023 |
Control of powerful AI models five years from now will involve substantial involvement of a government or assembly of government bodies.
Prediction · 8 Aug 2023 |
AI policy and governance |
| Unresolvable |
Factual |
8 Aug 2023 |
Dario Amodei did not think AI scaling would hit a wall, and a few other people shared that view, when a wall was a more plausible case.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Unresolvable |
Prediction |
8 Aug 2023 |
Danger from AI may lead to unilateral, multilateral or government-enforced decisions not to scale as fast as possible, which Anthropic supports.
Prediction · 8 Aug 2023 |
AI policy and governance |
| Own records only |
Prediction |
8 Aug 2023 |
Anthropic's security measures will defend against most attacks and against a less determined state-level actor.
Prediction · 8 Aug 2023 |
Their own work or organisation |
| Unresolvable |
Factual |
8 Aug 2023 |
As of 2023, the model can be very good at coding but can't quite prove the prime number theorem yet.
Factual · 8 Aug 2023 |
AI capabilities |
| Own records only |
Factual |
8 Aug 2023 |
Anthropic has generally found that hired physics PhDs can learn machine learning and contribute very quickly in most cases.
Factual · 8 Aug 2023 |
Field building and careers |
| Mostly true |
Factual |
8 Aug 2023 |
Anthropic published a blog post on security stating it has a two-key system for access to model weights.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Unresolvable |
Prediction |
8 Aug 2023 |
Powerful, agentic AI models will be built.
Prediction · 8 Aug 2023 |
AI capabilities |
| Unresolvable |
Prediction |
8 Aug 2023 |
Dario Amodei expects the money spent on the largest AI models to rise by something like a factor of 100.
Prediction · 8 Aug 2023 |
AI compute, hardware and data |
| Unresolvable |
Prediction |
8 Aug 2023 |
Amodei guessed that reinforcement learning will become a thing for models taking actions in the world, with all the power and safety issues that come with it.
Prediction · 8 Aug 2023 |
AI capabilities |
| Own records only |
Factual |
8 Aug 2023 |
Anthropic has worked to ensure the data center used for its models is located in the United States.
Factual · 8 Aug 2023 |
AI compute, hardware and data |
| Mostly true |
Factual |
8 Aug 2023 |
As of August 2023, mechanistic interpretability is not nearly capable enough to verify that a model is aligned.
Factual · 8 Aug 2023 |
AI safety and alignment |
| Unresolvable |
Prediction |
8 Aug 2023 |
AI developers could run out of training data, which would limit scaling.
Prediction · 8 Aug 2023 |
AI compute, hardware and data |
| Unresolvable |
Factual |
8 Aug 2023 |
AI scaling laws are sometimes predictable to several significant figures, which is not seen outside of physics.
Factual · 8 Aug 2023 |
AI capabilities |
| Unresolvable |
Factual |
8 Aug 2023 |
As of 2023, many firms rushing to deploy AI systems are not using them in anywhere near the most efficient way possible.
Factual · 8 Aug 2023 |
AI, the economy and work |
| Unresolvable |
Prediction |
8 Aug 2023 |
If China sees AI as a source of national power, it will try the most effective approach, which could lead it toward AGI.
Prediction · 8 Aug 2023 |
AI policy and governance |
| Unresolvable |
Prediction |
8 Aug 2023 |
Running out of training data will not be a blocker to AI scaling.
Prediction · 8 Aug 2023 |
AI compute, hardware and data |
| Mostly true |
Factual |
8 Aug 2023 |
Existing alignment methods succeed in aligning AI systems for today's tasks.
Factual · 8 Aug 2023 |
AI safety and alignment |
| Unresolvable |
Factual |
8 Aug 2023 |
Current AI models may be superhuman or close to superhuman at constrained writing, such as writing a page without the letter E.
Factual · 8 Aug 2023 |
AI capabilities |
| Resolved true |
Prediction |
8 Aug 2023 |
In a year or two (from 2023), AI model consciousness might become a very real concern.
Prediction · 8 Aug 2023 |
Philosophy, ethics and society |
| Own records only |
Factual |
8 Aug 2023 |
Dario Amodei has pushed for better cybersecurity at every organisation where he has worked.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Resolved true |
Factual |
8 Aug 2023 |
Amodei said Anthropic "kind of" already does reinforcement learning, through RLHF.
Factual · 8 Aug 2023 |
AI capabilities |
| Own records only |
Factual |
8 Aug 2023 |
Anthropic's current security measures are not sufficient against a super determined state-level actor.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Unresolvable |
Prediction |
8 Aug 2023 |
In Dario Amodei's view, AI models would keep getting better across the board; he said he did not see any area where the models were very weak or not starting to make progress.
Prediction · 8 Aug 2023 |
AI capabilities |
| Not yet due |
Prediction |
8 Aug 2023 |
AI models that act like a generally well-educated human in an hour-long conversation could exist within two or three years of August 2023.
Prediction · 8 Aug 2023 |
AI timelines and forecasting |
| Mostly true |
Factual |
8 Aug 2023 |
Anthropic's initial constitution for its models drew on broadly agreed sources such as the UN Declaration of Human Rights and parts of Apple's Terms of Service.
Factual · 8 Aug 2023 |
AI safety and alignment |
| Own records only |
Factual |
8 Aug 2023 |
Dario Amodei formed his view on scaling gradually between 2014 and 2017.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Unresolvable |
Prediction |
8 Aug 2023 |
AI models will undertake extended tasks.
Prediction · 8 Aug 2023 |
AI capabilities |
| Unresolvable |
Prediction |
8 Aug 2023 |
Dario Amodei said it seemed likely to him that AI systems will first speed up human productivity, then equal it, and at some point become in some meaningful sense the main contributor to scientific progress, though he expected the details to be different from what people expect.
Prediction · 8 Aug 2023 |
AI capabilities |
| Mostly true |
Prediction |
8 Aug 2023 |
AI models will not have enough autonomy within two years to raise alignment concerns, though that may not be far behind.
Prediction · 8 Aug 2023 |
AI safety and alignment |
| Unresolvable |
Prediction |
8 Aug 2023 |
The models' current level of performance, which the speaker graded as a B or B minus, will change with scaling.
Prediction · 8 Aug 2023 |
AI capabilities |
| Unresolvable |
Prediction |
8 Aug 2023 |
Dario Amodei does not expect RL training for longer-horizon tasks to require a substantial amount of additional compute.
Prediction · 8 Aug 2023 |
AI compute, hardware and data |
| Unresolvable |
Factual |
8 Aug 2023 |
Interpretability work on language models, such as induction heads, suggests much of the cognitive machinery needed for active agents is already present in base language models.
Factual · 8 Aug 2023 |
AI capabilities |
| Unresolvable |
Factual |
8 Aug 2023 |
AI language models learn to speak fluent Base64, which humans do not typically learn.
Factual · 8 Aug 2023 |
AI capabilities |
| Not yet due |
Prediction |
8 Aug 2023 |
Amodei said that the trend from earlier models to state-of-the-art models shows every sign that, two or three years after August 2023, there will be a real problem.
Prediction · 8 Aug 2023 |
Biosecurity |
| Own records only |
Factual |
8 Aug 2023 |
Anthropic is focusing heavily on cybersecurity, including working with its cloud providers.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Unresolvable |
Prediction |
8 Aug 2023 |
Serious danger from scaled AI models will first come from misuse, such as biorisk, rather than misalignment.
Prediction · 8 Aug 2023 |
AI safety and alignment |
| Own records only |
Factual |
8 Aug 2023 |
Every traditional investor who invests in Anthropic looks at its unusual governance body.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Unresolvable |
Prediction |
8 Aug 2023 |
Dario Amodei said he personally thinks it is very unlikely that AI scaling laws will just stop.
Prediction · 8 Aug 2023 |
AI capabilities |
| Not yet due |
Prediction |
2023 |
AI misuse risks such as biological or chemical weapons uplift might become real risks in 2025 or 2026.
Prediction · 2023 |
Biosecurity |
| Unresolvable |
Factual |
13 Oct 2022 |
Amodei said he does not believe US export controls were ever designed to prevent China from obtaining a few tens of thousands of chips.
Factual · 13 Oct 2022 |
AI policy and governance |
| Unresolvable |
Factual |
13 Oct 2022 |
DeepSeek, a Chinese company, was the first to demonstrate the expected AI cost reductions, which had never before happened with a Chinese company.
Factual · 13 Oct 2022 |
Economics and markets |
| Mostly true |
Factual |
13 Oct 2022 |
Because reasoning-focused RL is new, the amount all AI developers spend on the RL training stage is still small, so the field is early on its scaling curve.
Factual · 13 Oct 2022 |
AI compute, hardware and data |
| Resolved true |
Factual |
13 Oct 2022 |
The current rate of algorithmic curve shift is maybe about 4x per year.
Factual · 13 Oct 2022 |
AI compute, hardware and data |
| Not yet due |
Prediction |
13 Oct 2022 |
AI smarter than almost all humans at almost all things will require millions of chips and at least tens of billions of dollars, and is most likely to arrive in 2026-2027.
Prediction · 13 Oct 2022 |
AI timelines and forecasting |
| Own records only |
Factual |
13 Oct 2022 |
DeepSeek-V3 was the real innovation and should have made people take notice a month before this statement, and the speaker says that "we" did take notice of it.
Factual · 13 Oct 2022 |
AI capabilities |
| Unresolvable |
Prediction |
13 Oct 2022 |
US AI companies will soon achieve similar cost reductions, through the usual cost-reduction trend rather than by copying DeepSeek.
Prediction · 13 Oct 2022 |
Economics and markets |
| Unresolvable |
Factual |
13 Oct 2022 |
Anthropic finds Claude 3.5 Sonnet remains much better than DeepSeek-V3 on some key tasks such as real-world coding.
Factual · 13 Oct 2022 |
AI capabilities |
| Mixed |
Factual |
13 Oct 2022 |
DeepSeek was not substantially more resource-constrained than US AI companies, and export controls were not the main factor causing its innovation.
Factual · 13 Oct 2022 |
AI policy and governance |
| Resolved false |
Prediction |
13 Oct 2022 |
The situation where several companies can produce good reasoning models will rapidly cease as everyone moves further up the scaling curve.
Prediction · 13 Oct 2022 |
Economics and markets |
| Mostly true |
Factual |
13 Oct 2022 |
Dario Amodei and his co-founders were among the first to document, while at OpenAI, that scaling up AI training smoothly improves results across a range of cognitive tasks.
Factual · 13 Oct 2022 |
Their own work or organisation |
| Mostly true |
Factual |
13 Oct 2022 |
Improvements in training cost efficiency typically lead AI companies to spend more, not less, on training models.
Factual · 13 Oct 2022 |
Economics and markets |
| Resolved true |
Factual |
13 Oct 2022 |
Amodei said he thinks a fair statement is that DeepSeek produced a model close in performance to US models 7-10 months older, at a good deal less cost but not near the ratios people have suggested.
Factual · 13 Oct 2022 |
Economics and markets |
| Unresolvable |
Prediction |
21 Jul 2017 |
Solving biology might turn out to be an exponentially complicated combinatorial problem or be limited by data and experiment.
Prediction · 21 Jul 2017 |
Biosecurity |
| Own records only |
Factual |
21 Jul 2017 |
Around 2015, Dario Amodei often argued that a relatively peaceful geopolitical period made it a good time for AGI to be built.
Factual · 21 Jul 2017 |
AI timelines and forecasting |
| Resolved true |
Factual |
21 Jul 2017 |
OpenAI and DeepMind both have a focus on safety and both have safety teams.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Unresolvable |
Prediction |
21 Jul 2017 |
A really powerful AI might be unable to understand macroeconomic systems due to data limits yet still be able to design a better one.
Prediction · 21 Jul 2017 |
AI, the economy and work |
| Unresolvable |
Prediction |
21 Jul 2017 |
Machines could probably make progress in biology pretty fast, though there is huge uncertainty.
Prediction · 21 Jul 2017 |
Biosecurity |
| Mostly true |
Factual |
21 Jul 2017 |
Getting started in machine learning probably requires about a thousand dollars to buy a GPU.
Factual · 21 Jul 2017 |
Field building and careers |
| Mostly true |
Factual |
21 Jul 2017 |
There was a lot of political instability in the western world in the year before July 2017.
Factual · 21 Jul 2017 |
Philosophy, ethics and society |
| Own records only |
Factual |
21 Jul 2017 |
OpenAI does not lower its machine learning hiring bar for people who want to work on safety.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Factual |
21 Jul 2017 |
Vicarious does not think about AI safety, to Amodei's knowledge.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Unresolvable |
Prediction |
21 Jul 2017 |
Amodei said he is optimistic that researchers will gain a better understanding of transparency inside neural nets.
Prediction · 21 Jul 2017 |
AI safety and alignment |
| Own records only |
Factual |
21 Jul 2017 |
Amodei said that he and OpenAI focus a lot on reinforcement learning because it, and extended versions of it, seems a better fit for what intelligent agents do in general.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Prediction |
21 Jul 2017 |
Solving resource constraints through AI will not by itself solve war.
Prediction · 21 Jul 2017 |
Other global risks |
| Own records only |
Factual |
21 Jul 2017 |
Amodei said he thinks that, broadly, most people at OpenAI are worried about the issues under discussion or at least think they are worth thinking about, and he set this apart from the staff actively doing technical work on them.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Factual |
21 Jul 2017 |
Dario Amodei mainly works on safety at OpenAI.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Own records only |
Factual |
21 Jul 2017 |
Dario Amodei has not been closely involved in OpenAI's rapid hiring and growth, except on the safety side.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Mixed |
Factual |
21 Jul 2017 |
For almost a decade before 2017, self-driving cars have existed that are 99.9% safe.
Factual · 21 Jul 2017 |
AI capabilities |
| Unresolvable |
Factual |
21 Jul 2017 |
The Concrete Problems in AI Safety paper did not discuss the transparency of neural nets.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Unresolvable |
Prediction |
21 Jul 2017 |
Pure rule-based systems will not work for building AGI.
Prediction · 21 Jul 2017 |
AI capabilities |
| Unresolvable |
Prediction |
21 Jul 2017 |
Artificial general intelligence will eventually be developed.
Prediction · 21 Jul 2017 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
21 Jul 2017 |
There may be more than a 50% chance that, as AI gets closer to AGI, it becomes clear how to make it safe.
Prediction · 21 Jul 2017 |
AI safety and alignment |
| Resolved true |
Factual |
21 Jul 2017 |
Dario Amodei's PhD was not in machine learning.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Factual |
21 Jul 2017 |
Statistical AI systems have pretty decisively won out over rule-based systems.
Factual · 21 Jul 2017 |
AI capabilities |
| Resolved true |
Factual |
21 Jul 2017 |
OpenAI is a nonprofit AI research lab.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Factual |
21 Jul 2017 |
Amodei said he thinks OpenAI has generally been very selective in whom it picks.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Mostly true |
Prediction |
17 Aug 2015 |
AI seems likely to enable much better propaganda and surveillance, which are major tools of autocrats.
Prediction · 17 Aug 2015 |
AI policy and governance |
| Unresolvable |
Prediction |
17 Aug 2015 |
Amodei guessed that most people would support embryo screening for severe or debilitating mental illness.
Prediction · 17 Aug 2015 |
Philosophy, ethics and society |
| Not yet due |
Prediction |
17 Aug 2015 |
Powerful AI could be built as early as 2026, though it could take much longer.
Prediction · 17 Aug 2015 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
17 Aug 2015 |
Amodei said he suspects AI-accelerated biology will greatly expand what is possible, with weight, physical appearance, reproduction and other biological processes becoming fully under people's control.
Prediction · 17 Aug 2015 |
Science and research methods |
| Not yet due |
Prediction |
17 Aug 2015 |
Most mental illness can probably be cured with AI-accelerated neuroscience.
Prediction · 17 Aug 2015 |
Science and research methods |
| Mostly true |
Prediction |
17 Aug 2015 |
Climate change will be felt much more strongly in the developing world, hampering its development.
Prediction · 17 Aug 2015 |
Other global risks |
| Not yet due |
Prediction |
17 Aug 2015 |
Amodei thinks AI will similarly accelerate the rate of neuroscience advances, so that the framework of '100 years of progress in 5-10 years' applies to neuroscience in the same way it does to biology.
Prediction · 17 Aug 2015 |
AI capabilities |
| Unresolvable |
Prediction |
17 Aug 2015 |
The rate of discovery of key biology and medicine technologies could be increased by 10x or more with many more talented, creative researchers.
Prediction · 17 Aug 2015 |
Science and research methods |
| Unresolvable |
Prediction |
17 Aug 2015 |
Dario Amodei suspects that some new and stranger economic arrangement will be needed, one that no one today has done a good job of envisioning.
Prediction · 17 Aug 2015 |
AI, the economy and work |
| Unresolvable |
Prediction |
17 Aug 2015 |
Amodei said the cause of Alzheimer's seems like the type of problem that better measurement tools isolating biological effects could solve, and that he is bullish about AI's ability to solve it.
Prediction · 17 Aug 2015 |
AI capabilities |
| Mixed |
Factual |
17 Aug 2015 |
Poorly implemented services are currently a major driver of cynicism about government.
Factual · 17 Aug 2015 |
AI policy and governance |
| Unresolvable |
Prediction |
17 Aug 2015 |
Amodei suspects that improved mental health will ameliorate many other societal problems, including ones that seem political or economic.
Prediction · 17 Aug 2015 |
Philosophy, ethics and society |
| Mostly true |
Factual |
17 Aug 2015 |
The impact of nuclear power, supersonic flight and elevators has been substantially reduced by regulations or misplaced fears despite working well technically.
Factual · 17 Aug 2015 |
AI policy and governance |
| Unresolvable |
Prediction |
17 Aug 2015 |
Amodei said it seems very likely that there is room for smarter-than-human AI systems to do a better job than humans at the epidemiological modeling used in disease eradication campaigns.
Prediction · 17 Aug 2015 |
AI capabilities |