| Own records only |
Factual |
8 Aug 2023 |
Every traditional investor who invests in Anthropic looks at its unusual governance body.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Not checkable |
Not checkable |
8 Aug 2023 |
It feels to me like an intern in most areas, but then some specific areas where it's better than that.
Not checkable · 8 Aug 2023 |
|
| Unresolvable |
Prediction |
8 Aug 2023 |
Dario Amodei said he personally thinks it is very unlikely that AI scaling laws will just stop.
Prediction · 8 Aug 2023 |
AI capabilities |
| Not checkable |
Not checkable |
8 Aug 2023 |
I think then you would have to go for some kind of RL.
Not checkable · 8 Aug 2023 |
|
| Not checkable |
Not checkable |
8 Aug 2023 |
I thought it had understood a lot of the essence of language but then there's further to go.
Not checkable · 8 Aug 2023 |
|
| Not checkable |
Not checkable |
8 Aug 2023 |
I guess if you had the view that alignment is completely unsolvable, then you'd be like, well, we're dead anyway so I don't want to worry…
Not checkable · 8 Aug 2023 |
|
| Not researched |
Factual |
8 Aug 2023 |
Email accounts of fairly high-ranking US government officials were recently hacked via Microsoft, which provided the accounts.
Factual · 8 Aug 2023 |
Other global risks |
| Not researched |
Factual |
8 Aug 2023 |
As of 2023, AI models are only beginning to prove relatively simple mathematical theorems.
Factual · 8 Aug 2023 |
AI capabilities |
| Not researched |
Factual |
2023 |
Dario Amodei testified in the US Senate that AI might pose serious bio risks within two to three years.
Factual · 2023 |
Biosecurity |
| Not yet due |
Prediction |
2023 |
AI misuse risks such as biological or chemical weapons uplift might become real risks in 2025 or 2026.
Prediction · 2023 |
Biosecurity |
| Unresolvable |
Factual |
13 Oct 2022 |
Amodei said he does not believe US export controls were ever designed to prevent China from obtaining a few tens of thousands of chips.
Factual · 13 Oct 2022 |
AI policy and governance |
| Not checkable |
Not checkable |
13 Oct 2022 |
DeepSeek's releases don't change this, because they're roughly on the expected cost reduction curve that has always been factored into…
Not checkable · 13 Oct 2022 |
|
| Not checkable |
Not checkable |
13 Oct 2022 |
is much less interesting from an innovation or engineering perspective than V3.
Not checkable · 13 Oct 2022 |
|
| Not checkable |
Not checkable |
13 Oct 2022 |
the idea that the technology getting more powerful, having more bang for the buck, is a reason to lift our export controls makes no sense…
Not checkable · 13 Oct 2022 |
|
| Not researched |
Factual |
13 Oct 2022 |
Nvidia H20 chips are less efficient for training and more efficient for sampling, and are still allowed under US export controls.
Factual · 13 Oct 2022 |
AI policy and governance |
| Not checkable |
Not checkable |
13 Oct 2022 |
I don't see DeepSeek themselves as adversaries and the point isn't to target them in particular.
Not checkable · 13 Oct 2022 |
|
| Not researched |
Citation |
13 Oct 2022 |
In 2020 Amodei's team published a paper suggesting algorithmic progress shifts the AI scaling curve by about 1.68x per year.
Citation · 13 Oct 2022 |
AI compute, hardware and data |
| Not researched |
Factual |
13 Oct 2022 |
Producing DeepSeek's R1 from V3 was probably very cheap.
Factual · 13 Oct 2022 |
Economics and markets |
| Not checkable |
Not checkable |
13 Oct 2022 |
Export controls serve a vital purpose: keeping democratic nations at the forefront of AI development.
Not checkable · 13 Oct 2022 |
|
| Unresolvable |
Factual |
13 Oct 2022 |
DeepSeek, a Chinese company, was the first to demonstrate the expected AI cost reductions, which had never before happened with a Chinese company.
Factual · 13 Oct 2022 |
Economics and markets |
| Mostly true |
Factual |
13 Oct 2022 |
Because reasoning-focused RL is new, the amount all AI developers spend on the RL training stage is still small, so the field is early on its scaling curve.
Factual · 13 Oct 2022 |
AI compute, hardware and data |
| Not checkable |
Not checkable |
13 Oct 2022 |
Well-enforced export controls are the only thing that can prevent China from getting millions of chips, and are therefore the most…
Not checkable · 13 Oct 2022 |
|
| Resolved true |
Factual |
13 Oct 2022 |
The current rate of algorithmic curve shift is maybe about 4x per year.
Factual · 13 Oct 2022 |
AI compute, hardware and data |
| Not checkable |
Not checkable |
13 Oct 2022 |
This shows that the export controls are actually working and adapting: loopholes are being closed
Not checkable · 13 Oct 2022 |
|
| Not yet due |
Prediction |
13 Oct 2022 |
AI smarter than almost all humans at almost all things will require millions of chips and at least tens of billions of dollars, and is most likely to arrive in 2026-2027.
Prediction · 13 Oct 2022 |
AI timelines and forecasting |
| Own records only |
Factual |
13 Oct 2022 |
DeepSeek-V3 was the real innovation and should have made people take notice a month before this statement, and the speaker says that "we" did take notice of it.
Factual · 13 Oct 2022 |
AI capabilities |
| Not checkable |
Not checkable |
13 Oct 2022 |
It's just that the economic value of training more and more intelligent models is so great that any cost gains are more than eaten up…
Not checkable · 13 Oct 2022 |
|
| Not checkable |
Not checkable |
13 Oct 2022 |
The goal is to prevent them from gaining military dominance.
Not checkable · 13 Oct 2022 |
|
| Not checkable |
Not checkable |
13 Oct 2022 |
All of this is to say that DeepSeek-V3 is not a unique breakthrough or something that fundamentally changes the economics of LLM’s; it’s an…
Not checkable · 13 Oct 2022 |
|
| Not checkable |
Not checkable |
13 Oct 2022 |
Claude is extremely good at coding and at having a well-designed style of interaction with people
Not checkable · 13 Oct 2022 |
|
| Not checkable |
Not checkable |
13 Oct 2022 |
$1B of economic activity can be hidden, but it's hard to hide $100B or even $10B.
Not checkable · 13 Oct 2022 |
|
| Unresolvable |
Prediction |
13 Oct 2022 |
US AI companies will soon achieve similar cost reductions, through the usual cost-reduction trend rather than by copying DeepSeek.
Prediction · 13 Oct 2022 |
Economics and markets |
| Unresolvable |
Factual |
13 Oct 2022 |
Anthropic finds Claude 3.5 Sonnet remains much better than DeepSeek-V3 on some key tasks such as real-world coding.
Factual · 13 Oct 2022 |
AI capabilities |
| Not checkable |
Not checkable |
13 Oct 2022 |
I think they make export control policies even more existentially important than they were a week ago
Not checkable · 13 Oct 2022 |
|
| Not checkable |
Not checkable |
13 Oct 2022 |
The performance of DeepSeek does not mean the export controls failed.
Not checkable · 13 Oct 2022 |
|
| Not checkable |
Not checkable |
13 Oct 2022 |
another factor of 10 may correspond to the difference between an undergraduate and PhD skill level
Not checkable · 13 Oct 2022 |
|
| Mixed |
Factual |
13 Oct 2022 |
DeepSeek was not substantially more resource-constrained than US AI companies, and export controls were not the main factor causing its innovation.
Factual · 13 Oct 2022 |
AI policy and governance |
| Not checkable |
Not checkable |
13 Oct 2022 |
I do believe many of the claims about their threat to US AI leadership are greatly overstated
Not checkable · 13 Oct 2022 |
|
| Resolved false |
Prediction |
13 Oct 2022 |
The situation where several companies can produce good reasoning models will rapidly cease as everyone moves further up the scaling curve.
Prediction · 13 Oct 2022 |
Economics and markets |
| Mostly true |
Factual |
13 Oct 2022 |
Dario Amodei and his co-founders were among the first to document, while at OpenAI, that scaling up AI training smoothly improves results across a range of cognitive tasks.
Factual · 13 Oct 2022 |
Their own work or organisation |
| Mostly true |
Factual |
13 Oct 2022 |
Improvements in training cost efficiency typically lead AI companies to spend more, not less, on training models.
Factual · 13 Oct 2022 |
Economics and markets |
| Not researched |
Factual |
13 Oct 2022 |
DeepSeek's team achieved V3's results through innovations mostly focused on engineering efficiency, including Key-Value cache management and mixture of experts.
Factual · 13 Oct 2022 |
AI compute, hardware and data |
| Resolved true |
Factual |
13 Oct 2022 |
Amodei said he thinks a fair statement is that DeepSeek produced a model close in performance to US models 7-10 months older, at a good deal less cost but not near the ratios people have suggested.
Factual · 13 Oct 2022 |
Economics and markets |
| Not researched |
Factual |
13 Oct 2022 |
DeepSeek's total company spend is not vastly different from that of US AI labs.
Factual · 13 Oct 2022 |
Economics and markets |
| Not checkable |
Not checkable |
13 Oct 2022 |
Everyone should be able to benefit from AI.
Not checkable · 13 Oct 2022 |
|
| Not researched |
Factual |
13 Oct 2022 |
Sonnet's training was conducted 9-12 months ago, DeepSeek's model was trained in November/December, and Sonnet remains notably ahead in many internal and external evals.
Factual · 13 Oct 2022 |
AI capabilities |
| Not checkable |
Not checkable |
13 Oct 2022 |
On these and some additional tasks, there’s just no comparison with DeepSeek.
Not checkable · 13 Oct 2022 |
|
| Not researched |
Factual |
13 Oct 2022 |
Claude 3.5 Sonnet is a mid-sized model that cost a few tens of millions of dollars to train.
Factual · 13 Oct 2022 |
Economics and markets |
| Not checkable |
Not checkable |
13 Oct 2022 |
But we shouldn't hand the Chinese Communist Party technological advantages when we don't have to.
Not checkable · 13 Oct 2022 |
|
| Unresolvable |
Prediction |
21 Jul 2017 |
Solving biology might turn out to be an exponentially complicated combinatorial problem or be limited by data and experiment.
Prediction · 21 Jul 2017 |
Biosecurity |
| Own records only |
Factual |
21 Jul 2017 |
Around 2015, Dario Amodei often argued that a relatively peaceful geopolitical period made it a good time for AGI to be built.
Factual · 21 Jul 2017 |
AI timelines and forecasting |
| Resolved true |
Factual |
21 Jul 2017 |
OpenAI and DeepMind both have a focus on safety and both have safety teams.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Unresolvable |
Prediction |
21 Jul 2017 |
A really powerful AI might be unable to understand macroeconomic systems due to data limits yet still be able to design a better one.
Prediction · 21 Jul 2017 |
AI, the economy and work |
| Unresolvable |
Prediction |
21 Jul 2017 |
Machines could probably make progress in biology pretty fast, though there is huge uncertainty.
Prediction · 21 Jul 2017 |
Biosecurity |
| Mostly true |
Factual |
21 Jul 2017 |
Getting started in machine learning probably requires about a thousand dollars to buy a GPU.
Factual · 21 Jul 2017 |
Field building and careers |
| Mostly true |
Factual |
21 Jul 2017 |
There was a lot of political instability in the western world in the year before July 2017.
Factual · 21 Jul 2017 |
Philosophy, ethics and society |
| Own records only |
Factual |
21 Jul 2017 |
OpenAI does not lower its machine learning hiring bar for people who want to work on safety.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Factual |
21 Jul 2017 |
Vicarious does not think about AI safety, to Amodei's knowledge.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Not researched |
Factual |
21 Jul 2017 |
Dario Amodei was not present when OpenAI was founded or its name chosen, and did not pick the name.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Not researched |
Factual |
21 Jul 2017 |
OpenAI's safety team consisted of Dario Amodei and Paul Christiano as of mid-2017.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Prediction |
21 Jul 2017 |
Amodei said he is optimistic that researchers will gain a better understanding of transparency inside neural nets.
Prediction · 21 Jul 2017 |
AI safety and alignment |
| Own records only |
Factual |
21 Jul 2017 |
Amodei said that he and OpenAI focus a lot on reinforcement learning because it, and extended versions of it, seems a better fit for what intelligent agents do in general.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Prediction |
21 Jul 2017 |
Solving resource constraints through AI will not by itself solve war.
Prediction · 21 Jul 2017 |
Other global risks |
| Not researched |
Factual |
21 Jul 2017 |
Early expert systems based purely on logical reasoning proved very brittle because they could not represent high-dimensional space.
Factual · 21 Jul 2017 |
AI capabilities |
| Not researched |
Factual |
21 Jul 2017 |
The principles on which a visual neural net is built are simple: backpropagation and alternating linear and non-linear components.
Factual · 21 Jul 2017 |
AI capabilities |
| Own records only |
Factual |
21 Jul 2017 |
Amodei said he thinks that, broadly, most people at OpenAI are worried about the issues under discussion or at least think they are worth thinking about, and he set this apart from the staff actively doing technical work on them.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Factual |
21 Jul 2017 |
Dario Amodei mainly works on safety at OpenAI.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Not researched |
Factual |
21 Jul 2017 |
On some Atari games that take about 10 million timesteps to learn, a human usually has to give feedback only a few thousand times.
Factual · 21 Jul 2017 |
AI capabilities |
| Not researched |
Factual |
21 Jul 2017 |
OpenAI as an institution holds that working on AI safety requires being at the forefront of AI.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Own records only |
Factual |
21 Jul 2017 |
Dario Amodei has not been closely involved in OpenAI's rapid hiring and growth, except on the safety side.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Not researched |
Factual |
21 Jul 2017 |
Not many people were yet working on technical AI safety.
Factual · 21 Jul 2017 |
Field building and careers |
| Not researched |
Factual |
21 Jul 2017 |
As of 2017, OpenAI is hiring talented machine-learning people who care about AI safety.
Factual · 21 Jul 2017 |
Field building and careers |
| Mixed |
Factual |
21 Jul 2017 |
For almost a decade before 2017, self-driving cars have existed that are 99.9% safe.
Factual · 21 Jul 2017 |
AI capabilities |
| Unresolvable |
Factual |
21 Jul 2017 |
The Concrete Problems in AI Safety paper did not discuss the transparency of neural nets.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Not researched |
Factual |
21 Jul 2017 |
Researchers trained a simulated robot to do a backflip using human feedback over a few hundred timesteps, with about 30 minutes of human clicking.
Factual · 21 Jul 2017 |
AI capabilities |
| Not researched |
Factual |
21 Jul 2017 |
OpenAI had about 55 staff in mid-2017.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Not researched |
Factual |
21 Jul 2017 |
OpenAI is a nonprofit and does not sell products.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Prediction |
21 Jul 2017 |
Pure rule-based systems will not work for building AGI.
Prediction · 21 Jul 2017 |
AI capabilities |
| Unresolvable |
Prediction |
21 Jul 2017 |
Artificial general intelligence will eventually be developed.
Prediction · 21 Jul 2017 |
AI timelines and forecasting |
| Not researched |
Factual |
21 Jul 2017 |
As of 2017, OpenAI's funding came only from donations.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Prediction |
21 Jul 2017 |
There may be more than a 50% chance that, as AI gets closer to AGI, it becomes clear how to make it safe.
Prediction · 21 Jul 2017 |
AI safety and alignment |
| Not researched |
Factual |
21 Jul 2017 |
Amodei said that his team's paper replaces the fixed reward function with a neural-net-based model of the human's reward.
Factual · 21 Jul 2017 |
AI capabilities |
| Not researched |
Factual |
21 Jul 2017 |
A researcher named Stuart, at a group that sends interns to OpenAI, has been thinking about AI safety for a while.
Factual · 21 Jul 2017 |
Field building and careers |
| Resolved true |
Factual |
21 Jul 2017 |
Dario Amodei's PhD was not in machine learning.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Not researched |
Factual |
21 Jul 2017 |
MIRI does some AI safety work based on mathematics and formal logic.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Not researched |
Factual |
21 Jul 2017 |
Dario Amodei had never worked at a startup before OpenAI.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Factual |
21 Jul 2017 |
Statistical AI systems have pretty decisively won out over rule-based systems.
Factual · 21 Jul 2017 |
AI capabilities |
| Resolved true |
Factual |
21 Jul 2017 |
OpenAI is a nonprofit AI research lab.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Not researched |
Factual |
21 Jul 2017 |
OpenAI and DeepMind are probably the AI organisations most focused on reinforcement learning.
Factual · 21 Jul 2017 |
AI capabilities |
| Unresolvable |
Factual |
21 Jul 2017 |
Amodei said he thinks OpenAI has generally been very selective in whom it picks.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Not researched |
Factual |
21 Jul 2017 |
In the method Amodei described, the agent builds a model of what reward function would lie behind the human's expressed preferences.
Factual · 21 Jul 2017 |
AI capabilities |
| Not checkable |
Not checkable |
17 Aug 2015 |
Biology is probably the area where scientific progress has the greatest potential to directly and unambiguously improve the quality of…
Not checkable · 17 Aug 2015 |
|
| Not checkable |
Not checkable |
17 Aug 2015 |
AI-powered authoritarianism seems too terrible to contemplate, so democracies need to be able to set the terms by which powerful AI is…
Not checkable · 17 Aug 2015 |
|
| Mostly true |
Prediction |
17 Aug 2015 |
AI seems likely to enable much better propaganda and surveillance, which are major tools of autocrats.
Prediction · 17 Aug 2015 |
AI policy and governance |
| Unresolvable |
Prediction |
17 Aug 2015 |
Amodei guessed that most people would support embryo screening for severe or debilitating mental illness.
Prediction · 17 Aug 2015 |
Philosophy, ethics and society |
| Not yet due |
Prediction |
17 Aug 2015 |
Powerful AI could be built as early as 2026, though it could take much longer.
Prediction · 17 Aug 2015 |
AI timelines and forecasting |
| Not checkable |
Not checkable |
17 Aug 2015 |
there’s an unavoidable constant delay
Not checkable · 17 Aug 2015 |
|
| Not checkable |
Not checkable |
17 Aug 2015 |
I think this question is more difficult than the others.
Not checkable · 17 Aug 2015 |
|
| Not checkable |
Not checkable |
17 Aug 2015 |
A truly mature and successful implementation of AI has the potential to reduce bias and be fairer for everyone.
Not checkable · 17 Aug 2015 |
|
| Unresolvable |
Prediction |
17 Aug 2015 |
Amodei said he suspects AI-accelerated biology will greatly expand what is possible, with weight, physical appearance, reproduction and other biological processes becoming fully under people's control.
Prediction · 17 Aug 2015 |
Science and research methods |