| Mostly true |
Factual |
12 Apr 2024 |
Anthropic's experiment found its large model nearly matched a hired human team in changing people's views with persuasive essays.
Factual · 12 Apr 2024 |
AI safety and alignment |
| Own records only |
Factual |
12 Apr 2024 |
In Amodei's experience, the company's internal models he occasionally uses can in some respects help conceptualize thinking but are not good at generating initial ideas.
Factual · 12 Apr 2024 |
AI capabilities |
| Unresolvable |
Factual |
12 Apr 2024 |
Amodei said Anthropic launched its safety-level framework in September and that about three months later OpenAI launched a similar product.
Factual · 12 Apr 2024 |
AI policy and governance |
| Resolved true |
Factual |
12 Apr 2024 |
The Star Trek series depicts a highly developed universe in which humans live longer and have expanded into space.
Factual · 12 Apr 2024 |
Other |
| Own records only |
Factual |
12 Apr 2024 |
Dario Amodei said that at Anthropic he writes strategic planning documents or does some new thinking, possibly on directions others have not covered.
Factual · 12 Apr 2024 |
Their own work or organisation |
| Mostly true |
Factual |
12 Apr 2024 |
Anthropic introduced its Responsible Scaling Plan at the end of 2023, setting thresholds for AI system capabilities.
Factual · 12 Apr 2024 |
Their own work or organisation |
| Mixed |
Factual |
12 Apr 2024 |
我们和其他一些研究者发现,模型里有时会有某些特定的神经元和统计指标(这些通常不出现在它的外部反应中),这些指标能够指示模型是在撒谎还是在说真话。
Factual · 12 Apr 2024 |
AI safety and alignment |
| Unresolvable |
Factual |
12 Apr 2024 |
Amodei and colleagues found regular scaling patterns and predicted that raising investment from about $10,000 to hundreds of millions of dollars would bring huge change and economic value.
Factual · 12 Apr 2024 |
AI capabilities |
| Unresolvable |
Factual |
12 Apr 2024 |
Anthropic's Claude 3 Opus reaches roughly 99.9% accuracy on 20-digit addition, well beyond what common internet data would give.
Factual · 12 Apr 2024 |
AI capabilities |
| Resolved true |
Factual |
12 Apr 2024 |
Anthropic's models are currently at AI Safety Level ASL-2.
Factual · 12 Apr 2024 |
Their own work or organisation |
| Own records only |
Factual |
12 Apr 2024 |
Anthropic has already secured the compute it needs for 2024, and Amodei expects next year's compute to be sufficient too.
Factual · 12 Apr 2024 |
AI compute, hardware and data |
| Own records only |
Factual |
12 Apr 2024 |
In Amodei's short-term personal experience, he has always found a workflow in which AI tools assist him.
Factual · 12 Apr 2024 |
Their own work or organisation |
| Unresolvable |
Factual |
8 Aug 2023 |
Dario Amodei did not think AI scaling would hit a wall, and a few other people shared that view, when a wall was a more plausible case.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Unresolvable |
Factual |
8 Aug 2023 |
As of 2023, the model can be very good at coding but can't quite prove the prime number theorem yet.
Factual · 8 Aug 2023 |
AI capabilities |
| Own records only |
Factual |
8 Aug 2023 |
Anthropic has generally found that hired physics PhDs can learn machine learning and contribute very quickly in most cases.
Factual · 8 Aug 2023 |
Field building and careers |
| Mostly true |
Factual |
8 Aug 2023 |
Anthropic published a blog post on security stating it has a two-key system for access to model weights.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Own records only |
Factual |
8 Aug 2023 |
Anthropic has worked to ensure the data center used for its models is located in the United States.
Factual · 8 Aug 2023 |
AI compute, hardware and data |
| Mostly true |
Factual |
8 Aug 2023 |
As of August 2023, mechanistic interpretability is not nearly capable enough to verify that a model is aligned.
Factual · 8 Aug 2023 |
AI safety and alignment |
| Unresolvable |
Factual |
8 Aug 2023 |
AI scaling laws are sometimes predictable to several significant figures, which is not seen outside of physics.
Factual · 8 Aug 2023 |
AI capabilities |
| Unresolvable |
Factual |
8 Aug 2023 |
As of 2023, many firms rushing to deploy AI systems are not using them in anywhere near the most efficient way possible.
Factual · 8 Aug 2023 |
AI, the economy and work |
| Mostly true |
Factual |
8 Aug 2023 |
Existing alignment methods succeed in aligning AI systems for today's tasks.
Factual · 8 Aug 2023 |
AI safety and alignment |
| Unresolvable |
Factual |
8 Aug 2023 |
Current AI models may be superhuman or close to superhuman at constrained writing, such as writing a page without the letter E.
Factual · 8 Aug 2023 |
AI capabilities |
| Own records only |
Factual |
8 Aug 2023 |
Dario Amodei has pushed for better cybersecurity at every organisation where he has worked.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Resolved true |
Factual |
8 Aug 2023 |
Amodei said Anthropic "kind of" already does reinforcement learning, through RLHF.
Factual · 8 Aug 2023 |
AI capabilities |
| Own records only |
Factual |
8 Aug 2023 |
Anthropic's current security measures are not sufficient against a super determined state-level actor.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Mostly true |
Factual |
8 Aug 2023 |
Anthropic's initial constitution for its models drew on broadly agreed sources such as the UN Declaration of Human Rights and parts of Apple's Terms of Service.
Factual · 8 Aug 2023 |
AI safety and alignment |
| Own records only |
Factual |
8 Aug 2023 |
Dario Amodei formed his view on scaling gradually between 2014 and 2017.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Unresolvable |
Factual |
8 Aug 2023 |
Interpretability work on language models, such as induction heads, suggests much of the cognitive machinery needed for active agents is already present in base language models.
Factual · 8 Aug 2023 |
AI capabilities |
| Unresolvable |
Factual |
8 Aug 2023 |
AI language models learn to speak fluent Base64, which humans do not typically learn.
Factual · 8 Aug 2023 |
AI capabilities |
| Own records only |
Factual |
8 Aug 2023 |
Anthropic is focusing heavily on cybersecurity, including working with its cloud providers.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Own records only |
Factual |
8 Aug 2023 |
Every traditional investor who invests in Anthropic looks at its unusual governance body.
Factual · 8 Aug 2023 |
Their own work or organisation |
| Unresolvable |
Factual |
13 Oct 2022 |
Amodei said he does not believe US export controls were ever designed to prevent China from obtaining a few tens of thousands of chips.
Factual · 13 Oct 2022 |
AI policy and governance |
| Unresolvable |
Factual |
13 Oct 2022 |
DeepSeek, a Chinese company, was the first to demonstrate the expected AI cost reductions, which had never before happened with a Chinese company.
Factual · 13 Oct 2022 |
Economics and markets |
| Mostly true |
Factual |
13 Oct 2022 |
Because reasoning-focused RL is new, the amount all AI developers spend on the RL training stage is still small, so the field is early on its scaling curve.
Factual · 13 Oct 2022 |
AI compute, hardware and data |
| Resolved true |
Factual |
13 Oct 2022 |
The current rate of algorithmic curve shift is maybe about 4x per year.
Factual · 13 Oct 2022 |
AI compute, hardware and data |
| Own records only |
Factual |
13 Oct 2022 |
DeepSeek-V3 was the real innovation and should have made people take notice a month before this statement, and the speaker says that "we" did take notice of it.
Factual · 13 Oct 2022 |
AI capabilities |
| Unresolvable |
Factual |
13 Oct 2022 |
Anthropic finds Claude 3.5 Sonnet remains much better than DeepSeek-V3 on some key tasks such as real-world coding.
Factual · 13 Oct 2022 |
AI capabilities |
| Mixed |
Factual |
13 Oct 2022 |
DeepSeek was not substantially more resource-constrained than US AI companies, and export controls were not the main factor causing its innovation.
Factual · 13 Oct 2022 |
AI policy and governance |
| Mostly true |
Factual |
13 Oct 2022 |
Dario Amodei and his co-founders were among the first to document, while at OpenAI, that scaling up AI training smoothly improves results across a range of cognitive tasks.
Factual · 13 Oct 2022 |
Their own work or organisation |
| Mostly true |
Factual |
13 Oct 2022 |
Improvements in training cost efficiency typically lead AI companies to spend more, not less, on training models.
Factual · 13 Oct 2022 |
Economics and markets |
| Resolved true |
Factual |
13 Oct 2022 |
Amodei said he thinks a fair statement is that DeepSeek produced a model close in performance to US models 7-10 months older, at a good deal less cost but not near the ratios people have suggested.
Factual · 13 Oct 2022 |
Economics and markets |
| Own records only |
Factual |
21 Jul 2017 |
Around 2015, Dario Amodei often argued that a relatively peaceful geopolitical period made it a good time for AGI to be built.
Factual · 21 Jul 2017 |
AI timelines and forecasting |
| Resolved true |
Factual |
21 Jul 2017 |
OpenAI and DeepMind both have a focus on safety and both have safety teams.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Mostly true |
Factual |
21 Jul 2017 |
Getting started in machine learning probably requires about a thousand dollars to buy a GPU.
Factual · 21 Jul 2017 |
Field building and careers |
| Mostly true |
Factual |
21 Jul 2017 |
There was a lot of political instability in the western world in the year before July 2017.
Factual · 21 Jul 2017 |
Philosophy, ethics and society |
| Own records only |
Factual |
21 Jul 2017 |
OpenAI does not lower its machine learning hiring bar for people who want to work on safety.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Factual |
21 Jul 2017 |
Vicarious does not think about AI safety, to Amodei's knowledge.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Own records only |
Factual |
21 Jul 2017 |
Amodei said that he and OpenAI focus a lot on reinforcement learning because it, and extended versions of it, seems a better fit for what intelligent agents do in general.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Own records only |
Factual |
21 Jul 2017 |
Amodei said he thinks that, broadly, most people at OpenAI are worried about the issues under discussion or at least think they are worth thinking about, and he set this apart from the staff actively doing technical work on them.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Factual |
21 Jul 2017 |
Dario Amodei mainly works on safety at OpenAI.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Own records only |
Factual |
21 Jul 2017 |
Dario Amodei has not been closely involved in OpenAI's rapid hiring and growth, except on the safety side.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Mixed |
Factual |
21 Jul 2017 |
For almost a decade before 2017, self-driving cars have existed that are 99.9% safe.
Factual · 21 Jul 2017 |
AI capabilities |
| Unresolvable |
Factual |
21 Jul 2017 |
The Concrete Problems in AI Safety paper did not discuss the transparency of neural nets.
Factual · 21 Jul 2017 |
AI safety and alignment |
| Resolved true |
Factual |
21 Jul 2017 |
Dario Amodei's PhD was not in machine learning.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Factual |
21 Jul 2017 |
Statistical AI systems have pretty decisively won out over rule-based systems.
Factual · 21 Jul 2017 |
AI capabilities |
| Resolved true |
Factual |
21 Jul 2017 |
OpenAI is a nonprofit AI research lab.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Unresolvable |
Factual |
21 Jul 2017 |
Amodei said he thinks OpenAI has generally been very selective in whom it picks.
Factual · 21 Jul 2017 |
Their own work or organisation |
| Mixed |
Factual |
17 Aug 2015 |
Poorly implemented services are currently a major driver of cynicism about government.
Factual · 17 Aug 2015 |
AI policy and governance |
| Mostly true |
Factual |
17 Aug 2015 |
The impact of nuclear power, supersonic flight and elevators has been substantially reduced by regulations or misplaced fears despite working well technically.
Factual · 17 Aug 2015 |
AI policy and governance |
| Unresolvable |
Factual |
17 Aug 2015 |
Successful biology projects are often scrappy or afterthoughts not initially thought promising, rather than massively funded efforts.
Factual · 17 Aug 2015 |
Science and research methods |
| Mostly true |
Factual |
17 Aug 2015 |
Diseases have been eradicated and many countries have gone from poor to rich, through decisions that exhibit high returns to intelligence.
Factual · 17 Aug 2015 |
Economics and markets |
| Mostly true |
Factual |
17 Aug 2015 |
Although drug development is overly cumbersome, once developed drugs are generally successfully deployed and used.
Factual · 17 Aug 2015 |
Economics and markets |
| Unresolvable |
Factual |
17 Aug 2015 |
In recent years GWAS studies seem to suggest that correlations between psychiatric disease genes and positive traits might have been overstated.
Factual · 17 Aug 2015 |
Science and research methods |
| Unresolvable |
Factual |
17 Aug 2015 |
Over the last 30 years, mathematicians, computer scientists and physicists applying their skills to biology have been quite successful but have not had the truly transformative impact initially hoped for.
Factual · 17 Aug 2015 |
Science and research methods |
| Mixed |
Factual |
17 Aug 2015 |
Human economic planners made the decisions that led to several East Asian economies' late-20th-century growth by pulling a few key levers such as export-led industrial policy, not by directly controlling whole economies.
Factual · 17 Aug 2015 |
Economics and markets |
| Unresolvable |
Factual |
17 Aug 2015 |
Markets function better in the developed world and are typically good at bringing down the cost of high-value technologies over time.
Factual · 17 Aug 2015 |
Economics and markets |
| Unresolvable |
Factual |
17 Aug 2015 |
There is perhaps about one major biology discovery per year, and collectively these arguably drive over 50% of progress in biology.
Factual · 17 Aug 2015 |
Science and research methods |
| Mixed |
Factual |
17 Aug 2015 |
Smallpox was fully eliminated in the 1970s, and polio and guinea worm are nearly eradicated with fewer than 100 cases per year.
Factual · 17 Aug 2015 |
Biosecurity |
| Unresolvable |
Factual |
17 Aug 2015 |
Dario Amodei thinks and talks a lot about the risks of powerful AI.
Factual · 17 Aug 2015 |
Their own work or organisation |