| Mostly true |
Factual |
4 Mar 2022 |
Daniela Amodei said she thinks some of "our employees" identify as effective altruists, which she said means they are especially worried about the potential for long-term harms from AI.
Factual · 4 Mar 2022 |
Field building and careers |
| Not checkable |
Not checkable |
4 Mar 2022 |
how quietly and seamlessly people are becoming dependent on some of these systems.
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
it can produce results that on the surface, it might look like it could be a credible answer, but it's really not a credible answer, and it…
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
we ultimately hope that some of the work that we do is going to be adopted and even expanded on in other organizations
Not checkable · 4 Mar 2022 |
|
| Mostly true |
Factual |
4 Mar 2022 |
The goal of NIST's AI Risk Management Framework is to develop more monitoring tools for AI risk and its management.
Factual · 4 Mar 2022 |
AI policy and governance |
| Mostly false |
Factual |
4 Mar 2022 |
Shareholders cannot sue Anthropic for failing to maximize financial returns when those conflict with its public benefit.
Factual · 4 Mar 2022 |
Economics and markets |
| Not checkable |
Not checkable |
4 Mar 2022 |
a genuine desire to reduce the risks and increase the potential benefits from AI.
Not checkable · 4 Mar 2022 |
|
| Mostly true |
Factual |
4 Mar 2022 |
As of 2022 there is no required disclosure of whether a person is interacting with an AI system or a human.
Factual · 4 Mar 2022 |
AI policy and governance |
| Mostly true |
Factual |
4 Mar 2022 |
Daniela Amodei said Dario Amodei was getting a PhD in a technical field at the time and so was not working directly on the interest area she described, which she connected with her start in international development.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Not checkable |
Not checkable |
4 Mar 2022 |
for the majority of our lives, I think we've wanted to find something to work together on and it's been really awesome that we've been able…
Not checkable · 4 Mar 2022 |
|
| Mostly false |
Factual |
4 Mar 2022 |
Anthropic's PBC status legally ensures that, if profit and public benefit conflict, public benefit prevails.
Factual · 4 Mar 2022 |
Economics and markets |
| Unresolvable |
Factual |
4 Mar 2022 |
Anthropic is looking to hire front-end engineers for interfaces and tooling for internal research.
Factual · 4 Mar 2022 |
Field building and careers |
| Unresolvable |
Factual |
4 Mar 2022 |
Machine learning and AI is still a fairly new field.
Factual · 4 Mar 2022 |
AI capabilities |
| Resolved true |
Factual |
4 Mar 2022 |
As a public benefit corporation, Anthropic has more legal protection from shareholders if it fails to maximize financial interests in favor of its public benefit mission.
Factual · 4 Mar 2022 |
Economics and markets |
| Not checkable |
Not checkable |
4 Mar 2022 |
running experiments on AI systems is something that requires a lot of custom software and tooling.
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
there's a way that industry incentives are not the same as nonprofit groups or as civil society groups.
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
until we have that common language or framework, it's hard to set things like standards across the industry around what safety even means.
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
I am really hopeful about the future.
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
These are important problems today.
Not checkable · 4 Mar 2022 |
|
| Unresolvable |
Factual |
4 Mar 2022 |
Anthropic's Twitter handle is @anthropicAI.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Unresolvable |
Promise |
4 Mar 2022 |
Daniela Amodei said Anthropic hoped to publish soon a paper that discusses the role government could play in funding academic AI safety research.
Promise · 4 Mar 2022 |
AI policy and governance |
| Not checkable |
Not checkable |
4 Mar 2022 |
I think the more people working on safety-related topics, that can positively feed on itself.
Not checkable · 4 Mar 2022 |
|
| Resolved true |
Factual |
4 Mar 2022 |
Anthropic conducts interpretability research aimed at seeing inside language models and understanding their workings.
Factual · 4 Mar 2022 |
AI safety and alignment |
| Mostly true |
Factual |
4 Mar 2022 |
Public benefit corporations are fairly similar to C corporations, a standard corporate entity.
Factual · 4 Mar 2022 |
Economics and markets |
| Unresolvable |
Factual |
4 Mar 2022 |
Anthropic has a Twitter account.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Not checkable |
Not checkable |
4 Mar 2022 |
And the reason for that is because we've really taken the time to chart them out and understand what all of those potential problems could…
Not checkable · 4 Mar 2022 |
|
| Own records only |
Factual |
4 Mar 2022 |
She said that she and her colleagues think government has already been starting to fund a lot more academic safety research.
Factual · 4 Mar 2022 |
AI policy and governance |
| Own records only |
Factual |
4 Mar 2022 |
Daniela and Dario Amodei both donated small amounts to global health organizations, such as malaria prevention groups, while still in school.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Unresolvable |
Factual |
4 Mar 2022 |
Anthropic's website states its mission as building steerable, interpretable and reliable AI systems.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Own records only |
Factual |
4 Mar 2022 |
Anthropic's societal impacts team is about 1.5 people and has been working on AI evaluations.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Not checkable |
Not checkable |
4 Mar 2022 |
There's something everyone really agrees on in industry and outside of industry, which is that security is really important.
Not checkable · 4 Mar 2022 |
|
| Own records only |
Factual |
4 Mar 2022 |
At Anthropic there is no strong distinction between research and engineering: researchers write code and engineers contribute to research.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Unresolvable |
Prediction |
4 Mar 2022 |
Daniela Amodei said she hopes that in the next few years many different groups will develop more practical tools and techniques for advancing AI safety research.
Prediction · 4 Mar 2022 |
AI safety and alignment |
| Not checkable |
Not checkable |
4 Mar 2022 |
we really need thoughtful and empowered organizations that are working on these kinds of questions, fundamentally outside of the industry…
Not checkable · 4 Mar 2022 |
|
| Own records only |
Factual |
4 Mar 2022 |
Anthropic's policy team is about 1.5 people as of late 2022.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Own records only |
Factual |
4 Mar 2022 |
As of November 2022, the organisation Daniela Amodei was speaking for was very bottlenecked on engineering talent.
Factual · 4 Mar 2022 |
Field building and careers |
| Unresolvable |
Prediction |
4 Mar 2022 |
More advanced AI systems could bring transformative benefits in areas such as renewable energy, health, disease detection and economic growth.
Prediction · 4 Mar 2022 |
AI capabilities |
| Unresolvable |
Factual |
4 Mar 2022 |
Anthropic generally tweets about its recent research releases from its Twitter account.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Not researched |
Factual |
4 Mar 2022 |
Daniela Amodei began her career in international development.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Not checkable |
Not checkable |
4 Mar 2022 |
And I think I'm most broadly hoping for a world where we can feel confident that when we're using AI for more advanced purposes, like…
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
I think their goal is to really take the technical content that we are developing at Anthropic and translate that into something that is…
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
And again, I'm not a lawyer but that's my understanding of the PBC.
Not checkable · 4 Mar 2022 |
|
| Own records only |
Factual |
4 Mar 2022 |
Anthropic has had a lot of success hiring people accomplished in other fields, especially other technical fields.
Factual · 4 Mar 2022 |
Field building and careers |
| Not checkable |
Not checkable |
4 Mar 2022 |
our bet is one we've talked about, which is this empirical scientific approach to doing AI research and AI safety research in particular.
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
I think communication with policy makers about safety with other labs in the form of papers that we publish is something that's very…
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
our kind of hope is that this will lead to more people doing interpretability research or kind of building on the work we've done in other…
Not checkable · 4 Mar 2022 |
|
| Resolved true |
Factual |
4 Mar 2022 |
Stripe had about 40 people when Daniela Amodei joined.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Not researched |
Factual |
4 Mar 2022 |
Daniela Amodei said she and her colleagues basically think some larger models have figured out how to lie unintentionally, and that posing the same question to them differently can eventually pin down the lie, "but they won't in other contexts."
Factual · 4 Mar 2022 |
AI safety and alignment |
| Not checkable |
Not checkable |
4 Mar 2022 |
I don't know that most people necessarily even know all the ways in which AI is impacting our kind of day-to-day lives today
Not checkable · 4 Mar 2022 |
|
| Own records only |
Factual |
4 Mar 2022 |
Daniela Amodei said she thinks many of Anthropic's best ML and research engineers came from software or infrastructure engineering backgrounds and had not necessarily worked in ML before.
Factual · 4 Mar 2022 |
Field building and careers |
| Unresolvable |
Factual |
4 Mar 2022 |
Anthropic has been supporting NIST in developing an AI Risk Management Framework.
Factual · 4 Mar 2022 |
AI policy and governance |
| Not checkable |
Not checkable |
4 Mar 2022 |
it allowed us the maximum amount of flexibility in how we can structure the organization
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
while machine learning experience is helpful for that, it isn't necessarily required.
Not checkable · 4 Mar 2022 |
|
| Resolved true |
Factual |
4 Mar 2022 |
Anthropic is currently focused on research and development rather than deployment of products for revenue.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Not checkable |
Not checkable |
4 Mar 2022 |
a combination of a set of two impulses that I think we've talked about a lot in this podcast.
Not checkable · 4 Mar 2022 |
|
| Mostly true |
Factual |
4 Mar 2022 |
People use online therapists, and sometimes the advice is backed by an AI system.
Factual · 4 Mar 2022 |
Technology |
| Not checkable |
Not checkable |
4 Mar 2022 |
I would just echo everything Dario said.
Not checkable · 4 Mar 2022 |
|
| Unresolvable |
Factual |
4 Mar 2022 |
Anthropic's website anthropic.com is the best place to see most of its recent work.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Own records only |
Factual |
4 Mar 2022 |
Anthropic staff all have lunch together every day.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Mostly true |
Factual |
4 Mar 2022 |
Anthropic is hiring a lot of people as of March 2022.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Not checkable |
Not checkable |
4 Mar 2022 |
I think the field will rise to the occasion, or that's kind of my hope.
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
having a wider range of views and perspectives and approaches tends to lead to a more robust approach to doing both basic research and…
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
A concrete policy recommendation is, hey, go do more of that.
Not checkable · 4 Mar 2022 |
|
| Resolved true |
Factual |
4 Mar 2022 |
Anthropic chose to incorporate as a public benefit corporation when it was founded.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Not checkable |
Not checkable |
4 Mar 2022 |
Yeah, thanks so much for having us, Lucas. This was really fun.
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
I really think of this as an ecosystem, and I think Anthropic is in an interesting place in the ecosystem, but we are part of the ecosystem.
Not checkable · 4 Mar 2022 |
|
| Own records only |
Factual |
4 Mar 2022 |
Anthropic has about 35 employees as of late 2022.
Factual · 4 Mar 2022 |
Their own work or organisation |
| Not checkable |
Not checkable |
4 Mar 2022 |
we were actually very lucky, to a later part of your question, to find both investors and employees who were generally very on board with…
Not checkable · 4 Mar 2022 |
|
| Not researched |
Factual |
4 Mar 2022 |
Anthropic has been supporting efforts in the US and internationally on how to support academic experimentation with large-scale compute models.
Factual · 4 Mar 2022 |
AI policy and governance |
| Not checkable |
Not checkable |
4 Mar 2022 |
that's the impetus behind why we're studying these larger models.
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
a lot of what Anthropic adds to this ecosystem or what we hope it adds is this rigorous scientific approach to doing fundamental research…
Not checkable · 4 Mar 2022 |
|
| Own records only |
Factual |
4 Mar 2022 |
Anthropic's PBC structure has little bearing on decisions about productization, deployment and revenue generation, beyond the legal protections discussed.
Factual · 4 Mar 2022 |
Economics and markets |
| Not checkable |
Not checkable |
4 Mar 2022 |
A lot of the goals are aligned there, both for sort of short, medium and potentially long-term safety.
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
part of what's valuable about a public benefit corporation is that it's flexible
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
4 Mar 2022 |
So for me, I feel like it's been an awesome experience.
Not checkable · 4 Mar 2022 |
|
| Not checkable |
Not checkable |
2022 |
something that I think is extremely important in creating robustly safe systems is making sure that you have a variety of different people…
Not checkable · 2022 |
|
| Not checkable |
Not checkable |
2022 |
it kind of blows my mind that AI, given the potential reach that it could have, is still such a largely unregulated area.
Not checkable · 2022 |
|
| Mixed |
Factual |
2022 |
Members of Anthropic's founding group had previously done a lot of safety research together at different organizations.
Factual · 2022 |
Their own work or organisation |
| Not checkable |
Not checkable |
2022 |
I think something we feel interested in, or interested to explore from this empirical safety question is just how they will, as their…
Not checkable · 2022 |
|
| Mostly true |
Factual |
2022 |
As of 2022 Anthropic pursues its mission primarily through generative model research and AI safety research.
Factual · 2022 |
Their own work or organisation |
| Mixed |
Factual |
2022 |
Other researchers and engineers have been using Anthropic's released interpretability tools and watching its videos.
Factual · 2022 |
Science and research methods |
| Mostly true |
Factual |
2022 |
Daniela Amodei said she thinks part of what Anthropic's AI safety research is seeing is that different sized models exhibit different safety issues.
Factual · 2022 |
AI safety and alignment |
| Not checkable |
Not checkable |
2022 |
I think it's really very cool to be able to combine the things that we are good at into hopefully running an organization well.
Not checkable · 2022 |
|
| Resolved true |
Factual |
2022 |
A few jobs before Anthropic, Daniela Amodei worked at the tech startup Stripe.
Factual · 2022 |
Their own work or organisation |
| Not researched |
Factual |
2022 |
Stripe is a payments company, not a social media company.
Factual · 2022 |
Economics and markets |
| Not checkable |
Not checkable |
2022 |
And the reason that we're doing that is we want to make the models safer and more aligned with human values.
Not checkable · 2022 |
|
| Not researched |
Factual |
2022 |
Anthropic released materials beyond an arXiv paper, including video lectures, for its interpretability research.
Factual · 2022 |
Science and research methods |
| Not checkable |
Not checkable |
2022 |
they might be either legitimately confused or they might be choosing to obscure information
Not checkable · 2022 |
|
| Mixed |
Factual |
2022 |
Anthropic's internal scientists red-team its models by asking them questions to find unwanted behaviors.
Factual · 2022 |
AI safety and alignment |
| Not checkable |
Not checkable |
2022 |
I think we've always had this uniting, top level goal of wanting to work on something that matters, something that's important and…
Not checkable · 2022 |
|
| Not checkable |
Not checkable |
2022 |
there is a way that technology is a relatively small number of people having a very high impact in the world per person working on it.
Not checkable · 2022 |
|
| Not checkable |
Not checkable |
2022 |
Lying usually implies agency.
Not checkable · 2022 |
|
| Not checkable |
Not checkable |
2022 |
but they're very different and they look very different and they sound very different
Not checkable · 2022 |
|
| Own records only |
Factual |
2022 |
Anthropic structures its teams with capabilities research as a central pillar and safety research wrapping around every project.
Factual · 2022 |
Their own work or organisation |
| Not researched |
Factual |
2022 |
Anthropic does alignment research using human feedback to improve model outputs.
Factual · 2022 |
AI safety and alignment |
| Not checkable |
Not checkable |
2022 |
we really just wanted the opportunity to get that group together to do this focused research bet of building steerable, interpretable and…
Not checkable · 2022 |
|
| Not checkable |
Not checkable |
2022 |
I think there's quite a lot of behaviors emerging in generative models today that I think have the potential to be fairly alarming.
Not checkable · 2022 |
|
| Not checkable |
Not checkable |
2022 |
I think it implies intentionality, and I don't think we think, or maybe anyone thinks that language models have that intentionality.
Not checkable · 2022 |
|
| Not checkable |
Not checkable |
2022 |
Safety problems are also very open ended.
Not checkable · 2022 |
|
| Not checkable |
Not checkable |
2022 |
I felt those causes that I was working in were deeply important
Not checkable · 2022 |
|