1,191 claims · page 3 of 12
| Verdict | Person | Kind | Said | Claim | Topic |
|---|---|---|---|---|---|
| Mostly true | Demis Hassabis | Factual | 3 Aug 2025 | Current AI systems still can't really yet go beyond asking novel questions or conjectures, or come up with new hypotheses not thought of before. Demis Hassabis · Factual · 3 Aug 2025 | AI capabilities |
| Mostly true | Demis Hassabis | Factual | 3 Aug 2025 | On average it takes ten years and billions of dollars to design one drug. Demis Hassabis · Factual · 3 Aug 2025 | Science and research methods |
| Mostly true | Demis Hassabis | Factual | 3 Aug 2025 | Everything in biology and the body depends on proteins. Demis Hassabis · Factual · 3 Aug 2025 | Science and research methods |
| Mostly true | Mark Zuckerberg | Factual | 30 Jul 2025 | Zuckerberg said Meta launched the Meta Quest 3S Xbox Edition in June 2025 ("last month", speaking on 2025-07-30) and that Meta is seeing record interest in cloud gaming. Mark Zuckerberg · Factual · 30 Jul 2025 | Technology |
| Mostly true | Mark Zuckerberg | Factual | 30 Jul 2025 | Over the last 5 to 10 years Meta's Reality Labs has been heavily researching different glasses and display technologies. Mark Zuckerberg · Factual · 30 Jul 2025 | Technology |
| Mostly true | Mark Zuckerberg | Factual | 30 Jul 2025 | Alexandr Wang is leading the overall Meta Superintelligence Labs team. Mark Zuckerberg · Factual · 30 Jul 2025 | Their own work or organisation |
| Mostly true | Mark Zuckerberg | Factual | 30 Jul 2025 | Meta launched AI video editing tools across Meta AI and its new Edits app. Mark Zuckerberg · Factual · 30 Jul 2025 | AI capabilities |
| Mostly true | Mark Zuckerberg | Factual | 30 Jul 2025 | The Oakley Meta HSTN glasses have longer battery life and a higher resolution camera and are designed for sports. Mark Zuckerberg · Factual · 30 Jul 2025 | Technology |
| Mostly true | Balaji Srinivasan | Factual | 28 Jul 2025 | Bitcoin is valued everywhere there is an internet connection. Balaji Srinivasan · Factual · 28 Jul 2025 | Economics and markets |
| Mostly true | Jeremy Grantham | Factual | 28 Jul 2025 | Thirty-one years after Japan's 1989 bubbles, Japanese land prices and stocks had not returned to their 1989 levels. Jeremy Grantham · Factual · 28 Jul 2025 | Economics and markets |
| Mostly true | Jeremy Grantham | Factual | 28 Jul 2025 | Emerging markets and value stocks trade at one of the two or three lowest relative valuation points in history compared to the U.S. Jeremy Grantham · Factual · 28 Jul 2025 | Economics and markets |
| Mostly true | Balaji Srinivasan | Factual | 28 Jul 2025 | Doors, including house doors, can be secured with an onchain smart lock controlled by crypto. Balaji Srinivasan · Factual · 28 Jul 2025 | Technology |
| Mostly true | Gary Marcus | Prediction | 27 Jul 2025 | Some of GPT-5's advice will be very bad. Gary Marcus · Prediction · 27 Jul 2025 | AI capabilities |
| Mostly true | Gary Marcus | Prediction | 27 Jul 2025 | GPT-5 will be considerably better than GPT-4. Gary Marcus · Prediction · 27 Jul 2025 | AI capabilities |
| Mostly true | Demis Hassabis | Factual | 23 Jul 2025 | Video models such as Veo 3 can pretty accurately generate about eight seconds of video that, by eye and at a glance, looks consistent. Demis Hassabis · Factual · 23 Jul 2025 | AI capabilities |
| Mostly true | Demis Hassabis | Factual | 23 Jul 2025 | Veo, Google DeepMind's video generation model, can model liquids surprisingly well. Demis Hassabis · Factual · 23 Jul 2025 | AI capabilities |
| Mostly true | Demis Hassabis | Factual | 23 Jul 2025 | Google DeepMind built DolphinGemma, a version of its system trained on dolphin and whale sounds. Demis Hassabis · Factual · 23 Jul 2025 | Science and research methods |
| Mostly true | Ray Dalio | Factual | 10 Jun 2025 | Recently US bond prices have fallen while the dollar weakened, and gold and stock prices have risen. Ray Dalio · Factual · 10 Jun 2025 | Economics and markets |
| Mostly true | Ray Dalio | Prediction | 10 Jun 2025 | If current congressional plans go forward, the US federal deficit will be about 7% of GDP. Ray Dalio · Prediction · 10 Jun 2025 | Economics and markets |
| Mostly true | Dario Amodei | Factual | 5 Jun 2025 | Distillation of frontier models lets lagging companies narrow the gap at a fraction of the cost of developing their own AI independently. Dario Amodei · Factual · 5 Jun 2025 | AI compute, hardware and data |
| Mostly true | Dario Amodei | Promise | 5 Jun 2025 | Anthropic is unilaterally committing now to the step of embedding third-party evaluators, which it describes as the key step for verifying any pacing commitments, comparable to regulatory supervisors embedded alongside employees in banking. Dario Amodei · Promise · 5 Jun 2025 | AI safety and alignment |
| Mostly true | Dario Amodei | Factual | 5 Jun 2025 | Dario Amodei has worked on AI for the last twelve years. Dario Amodei · Factual · 5 Jun 2025 | Their own work or organisation |
| Mostly true | Nate Silver | Factual | 8 Apr 2025 | The average US tariff rate on the rest of the world was at least 23% as of April 2025. Nate Silver · Factual · 8 Apr 2025 | Economics and markets |
| Mostly true | Nate Silver | Factual | 8 Apr 2025 | The two special elections held in early April 2025 were in extremely Republican-leaning, rural Florida districts. Nate Silver · Factual · 8 Apr 2025 | AI policy and governance |
| Mostly true | Scott Alexander | Factual | 3 Apr 2025 | Through history, people have been reluctant to admit an AI is truly intelligent. Scott Alexander · Factual · 3 Apr 2025 | Philosophy, ethics and society |
| Mostly true | Scott Alexander | Prediction | 3 Apr 2025 | The authors of the scenario think coding is what will start the intelligence explosion. Scott Alexander · Prediction · 3 Apr 2025 | AI capabilities |
| Mostly true | Scott Alexander | Prediction | 3 Apr 2025 | In the AI 2027 scenario, as AI labs become more capable they tell the government, seeking government contracts and support. Scott Alexander · Prediction · 3 Apr 2025 | AI policy and governance |
| Mostly true | Scott Alexander | Prediction | 3 Apr 2025 | In the AI 2027 scenario, the government sees via cyber warfare that AIs are as capable as the best human hackers but deployable at huge scale. Scott Alexander · Prediction · 3 Apr 2025 | AI policy and governance |
| Mostly true | Dario Amodei | Factual | 10 Mar 2025 | Anthropic was the first AI company to have a responsible scaling policy. Dario Amodei · Factual · 10 Mar 2025 | AI policy and governance |
| Mostly true | Dario Amodei | Factual | 10 Mar 2025 | Within a few months of Anthropic releasing its responsible scaling policy, the other AI companies all adopted similar policies. Dario Amodei · Factual · 10 Mar 2025 | AI policy and governance |
| Mostly true | Dario Amodei | Factual | 10 Mar 2025 | Amodei said he thinks delaying Claude's release had real commercial consequences for Anthropic. Dario Amodei · Factual · 10 Mar 2025 | Their own work or organisation |
| Mostly true | Dario Amodei | Prediction | 10 Mar 2025 | Anthropic's models may reach AI Safety Level 3 in 2025. Dario Amodei · Prediction · 10 Mar 2025 | AI timelines and forecasting |
| Mostly true | Dario Amodei | Factual | 10 Mar 2025 | Dario Amodei has supported export controls on chips for several years, before DeepSeek's model came out. Dario Amodei · Factual · 10 Mar 2025 | AI policy and governance |
| Mostly true | Dario Amodei | Prediction | 28 Feb 2025 | In the short run (about 6 to 12 months), AI will augment and increase coders' productivity rather than replace them. Dario Amodei · Prediction · 28 Feb 2025 | AI, the economy and work |
| Mostly true | Dario Amodei | Factual | 28 Feb 2025 | Anthropic ran an experiment training a model to be helpful, honest, harmless and friendly. Dario Amodei · Factual · 28 Feb 2025 | AI safety and alignment |
| Mostly true | Dario Amodei | Factual | 28 Feb 2025 | Amodei said he thinks AI coding is moving the fastest of all the areas of AI. Dario Amodei · Factual · 28 Feb 2025 | AI capabilities |
| Mostly true | Dario Amodei | Factual | 28 Feb 2025 | The model sometimes gives a very short response because, when it knows it gains nothing from thinking further, it does not think for longer; a bound on how long it thinks is still described as valuable. Dario Amodei · Factual · 28 Feb 2025 | AI capabilities |
| Mostly true | Ray Dalio | Factual | 22 Feb 2025 | The United States designs chips but cannot produce chips effectively. Ray Dalio · Factual · 22 Feb 2025 | AI compute, hardware and data |
| Mostly true | Ray Dalio | Factual | 22 Feb 2025 | Indonesia has the second highest happiness rating. Ray Dalio · Factual · 22 Feb 2025 | Philosophy, ethics and society |
| Mostly true | Ray Dalio | Factual | 22 Feb 2025 | 60% of Americans read below a sixth-grade level. Ray Dalio · Factual · 22 Feb 2025 | Field building and careers |
| Mostly true | Dario Amodei | Factual | 18 Feb 2025 | The lack of understanding of how AI systems work is essentially unprecedented in the history of technology. Dario Amodei · Factual · 18 Feb 2025 | AI safety and alignment |
| Mostly true | Dario Amodei | Factual | 18 Feb 2025 | When Anthropic was founded, its founders made mechanistic interpretability a central part of the company's direction, focused on LLMs. Dario Amodei · Factual · 18 Feb 2025 | Their own work or organisation |
| Mostly true | Dario Amodei | Factual | 18 Feb 2025 | Amodei said that "we" were able to provide a strong theoretical basis for having conviction that superposition was the right hypothesis to pursue; the surrounding text does not say who "we" refers to. Dario Amodei · Factual · 18 Feb 2025 | AI safety and alignment |
| Mostly true | Dario Amodei | Factual | 18 Feb 2025 | It became clear that superposition would be a central problem for language models, much worse than in vision models. Dario Amodei · Factual · 18 Feb 2025 | AI safety and alignment |
| Mostly true | Dario Amodei | Factual | 18 Feb 2025 | Modern generative AI systems are opaque in a way that fundamentally differs from traditional software. Dario Amodei · Factual · 18 Feb 2025 | AI safety and alignment |
| Mostly true | Dario Amodei | Factual | 18 Feb 2025 | Circuits, groups of features, allow researchers to trace an AI model's thinking steps. Dario Amodei · Factual · 18 Feb 2025 | AI safety and alignment |
| Mostly true | Marc Andreessen | Factual | 26 Jan 2025 | Substack started from scratch and declared up front that it would be a free speech platform. Marc Andreessen · Factual · 26 Jan 2025 | Their own work or organisation |
| Mostly true | Marc Andreessen | Prediction | 26 Jan 2025 | The incoming Trump administration will do as much as it can through executive orders and then use legislation and regulatory changes for the rest. Marc Andreessen · Prediction · 26 Jan 2025 | AI policy and governance |
| Mostly true | Marc Andreessen | Factual | 26 Jan 2025 | Marc Andreessen is a volunteer for the Trump administration when helpful, does not make its decisions and cannot speak for it. Marc Andreessen · Factual · 26 Jan 2025 | AI policy and governance |
| Mostly true | Marc Andreessen | Factual | 26 Jan 2025 | The US Constitution requires Congress to authorize money to be spent by the executive branch. Marc Andreessen · Factual · 26 Jan 2025 | AI policy and governance |
| Mostly true | Marc Andreessen | Factual | 26 Jan 2025 | Under the current interpretation of appropriations, a president who does not want to spend appropriated money cannot decline to spend it. Marc Andreessen · Factual · 26 Jan 2025 | AI policy and governance |
| Mostly true | Marc Andreessen | Factual | 26 Jan 2025 | Incumbent universities, through accreditation, are in complete control of who gets access to federal student loan money. Marc Andreessen · Factual · 26 Jan 2025 | Other |
| Mostly true | Marc Andreessen | Factual | 26 Jan 2025 | Marc Andreessen does not speak for DOGE and is not in charge of DOGE. Marc Andreessen · Factual · 26 Jan 2025 | AI policy and governance |
| Mostly true | Marc Andreessen | Factual | 26 Jan 2025 | The United States is the main place where the world's best and brightest foreign students get educated. Marc Andreessen · Factual · 26 Jan 2025 | AI, the economy and work |
| Mostly true | Marc Andreessen | Factual | 26 Jan 2025 | The US is adding a trillion dollars to the national debt every 100 days, and it is now passing the size of the Defense Department budget and compounding. Marc Andreessen · Factual · 26 Jan 2025 | Economics and markets |
| Mostly true | Marc Andreessen | Factual | 26 Jan 2025 | Marc Andreessen has made the argument in favour of high-skilled immigration and H-1B visas many times. Marc Andreessen · Factual · 26 Jan 2025 | AI, the economy and work |
| Mostly true | Marc Andreessen | Factual | 26 Jan 2025 | Marc Andreessen joined the Facebook board in 2007. Marc Andreessen · Factual · 26 Jan 2025 | Their own work or organisation |
| Mostly true | Mark Zuckerberg | Prediction | 10 Jan 2025 | Changing Meta's content filters to require higher confidence and precision will reduce the vast majority of Meta's censorship mistakes. Mark Zuckerberg · Prediction · 10 Jan 2025 | Their own work or organisation |
| Mostly true | Mark Zuckerberg | Factual | 10 Jan 2025 | Someone in Pakistan tried to get Zuckerberg sentenced to death, bringing a criminal proceeding over a Facebook picture of the prophet Muhammad. Mark Zuckerberg · Factual · 10 Jan 2025 | Philosophy, ethics and society |
| Mostly true | Mark Zuckerberg | Factual | 10 Jan 2025 | Apple built a protocol for connecting accessories to the iPhone that is not encrypted (plain text). Mark Zuckerberg · Factual · 10 Jan 2025 | Technology |
| Mostly true | Mark Zuckerberg | Factual | 10 Jan 2025 | The body has redundant neural pathways to the hand because the ability to use the hand is very important. Mark Zuckerberg · Factual · 10 Jan 2025 | Technology |
| Mostly true | Jensen Huang | Factual | 7 Jan 2025 | NVIDIA fine-tuned Llama models and turned them into the Llama Nemotron suite of open models. Jensen Huang · Factual · 7 Jan 2025 | AI capabilities |
| Mostly true | Jensen Huang | Factual | 7 Jan 2025 | NVIDIA Cosmos is trained on 20 million hours of video. Jensen Huang · Factual · 7 Jan 2025 | AI capabilities |
| Mostly true | Jensen Huang | Factual | 7 Jan 2025 | NVIDIA's Blackwell chip is in full production as of January 2025. Jensen Huang · Factual · 7 Jan 2025 | AI compute, hardware and data |
| Mostly true | Jensen Huang | Factual | 7 Jan 2025 | NVIDIA invented the programmable GPU in 1999, six years after the UDA work described just before in the speech, and this started more than 20 years of advances in the GPU. Jensen Huang · Factual · 7 Jan 2025 | Technology |
| Mostly true | Jensen Huang | Factual | 7 Jan 2025 | The RTX 50 series Blackwell GPU has 92 billion transistors, 4,000 TOPS and four petaflops of AI, three times the previous-generation Ada. Jensen Huang · Factual · 7 Jan 2025 | Technology |
| Mostly true | Jensen Huang | Factual | 7 Jan 2025 | NVIDIA invented neural texture compression and neural material shading. Jensen Huang · Factual · 7 Jan 2025 | Technology |
| Mostly true | Jensen Huang | Factual | 7 Jan 2025 | In the RTX 50 (Blackwell) generation the programmable shader can process neural networks. Jensen Huang · Factual · 7 Jan 2025 | Technology |
| Mostly true | Jensen Huang | Factual | 7 Jan 2025 | NVIDIA's AI Blueprints are completely open source. Jensen Huang · Factual · 7 Jan 2025 | Technology |
| Mostly true | Rodney Brooks | Factual | 1 Jan 2025 | Zoox has purpose-built vehicles with no steering wheel or brake and accelerator pedals. Rodney Brooks · Factual · 1 Jan 2025 | Technology |
| Mostly true | Gary Marcus | Factual | 1 Jan 2025 | OpenAI has returned no profits, does not expect profits until at least 2029, has a burn rate in the billions, and lacks a clear technical moat. Gary Marcus · Factual · 1 Jan 2025 | Economics and markets |
| Mostly true | Gary Marcus | Prediction | 1 Jan 2025 | A large-scale cyberattack in which generative AI plays an important causal role may well occur in 2025. Gary Marcus · Prediction · 1 Jan 2025 | Other global risks |
| Mostly true | Gary Marcus | Prediction | 1 Jan 2025 | Few if any radiologists will be replaced by AI in 2025. Gary Marcus · Prediction · 1 Jan 2025 | AI, the economy and work |
| Mostly true | Gary Marcus | Prediction | 1 Jan 2025 | Neurosymbolic AI will become much more prominent in 2025. Gary Marcus · Prediction · 1 Jan 2025 | AI capabilities |
| Mostly true | Rodney Brooks | Factual | 1 Jan 2025 | Both billionaire founders of the two suborbital tourism companies have flown to space on their own craft. Rodney Brooks · Factual · 1 Jan 2025 | Economics and markets |
| Mostly true | Gary Marcus | Prediction | 1 Jan 2025 | OpenAI's Sora will continue to have trouble with physics in 2025. Gary Marcus · Prediction · 1 Jan 2025 | AI capabilities |
| Mostly true | Rodney Brooks | Factual | 1 Jan 2025 | In the 2017 'Attention Is All You Need' transformer architecture, each column from bottom to top is a pure feed-forward network with no search, iteration or conventional algorithm. Rodney Brooks · Factual · 1 Jan 2025 | AI capabilities |
| Mostly true | Warren Buffett | Promise | 2025 | Buffett will personally match whatever is raised through the sale of the 20 autographed "Charlie" books for the Stephen Center. Warren Buffett · Promise · 2025 | Their own work or organisation |
| Mostly true | Gary Marcus | Factual | 2025 | People put instructions in LLM system prompts but cannot get the systems to follow them. Gary Marcus · Factual · 2025 | AI safety and alignment |
| Mostly true | Elon Musk | Factual | 2025 | Many index and passive funds vote in line with Glass Lewis and ISS recommendations. Elon Musk · Factual · 2025 | Economics and markets |
| Mostly true | Michael Burry | Factual | 2025 | Scion's agreements with counterparties required daily collateral valuation in both directions. Michael Burry · Factual · 2025 | Their own work or organisation |
| Mostly true | Gary Marcus | Factual | 2025 | LLMs, which are not AGI, are already eliminating some human work. Gary Marcus · Factual · 2025 | AI, the economy and work |
| Mostly true | Michael Burry | Factual | 2025 | Michael Burry earned a bachelor's degree in economics at UCLA and then an MD at Vanderbilt School of Medicine. Michael Burry · Factual · 2025 | Their own work or organisation |
| Mostly true | Elon Musk | Factual | 2025 | A company that has already gone public cannot create a super voting stock. Elon Musk · Factual · 2025 | Economics and markets |
| Mostly true | Warren Buffett | Factual | 2025 | Becky Quick and her CNBC crew transmit Berkshire's meetings worldwide and archive much Berkshire-related material. Warren Buffett · Factual · 2025 | Their own work or organisation |
| Mostly true | Satya Nadella | Factual | 2025 | Microsoft Office was first created for the Mac, before Windows existed. Satya Nadella · Factual · 2025 | Their own work or organisation |
| Mostly true | Michael Burry | Factual | 2025 | Blue Ocean Re was set up in late 2005 to take advantage of what Burry called an extraordinary pricing ability in the retrocessional reinsurance space. Michael Burry · Factual · 2025 | Their own work or organisation |
| Mostly true | Michael Burry | Factual | 2025 | Burry's main contact at Goldman Sachs was Veronica, a front-end salesperson. Michael Burry · Factual · 2025 | Their own work or organisation |
| Mostly true | Elon Musk | Factual | 30 Dec 2024 | Community Notes only shows a note when people who have historically disagreed agree that it is valid. Elon Musk · Factual · 30 Dec 2024 | Their own work or organisation |
| Mostly true | Tyler Cowen | Factual | 25 Dec 2024 | As of December 2024, OpenAI's o1 pro is the best AI model available. Tyler Cowen · Factual · 25 Dec 2024 | AI capabilities |
| Mostly true | Tyler Cowen | Factual | 25 Dec 2024 | The Biden administration relied much less on economists than the Obama administration did. Tyler Cowen · Factual · 25 Dec 2024 | Other |
| Mostly true | Tyler Cowen | Factual | 25 Dec 2024 | The podcast Cowen was describing, which he said had about seven episodes and in which neither host interviews the other, is all economics, unlike Conversations with Tyler. Tyler Cowen · Factual · 25 Dec 2024 | Their own work or organisation |
| Mostly true | Tyler Cowen | Factual | 25 Dec 2024 | Tyler Cowen said he stated The Great Stagnation in 2011 and that he thinks it was seen as radical at the time. Tyler Cowen · Factual · 25 Dec 2024 | Economics and markets |
| Mostly true | Sam Altman | Prediction | 21 Dec 2024 | On many coding tasks, OpenAI's o3-mini will outperform o1 at a massive cost reduction. Sam Altman · Prediction · 21 Dec 2024 | AI capabilities |
| Mostly true | Sam Altman | Promise | 21 Dec 2024 | OpenAI is giving all Plus users unlimited Sora access via the relaxed queue over the 2024 holidays. Sam Altman · Promise · 21 Dec 2024 | Their own work or organisation |
| Mostly true | Scott Alexander | Factual | 10 Dec 2024 | Most of the benefits of prison come from incapacitation rather than deterrence. Scott Alexander · Factual · 10 Dec 2024 | Philosophy, ethics and society |
| Mostly true | Sam Altman | Factual | 10 Dec 2024 | OpenAI significantly underestimated demand for Sora at its December 2024 launch. Sam Altman · Factual · 10 Dec 2024 | Their own work or organisation |
| Mostly true | Sam Altman | Factual | 9 Dec 2024 | OpenAI launched Sora on 2024-12-09 along with a new product, letting Plus and Pro users generate videos. Sam Altman · Factual · 9 Dec 2024 | AI capabilities |
| Mostly true | Sam Altman | Factual | 6 Dec 2024 | OpenAI announced reinforcement finetuning on 2024-12-06, which makes it easy to create expert models in specific domains with little training data. Sam Altman · Factual · 6 Dec 2024 | AI capabilities |
| Mostly true | Demis Hassabis | Factual | Dec 2024 | Hassabis's first career was writing AI for commercial computer games. Demis Hassabis · Factual · Dec 2024 | Their own work or organisation |
“I do think in the short run it will augment and increase the productivity of coders rather than replacing them.”
Dario Amodei, Anthropic CEO, interviewed 28 February 2025 Hard Fork - Anthropic's C.E.O. Dario Amodei on Surviving the A.I. Endgame Transcript (Podscripts (Hard Fork))
In the short run (about 6 to 12 months), AI will augment and increase coders' productivity rather than replace them.
Mostly true True in substance, wrong in a detail.
The second judge said mixed; the verdict shown is the first judge's.
What would count as true or false
Judge the period from February 2025 to February 2026. TRUE: evidence from that period shows that AI mainly raised software developers' productivity (field studies, firm reports or developer surveys showing productivity gains) and did not cause large-scale replacement. That means no substantial drop in employment of software developers or programmers clearly attributed to AI (BLS or equivalent employment data, credible labour-market studies). MOSTLY TRUE: augmentation dominates, but there is some modest, AI-attributed reduction in hiring of entry-level or junior coders, or the evidence on productivity gains is mixed in size. MIXED: credible evidence shows significant AI-attributed displacement, such as clear declines in coder employment or hiring tied to AI, alongside augmentation, with neither clearly dominant. Rigorous studies finding no productivity gain or a slowdown also count towards mixed. MOSTLY FALSE: replacement effects (AI-attributed layoffs or employment declines) clearly outweigh augmentation, though some productivity gains exist. FALSE: AI substantially replaced coders in this period, with large AI-attributed employment declines, and there is little evidence of productivity augmentation.
Evidence
- The Effects of Generative AI on High-Skilled Work: Evidence from Three Field Experiments with Software Developers Kevin Zheyuan Cui, Mert Demirer, Sonia Jaffe, Leon Musolff, Sida Peng, and Tobias Salz (academic working paper; authors at Princeton, MIT, Microsoft, Wharton) · June 2025
“when data is combined across three experiments and 4,867 developers, our analysis reveals a 26.08% increase (SE: 10.3%) in completed tasks among developers using the AI tool.”
- The Effects of Generative AI on High-Skilled Work: Evidence from Three Field Experiments with Software Developers Kevin Zheyuan Cui, Mert Demirer, Sonia Jaffe, Leon Musolff, Sida Peng, and Tobias Salz (academic working paper; authors at Princeton, MIT, Microsoft, Wharton) · June 2025
“Notably, less experienced developers had higher adoption rates and greater productivity gains.”
- We are Changing our Developer Productivity Experiment Design METR · 24 February 2026
“Our early 2025 study found the use of AI causes tasks to take 19% longer, with a confidence interval between +2% and +39%.”
- We are Changing our Developer Productivity Experiment Design METR · 24 February 2026
“Based on conversations with study participants, we believe it is likely that developers are more sped up from AI tools now — in early 2026 — compared to our estimates from early 2025.”
- The Effects of Generative AI on High-Skilled Work: Evidence from Three Field Experiments with Software Developers Cui, Demirer, Jaffe, Musolff, Peng and Salz (academic working paper; authors at Princeton, MIT, Microsoft, Wharton) · June 2025
“Though each experiment is noisy, when data is combined across three experiments and 4,867 developers, our analysis reveals a 26.08% increase (SE: 10.3%) in completed tasks among developers using the AI tool.”
- The Effects of Generative AI on High-Skilled Work: Evidence from Three Field Experiments with Software Developers Cui, Demirer, Jaffe, Musolff, Peng and Salz (academic working paper; authors at Princeton, MIT, Microsoft, Wharton) · June 2025
“Notably, less experienced developers had higher adoption rates and greater productivity gains.”
- Canaries in the Coal Mine? Six Facts about the Recent Employment Effects of Artificial Intelligence Brynjolfsson, Chandar, Chen (Stanford University / NBER; ADP administrative payroll data) · 26 August 2025
“We find that since the widespread adoption of generative AI, early-career workers (ages 22-25) in the most AI-exposed occupations have experienced a 13 percent relative decline in employment even after controlling for firm-level shocks.”
- AI and Job Postings: From Destruction to Creation? - Indeed Hiring Lab Indeed Hiring Lab · 8 July 2026
“US software development job postings have grown by almost 15% since the launch of Claude Code in late February, 2025, while overall job postings fell by 7% over the same period.”
- Announcing the 2025 DORA Report | Google Cloud Blog Google Cloud (DORA research program) · 23 September 2025
“AI adoption is near-universal: 90% of survey respondents report using AI at work. More than 80% believe it has increased their productivity.”
- Fact-Check: Did AI Replace Software Engineers? What the Data Shows (2026) - IoT Digital Twin PLM IoT Digital Twin PLM · 24 October 2026
“No. US government data show roughly 1.7 million software developers in 2025 and a projected 10 percent growth through 2035.”
Reasoning
A combined field experiment with 4,867 developers found a 26% increase in completed tasks with an AI tool (E1). The 2025 DORA survey reports that more than 80% of respondents believe AI raised their productivity (E9). Against this, METR's early-2025 study found AI made tasks take 19% longer (E3), although its February 2026 update says developers were likely more sped up by early 2026 (E4). On replacement, Indeed reports that US software development postings grew almost 15% since late February 2025 while overall postings fell (E8), and payroll data show a 13% relative employment decline among workers aged 22–25 in the most AI-exposed occupations (E7). Taken together, augmentation dominates, with mixed evidence on the size of productivity gains and a modest early-career decline, which fits the mostly-true criterion.
Cite this claim
Dario Amodei, “In the short run (about 6 to 12 months), AI will augment and increase coders' productivity rather than replace them.” (said 28 February 2025). Verdict: mostly true. Reliability API, claim c_1ec8863c1aca, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_1ec8863c1aca
Verdicts are made automatically; how verdicts and scores are made. The same data is on Hugging Face under CC BY 4.0.