ClaimsYann LeCun

“many other domains such as drug discovery and genomics”

LeCun, Bengio and Hinton, article abstract 27 May 2015 Deep learning (Nature) (Nature)

Factual AI capabilities

Deep learning methods have dramatically improved the state of the art in many other domains such as drug discovery and genomics.

Mixed Partly true and partly false in roughly equal measure.

Factual: Statements about the present or the past, checked against the record: did they hold up?

What would count as true or false

True if published results as of May 2015 show deep learning methods markedly improving the state of the art in drug discovery (for example the Merck Kaggle challenge, Tox21) and in genomics (for example predicting splicing or the effects of mutations), as well as in other domains. Mostly true if clear improvements are shown in both but 'dramatically' overstates the gains in one of them. Mixed if clear state-of-the-art gains are documented for only one of drug discovery and genomics. Mostly false if the evidence by then amounts to only early or modest results in both, stated as dramatic. False if deep learning had not improved the state of the art in either field by then.

Set before the research began.

Evidence (4)

  1. E1 Toxicity Prediction using Deep Learning arXiv (ar5iv rendering); authors at Institute of Bioinformatics, Johannes Kepler University Linz

    “Though Deep Learning is new to the field and was never applied to toxicity prediction before, it clearly outperformed all other participating methods.”
  2. E2 Deep Neural Nets as a Method for Quantitative Structure−Activity Relationships Journal of Chemical Information and Modeling (Ma, Svetnik, Sheridan, Dahl, Liaw; Merck Research Laboratories and University of Toronto)

    “Here we show that DNNs can routinely make better prospective predictions than RF on a set of large diverse QSAR data sets that are taken from Merck’s drug discovery effort.”
  3. E3 Deep Neural Nets as a Method for Quantitative Structure−Activity Relationships Journal of Chemical Information and Modeling (Ma, Svetnik, Sheridan, Dahl, Liaw; Merck Research Laboratories and University of Toronto)

    “The winning entry (submitted by one of the authors, George Dahl) improved the mean R2 averaged over the 15 data sets from 0.42 (for RF) to 0.49.”
  4. E4 Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning - Nature Biotechnology Nature Biotechnology · 27 July 2015

    “Using a diverse array of experimental data and evaluation metrics, we find that deep learning outperforms other state-of-the-art methods, even when training on in vitro data and testing on in vivo data.”

Reasoning

For drug discovery, the evidence shows clear gains. The toxicity prediction paper (E1, arXiv 1503, which is the March 2015 numbering) says deep learning "clearly outperformed all other participating methods" in toxicity prediction. The Merck QSAR paper (E2, E3) reports that deep neural nets routinely beat random forests, and that the winning Kaggle entry raised mean R² from 0.42 to 0.49, a clear but moderate gain. The only genomics evidence (E4) was published on 2015-07-27, after the 2015-05-27 judge date, so the evidence does not document genomics gains as of the claim date. Since state-of-the-art gains are documented for only one of the two named fields, this falls under the criteria's 'mixed' tier.

Cite this claim

Yann LeCun, “Deep learning methods have dramatically improved the state of the art in many other domains such as drug discovery and genomics.” (said 27 May 2015). Verdict: mixed. Reliability API, claim c_92a884f7acba, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_92a884f7acba

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Yann LeCun, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Yann LeCun

  1. Mostly true Factual 18 March 2024
    “For starters, transformers are equivariant to permutations.”

    Transformers are equivariant to permutations, as ConvNets are equivariant to translations.

  2. Mostly true Factual 14 March 2024
    “If it were the case, we would have AI systems that could teach themselves to drive a car in 20 hours of practice, like any 17 year-old.”

    There are currently no AI systems that can teach themselves to drive a car in about 20 hours of practice, as a 17-year-old can.

  3. Mostly true Factual 8 March 2024
    “The architecture is good, the architecture of the encoder is good, but the fact that you train the system to reconstruct images does not lead it to produce to long, good generic features of images.”

    Training an encoder to reconstruct images does not lead it to produce good generic image features, though the encoder architecture is good.

  4. Mostly true Factual 8 March 2024
    “LLMs can do none of those or they can only do them in a very primitive way and they don’t really understand the physical world.”

    Current LLMs can do none of understanding the physical world, persistent memory, reasoning and planning, or only in a very primitive way.

  5. Mostly true Factual 8 March 2024
    “No, there’s one thing that autoregressive LLMs or that LLMs in general, not just the autoregressive one, but including the bird style bidirectional ones, are exploiting and its self supervised…”

    LLMs, including BERT-style bidirectional ones, exploit self-supervised learning, and LeCun has been a very strong advocate of self-supervised learning for many years.

All of them

Verdicts are made automatically; how verdicts are made.