| Mostly true |
Factual |
28 Jun 2023 |
The US is a clear outlier among developed countries in healthcare cost and outcomes.
Factual · 28 Jun 2023 |
Other |
| Mostly true |
Factual |
28 Jun 2023 |
The audience YES/NO split at the Munk Debate was 67/33 before the debate and 63/37 after.
Factual · 28 Jun 2023 |
AI safety and alignment |
| Mostly true |
Factual |
28 Jun 2023 |
In the official result of the Munk Debate on AI existential threat, the NO side (Mitchell and LeCun) won by 4% over the YES side (Tegmark and Bengio).
Factual · 28 Jun 2023 |
AI safety and alignment |
| Resolved true |
Factual |
27 Jun 2023 |
Clément Delangue defended AI open science and open source in his congressional testimony.
Factual · 27 Jun 2023 |
AI policy and governance |
| Resolved true |
Factual |
23 Jun 2023 |
Max Tegmark is a professor at MIT.
Factual · 23 Jun 2023 |
Their own work or organisation |
| Not researched |
Factual |
22 Jun 2023 |
A large number of Americans believe in conspiracy theories, though the proportion has not increased over time.
Factual · 22 Jun 2023 |
Philosophy, ethics and society |
| Not researched |
Factual |
22 Jun 2023 |
Yann LeCun gave an opening statement at the Munk Debate on the existential risk of AI on 2023-06-22.
Factual · 22 Jun 2023 |
AI safety and alignment |
| Unresolvable |
Factual |
19 Jun 2023 |
A joint interview of Yoshua Bengio and Yann LeCun was published in Les Échos Weekend a few days before 2023-06-19.
Factual · 19 Jun 2023 |
Their own work or organisation |
| Not researched |
Factual |
18 Jun 2023 |
Meta AI / FAIR has a large presence at CVPR 2023.
Factual · 18 Jun 2023 |
Their own work or organisation |
| Not researched |
Factual |
18 Jun 2023 |
Yann LeCun is an advisor to Enhance Lab.
Factual · 18 Jun 2023 |
Their own work or organisation |
| Not researched |
Factual |
15 Jun 2023 |
Yann LeCun expressed opinions on the future of AI at the Innovation Press Day held at Meta-Paris on Tuesday 2023-06-13.
Factual · 15 Jun 2023 |
Their own work or organisation |
| Not researched |
Factual |
14 Jun 2023 |
Ania Dawid transcribed Yann LeCun's lectures on Energy-Based Models, which he gave at the Les Houches summer school in 2022.
Factual · 14 Jun 2023 |
Science and research methods |
| Not researched |
Factual |
Jun 2023 |
The denoising autoencoder (ref. 51) is a type of contrastive energy-based model.
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
Supervised and reinforcement learning require an enormous number of labeled samples or trials.
Factual · Jun 2023 |
AI capabilities |
| Unresolvable |
Factual |
Jun 2023 |
Contrastive methods for training energy-based models work for any architecture but scale badly with data dimension.
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
Energy-based models can represent multimodal dependencies in which multiple values of y are compatible with a given x.
Factual · Jun 2023 |
AI capabilities |
| Mostly true |
Factual |
Jun 2023 |
Masked autoencoders are less successful with images and other continuous domains than with discrete domains such as language.
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
Contrastive methods for training energy-based models tend to become very inefficient in high dimensions.
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
Babies learn almost entirely by observation.
Factual · Jun 2023 |
Science and research methods |
| Not researched |
Factual |
Jun 2023 |
Hopfield networks, fully-connected recurrent networks, were popularized by John Hopfield in 1982.
Factual · Jun 2023 |
AI capabilities |
| Unresolvable |
Factual |
Jun 2023 |
Ideas related to VICReg-style regularization were explored already in 1992, per reference [62].
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
Joint embedding predictive architectures (JEPAs) are a new architecture proposed by LeCun in Ref. [6].
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
Supervised and reinforcement learning dominate modern real-world applications and are highly inefficient compared to human learning.
Factual · Jun 2023 |
AI capabilities |
| Mostly true |
Factual |
Jun 2023 |
Probabilistic models require normalization and may become intractable for high-dimensional data.
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
SSL for images produces blurry predictions.
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
Most large-scale machine learning applications today rely on supervised learning or deep reinforcement learning, which require extreme computational expense.
Factual · Jun 2023 |
AI compute, hardware and data |
| Not researched |
Factual |
Jun 2023 |
Boltzmann machines were fashionable for some time, but the large cost of sampling makes them less useful for real-world applications.
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
As of mid-2023, there are no Level 5 self-driving cars, domestic robots, or virtual assistants that learn reliable world models, reason and plan complex action sequences.
Factual · Jun 2023 |
AI capabilities |
| Resolved true |
Factual |
Jun 2023 |
LeCun's proposed AI architecture consists of multiple interconnected modules.
Factual · Jun 2023 |
AI capabilities |
| Mostly true |
Factual |
Jun 2023 |
With probabilistic models, training is confined to loss functions derived from the negative log-likelihood, such as cross entropy.
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
For energy-based models with a continuous y domain, the energy function is smooth and differentiable, allowing gradient-based inference.
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
The lecture notes summarize the main ideas of the autonomous intelligence architecture proposed by Yann LeCun.
Factual · Jun 2023 |
Their own work or organisation |
| Not researched |
Factual |
Jun 2023 |
SSL works very well for text, but for images, models trained to make a single prediction predict the average of all possible predictions.
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
Computing a partition function is very challenging, so probabilistic models in continuous high-dimensional domains are intractable.
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
Some regularized autoencoders learn interpretable features that mirror existing hand-crafted data compression approaches.
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
A major technique for detecting blacklisted content is nearest-neighbor search against that content.
Factual · Jun 2023 |
AI capabilities |
| Mostly true |
Factual |
Jun 2023 |
All modules of the proposed architecture are fully differentiable.
Factual · Jun 2023 |
AI capabilities |
| Not researched |
Factual |
Jun 2023 |
Current self-driving models need thousands of footage to learn, while humans can learn to drive in about twenty hours.
Factual · Jun 2023 |
AI capabilities |
| Unresolvable |
Factual |
4 Mar 2021 |
The Siamese network / joint embedding idea goes back to papers from Geoff Hinton's lab and Yann LeCun's group in the early 1990s.
Factual · 4 Mar 2021 |
AI capabilities |
| Resolved true |
Factual |
4 Mar 2021 |
Language models pretrained with self-supervised learning achieve considerably higher performance than models trained solely in a supervised manner.
Factual · 4 Mar 2021 |
AI capabilities |
| Mostly true |
Factual |
4 Mar 2021 |
Facebook has deployed XLM-R, a model based on its RoBERTa architecture, to improve hate speech classifiers in multiple languages across Facebook and Instagram.
Factual · 4 Mar 2021 |
AI capabilities |
| Mostly true |
Factual |
4 Mar 2021 |
LeCun said Facebook AI had created and open sourced SEER, a billion-parameter self-supervised computer vision model that he described as proven to work efficiently with complex, high-dimensional image data.
Factual · 4 Mar 2021 |
AI capabilities |
| Mostly true |
Factual |
4 Mar 2021 |
As of March 2021, self-supervised learning had not yet brought computer vision the same improvements it has brought to natural language processing.
Factual · 4 Mar 2021 |
AI capabilities |
| Mostly true |
Factual |
4 Mar 2021 |
The Barlow Twins method tries to minimize redundancy between the individual components of the embedding vectors.
Factual · 4 Mar 2021 |
AI capabilities |
| Resolved true |
Factual |
4 Mar 2021 |
After pretraining on a billion unlabeled Instagram images and fine-tuning on ImageNet, SEER outperformed state-of-the-art self-supervised systems, reaching 84.2 percent top-1 accuracy on ImageNet.
Factual · 4 Mar 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
Contrastive learning with positive and negative pairs does not work when the representation is high-dimensional, because there are too many ways for two things to be different.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
In MIT experiments where a baby ferret's optic nerve is connected to the auditory cortex, the auditory cortex becomes essentially a visual cortex.
Factual · 2021 |
Science and research methods |
| Not researched |
Factual |
2021 |
In the first months of life, babies learn how the world works mostly by observation because they can hardly act in the world.
Factual · 2021 |
Philosophy, ethics and society |
| Not researched |
Factual |
2021 |
Across AI sub-fields there has been a continuous evolution from less hand-crafting to more learning.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
People have used data augmentation on MNIST digits since the 1990s.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
Geoffrey Hinton proposed, in the early 1990s with his student Sue Becker, the idea of maximizing mutual information between the outputs of two systems.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
After self-supervised representation learning, recognizing handwritten digits on top of it requires only a few labeled samples.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
The difference between human and chimp genomes involved in human intelligence is less than 1% of the genome.
Factual · 2021 |
Science and research methods |
| Not researched |
Factual |
2021 |
The system under discussion worked, but they ended up not using it.
Factual · 2021 |
Technology |
| Not researched |
Factual |
2021 |
LeCun used to call the two-identical-copies network architecture a Siamese network.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
With a differentiable world model such as a neural net, one can do gradient-based model predictive control by backpropagating through it.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
Orangutans are solitary animals that do not seek the company of others.
Factual · 2021 |
Other |
| Mostly true |
Factual |
2021 |
A cat has fewer than 1 billion neurons, while a dog has 2 billion.
Factual · 2021 |
Other |
| Not researched |
Factual |
2021 |
Babies learn an enormous amount of background knowledge about the world that may be the basis of common sense.
Factual · 2021 |
Philosophy, ethics and society |
| Not researched |
Factual |
2021 |
Self-supervised learning offers far more training signal than supervised or reinforcement learning.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
Generally, the model is mostly deterministic and mostly built by hand, though sometimes a few parameters have to be identified through what is called systems identification.
Factual · 2021 |
Technology |
| Not researched |
Factual |
2021 |
Barlow Twins is a method for maximizing the information content of a vector.
Factual · 2021 |
AI capabilities |
| Mostly true |
Factual |
2021 |
Since the 1990s, algorithms exist that learn oriented edge detectors fully unsupervised with the equivalent of a few minutes of real time.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
The first vision systems in animals evolved mainly for localization, with very little recognition.
Factual · 2021 |
Science and research methods |
| Unresolvable |
Factual |
2021 |
The knowledge needed for house-cat intelligence fits in about 800 million neurons.
Factual · 2021 |
Other |
| Mostly true |
Factual |
2021 |
Self-supervised training of visual representations from video has not yet been successful.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
Representations from self-supervised methods that eliminate augmentation distortions cannot be used for object detection and localization because that information is lost.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
Yann LeCun proposes self-supervised learning as the way to get machines to learn to represent the world.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
A sea change in favor of convolutional nets occurred when datasets became bigger and GPUs became available.
Factual · 2021 |
AI compute, hardware and data |
| Resolved true |
Factual |
2021 |
The American financial payment system is much more lax about signature verification than Europe's.
Factual · 2021 |
Economics and markets |
| Not researched |
Factual |
2021 |
Until very recently there were no working methods for training image representations by masking parts of images and reconstructing them.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
Oriented edge detectors can be learned within minutes of opening one's eyes.
Factual · 2021 |
Science and research methods |
| Not researched |
Factual |
2021 |
LeCun said he believes no text in the world explains the physical situation he was describing (an object that is "sitting on" something else).
Factual · 2021 |
AI capabilities |
| Unresolvable |
Factual |
2021 |
The most intelligent AI systems have less common sense than a house cat.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
In the early 1990s LeCun and Bell Labs colleagues including Jane Bromley proposed using negative example pairs, now called contrastive learning.
Factual · 2021 |
AI capabilities |
| Unresolvable |
Factual |
2021 |
At that earlier time, datasets were so small that hand-engineered methods worked better than convolutional nets.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
LeCun revived Hinton's idea together with his postdocs at FAIR, producing a method called Barlow Twins.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
Model predictive control in classical optimal control has existed since the early 1960s.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
The distinguishing aspects of human intelligence appeared only in the last million years.
Factual · 2021 |
Science and research methods |
| Not researched |
Factual |
2021 |
Without specific provisions, a Siamese network trained on similar pairs ends up ignoring its input and producing a constant output vector.
Factual · 2021 |
AI capabilities |
| Mostly true |
Factual |
2021 |
In reinforcement learning the machine receives only a single scalar feedback, and only occasionally.
Factual · 2021 |
AI capabilities |
| Unresolvable |
Factual |
2021 |
AI is not anywhere close to reproducing the learning done by a cat brain of about 800 million neurons.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
Zeroth-order, gradient-free black-box optimization is much less efficient than gradient-based optimization.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
Self-supervised pre-training has been less successful in images than in language, is making progress, and relies on manual data augmentation.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
LeCun said he thinks the entire human prefrontal cortex is basically the engine for a world model.
Factual · 2021 |
Science and research methods |
| Not researched |
Factual |
2021 |
In supervised learning the machine is given a few bits of feedback per sample.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
A paper coming out of the FAIR group at Menlo Park shows a masking-based method that works very well, without data augmentation.
Factual · 2021 |
Their own work or organisation |
| Not researched |
Factual |
2021 |
Lions attack bigger animals than cheetahs do.
Factual · 2021 |
Other |
| Unresolvable |
Factual |
2021 |
Most of the complicated components of intelligence already exist in cats, dogs and non-human primates.
Factual · 2021 |
Science and research methods |
| Not researched |
Factual |
2021 |
LeCun said he thinks oriented edge detectors in the visual cortex area V1 are learned rather than hardwired.
Factual · 2021 |
Science and research methods |
| Not researched |
Factual |
2021 |
Every modern natural language processing system is pre-trained in a self-supervised manner by filling in blanks.
Factual · 2021 |
AI capabilities |
| Not researched |
Factual |
2021 |
Signals from the retina can easily train edge detectors, so V1 edge detectors may be learned before birth.
Factual · 2021 |
Science and research methods |
| Not researched |
Factual |
2021 |
Octopuses never know their parents.
Factual · 2021 |
Other |
| Mostly true |
Factual |
2021 |
The amount of image training data available for self-supervised learning is essentially unlimited, with billions of new images per day.
Factual · 2021 |
AI compute, hardware and data |
| Unresolvable |
Factual |
30 Sep 2020 |
An implementation of Perlin noise in PyTorch has been made by the X user honualx.
Factual · 30 Sep 2020 |
Technology |
| Unresolvable |
Factual |
30 Sep 2020 |
Ken Perlin is a colleague of Yann LeCun at NYU.
Factual · 30 Sep 2020 |
Their own work or organisation |
| Unresolvable |
Factual |
29 Sep 2020 |
The final lecture of the previous semester's Deep Learning course has been posted online.
Factual · 29 Sep 2020 |
Field building and careers |
| Unresolvable |
Factual |
28 Sep 2020 |
Konbini published a short interview with Yann LeCun on the history of deep learning and his career.
Factual · 28 Sep 2020 |
Their own work or organisation |
| Not researched |
Factual |
26 Sep 2020 |
Siamese networks trained to tell whether two states of a physical system lie on the same trajectory appear to discover symmetries and conservation laws.
Factual · 26 Sep 2020 |
Science and research methods |
| Not researched |
Factual |
18 Sep 2020 |
Yann LeCun is one of 24 American Turing Award laureates who endorsed the Biden/Harris ticket.
Factual · 18 Sep 2020 |
AI policy and governance |