| Unresolvable |
Factual |
28 Mar 2024 |
The linked document is Meta's official response to the NTIA request for comments about AI, whose recommendation number 1 stresses the importance of open foundation models.
Factual · 28 Mar 2024 |
AI policy and governance |
| Unresolvable |
Factual |
18 Mar 2024 |
Thoughts, memories and reasoning exist without language.
Factual · 18 Mar 2024 |
Philosophy, ethics and society |
| Unresolvable |
Factual |
12 Mar 2024 |
The attached image shows the computing infrastructure used for Llama-3 training.
Factual · 12 Mar 2024 |
AI compute, hardware and data |
| Unresolvable |
Prediction |
8 Mar 2024 |
The next major AI breakthrough will come from industry, and such information will disseminate extremely quickly.
Prediction · 8 Mar 2024 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
8 Mar 2024 |
The type of LLMs used today will not be able to make the leap the interviewer asked about, with the main reason given being the way LLMs are trained, by predicting masked words in text.
Prediction · 8 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
8 Mar 2024 |
In LeCun's opinion, the blueprint of future AI systems (transcribed as "data systems") is that they will plan their answers by optimization before turning them into text, a process he described as Turing complete (transcribed as "turning complete").
Prediction · 8 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
8 Mar 2024 |
World models most probably cannot be built by predicting words, because language is low-bandwidth and does not carry enough information.
Prediction · 8 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
8 Mar 2024 |
LeCun bets that future AI world-model systems will be JEPA-like architectures rather than generative models, adding that the future will tell.
Prediction · 8 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
8 Mar 2024 |
Keeping AI systems locked up as proprietary would potentially lead to a future where a few companies control all of our information diet.
Prediction · 8 Mar 2024 |
AI policy and governance |
| Unresolvable |
Prediction |
8 Mar 2024 |
AI will not cause mass unemployment, according to economists LeCun cites.
Prediction · 8 Mar 2024 |
AI, the economy and work |
| Unresolvable |
Prediction |
8 Mar 2024 |
As AI systems are made more intelligent, developers will also learn to add guardrails so they behave properly.
Prediction · 8 Mar 2024 |
AI safety and alignment |
| Unresolvable |
Prediction |
8 Mar 2024 |
AI assistants will amplify human intelligence.
Prediction · 8 Mar 2024 |
Philosophy, ethics and society |
| Unresolvable |
Prediction |
8 Mar 2024 |
Joint-embedding world models could possibly enable car driving, but it will take a while to get to that point.
Prediction · 8 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
8 Mar 2024 |
Bad actors will not have AI technology superior to that of good actors.
Prediction · 8 Mar 2024 |
AI policy and governance |
| Unresolvable |
Factual |
8 Mar 2024 |
The European Enlightenment would not have happened without the printing press.
Factual · 8 Mar 2024 |
Philosophy, ethics and society |
| Unresolvable |
Prediction |
8 Mar 2024 |
Many different groups will build advanced AI, and some will succeed at making controllable, safe systems with proper guardrails.
Prediction · 8 Mar 2024 |
AI safety and alignment |
| Unresolvable |
Prediction |
8 Mar 2024 |
Keeping AI systems locked up for security reasons would lead to a future in which people's information diet is controlled by a small number of companies with proprietary systems.
Prediction · 8 Mar 2024 |
AI policy and governance |
| Unresolvable |
Factual |
8 Mar 2024 |
Yann LeCun has had much experience working with people who are smarter than him.
Factual · 8 Mar 2024 |
Their own work or organisation |
| Unresolvable |
Factual |
8 Mar 2024 |
Meta's ability to derive revenue from AI technology is not impaired by releasing base models as open source.
Factual · 8 Mar 2024 |
Economics and markets |
| Unresolvable |
Prediction |
8 Mar 2024 |
AI will bring a gradual shift between professions rather than mass unemployment.
Prediction · 8 Mar 2024 |
AI, the economy and work |
| Unresolvable |
Prediction |
8 Mar 2024 |
Designing AI guardrails will not be solved by a single silver bullet or a mathematical proof of safety.
Prediction · 8 Mar 2024 |
AI safety and alignment |
| Unresolvable |
Prediction |
8 Mar 2024 |
Progress toward advanced AI will be continuous rather than a single event.
Prediction · 8 Mar 2024 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
8 Mar 2024 |
Future AI systems will not have a desire to dominate, because that desire would have to be hardwired into them.
Prediction · 8 Mar 2024 |
AI safety and alignment |
| Unresolvable |
Prediction |
8 Mar 2024 |
Advanced AI systems will not become a species that competes with humans.
Prediction · 8 Mar 2024 |
AI safety and alignment |
| Unresolvable |
Prediction |
8 Mar 2024 |
Millions of humanoid robots will eventually be walking around, though not soon.
Prediction · 8 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
8 Mar 2024 |
In future, people will interact with persuasive bad actors through their own AI assistants, which will be as smart as the actors' systems.
Prediction · 8 Mar 2024 |
AI safety and alignment |
| Unresolvable |
Prediction |
8 Mar 2024 |
LeCun said there is ample evidence that generative models will not be able to learn good representations of the real world.
Prediction · 8 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
8 Mar 2024 |
Without world models that let systems learn how the world works, there will be no significant progress in robotics.
Prediction · 8 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
8 Mar 2024 |
AI safety guardrails will be developed through a progressive, iterative design process.
Prediction · 8 Mar 2024 |
AI safety and alignment |
| Unresolvable |
Prediction |
8 Mar 2024 |
Training on large data sets may turn out to be necessary for world-model systems to have emergent properties like LLMs.
Prediction · 8 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
8 Mar 2024 |
World models for predicting how the world evolves cannot be built with generative models.
Prediction · 8 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
8 Mar 2024 |
Future AI systems that can plan and reason will not rely on "regressive prediction of tokens" but on something "more akin to inference of little variables" in what used to be called probabilistic or graphical models.
Prediction · 8 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
8 Mar 2024 |
Human-level AI (AGI) will not arrive as a single discrete event.
Prediction · 8 Mar 2024 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
8 Mar 2024 |
Before reaching human-level AI, we will first have systems with the characteristics of human-level intelligence but at the intelligence level of a cat or parrot.
Prediction · 8 Mar 2024 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
8 Mar 2024 |
The French government will not accept its citizens' digital information diet being controlled by three US west coast companies.
Prediction · 8 Mar 2024 |
AI policy and governance |
| Unresolvable |
Prediction |
8 Mar 2024 |
Every interaction people have with the digital world will be mediated by AI systems and AI assistants.
Prediction · 8 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
8 Mar 2024 |
Whenever an AI breakthrough occurs, it will be widely disseminated very quickly.
Prediction · 8 Mar 2024 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
8 Mar 2024 |
The vast majority of AI systems will be built on top of open source platforms.
Prediction · 8 Mar 2024 |
AI policy and governance |
| Unresolvable |
Prediction |
8 Mar 2024 |
If some AI goes rogue, well-controlled AI systems will be used against it.
Prediction · 8 Mar 2024 |
AI safety and alignment |
| Unresolvable |
Factual |
8 Mar 2024 |
Preliminary results suggest V-JEPA representations let the system tell whether a video is physically possible or impossible.
Factual · 8 Mar 2024 |
AI capabilities |
| Unresolvable |
Prediction |
8 Mar 2024 |
In the future, every interaction people have with the digital world will be mediated by their AI assistant.
Prediction · 8 Mar 2024 |
AI safety and alignment |
| Unresolvable |
Prediction |
8 Mar 2024 |
Humanity will not be exposed to a single rogue AI that kills everyone.
Prediction · 8 Mar 2024 |
AI safety and alignment |
| Unresolvable |
Prediction |
8 Mar 2024 |
Progress toward human-level AI will be gradual.
Prediction · 8 Mar 2024 |
AI timelines and forecasting |
| Unresolvable |
Factual |
28 Jun 2023 |
MIT Technology Review published a piece by Melissa Heikkilä about Meta's stance on AI existential risks, with quotes from Joelle Pineau and Yann LeCun.
Factual · 28 Jun 2023 |
AI safety and alignment |
| Unresolvable |
Prediction |
20 Jun 2023 |
Objective-Driven AI architectures are the future of AI.
Prediction · 20 Jun 2023 |
AI capabilities |
| Unresolvable |
Factual |
19 Jun 2023 |
A joint interview of Yoshua Bengio and Yann LeCun was published in Les Échos Weekend a few days before 2023-06-19.
Factual · 19 Jun 2023 |
Their own work or organisation |
| Unresolvable |
Factual |
Jun 2023 |
Contrastive methods for training energy-based models work for any architecture but scale badly with data dimension.
Factual · Jun 2023 |
AI capabilities |
| Unresolvable |
Prediction |
Jun 2023 |
H-JEPA trained with regularized methods may be a starting point for predictive world models capable of hierarchical planning under uncertainty, a breakthrough for autonomous AI.
Prediction · Jun 2023 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
Jun 2023 |
Self-supervised learning is the most likely approach to learning world representations, since supervised and reinforcement learning require too many samples or trials.
Prediction · Jun 2023 |
AI capabilities |
| Unresolvable |
Prediction |
Jun 2023 |
Regularized methods seem more promising than contrastive methods for training future energy-based models, because they are less likely to fall victim to the curse of dimensionality.
Prediction · Jun 2023 |
AI timelines and forecasting |
| Unresolvable |
Factual |
Jun 2023 |
Ideas related to VICReg-style regularization were explored already in 1992, per reference [62].
Factual · Jun 2023 |
AI capabilities |
| Unresolvable |
Prediction |
Jun 2023 |
Contrastive methods are unlikely to lead to future autonomous intelligence because of their unfavorable scaling with data dimension.
Prediction · Jun 2023 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
Jun 2023 |
Probabilistic models may also fail on the path to autonomous intelligence.
Prediction · Jun 2023 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
4 Mar 2021 |
Researchers may never develop techniques to represent suitable probability distributions over high-dimensional continuous spaces such as all possible video frames.
Prediction · 4 Mar 2021 |
AI capabilities |
| Unresolvable |
Factual |
4 Mar 2021 |
The Siamese network / joint embedding idea goes back to papers from Geoff Hinton's lab and Yann LeCun's group in the early 1990s.
Factual · 4 Mar 2021 |
AI capabilities |
| Unresolvable |
Prediction |
4 Mar 2021 |
Perhaps, in the long run, non-contrastive methods with latent-variable predictive models will prove a better alternative.
Prediction · 4 Mar 2021 |
AI capabilities |
| Unresolvable |
Prediction |
2021 |
Training systems on video prediction with self-supervised techniques will provide a path towards some level of physical common sense in machines.
Prediction · 2021 |
AI capabilities |
| Unresolvable |
Prediction |
2021 |
A machine cannot be trained to be intelligent purely from text.
Prediction · 2021 |
AI capabilities |
| Unresolvable |
Factual |
2021 |
The knowledge needed for house-cat intelligence fits in about 800 million neurons.
Factual · 2021 |
Other |
| Unresolvable |
Factual |
2021 |
The most intelligent AI systems have less common sense than a house cat.
Factual · 2021 |
AI capabilities |
| Unresolvable |
Factual |
2021 |
At that earlier time, datasets were so small that hand-engineered methods worked better than convolutional nets.
Factual · 2021 |
AI capabilities |
| Unresolvable |
Prediction |
2021 |
All of intelligence could possibly be solved by filling in blanks in language and similar self-supervised prediction.
Prediction · 2021 |
AI timelines and forecasting |
| Unresolvable |
Factual |
2021 |
AI is not anywhere close to reproducing the learning done by a cat brain of about 800 million neurons.
Factual · 2021 |
AI capabilities |
| Unresolvable |
Factual |
2021 |
Most of the complicated components of intelligence already exist in cats, dogs and non-human primates.
Factual · 2021 |
Science and research methods |
| Unresolvable |
Prediction |
2021 |
Active learning and reinforcement learning will become obsolete, useless or easy once self-supervised representation learning or predictive world models are figured out.
Prediction · 2021 |
AI capabilities |
| Unresolvable |
Factual |
30 Sep 2020 |
An implementation of Perlin noise in PyTorch has been made by the X user honualx.
Factual · 30 Sep 2020 |
Technology |
| Unresolvable |
Factual |
30 Sep 2020 |
Ken Perlin is a colleague of Yann LeCun at NYU.
Factual · 30 Sep 2020 |
Their own work or organisation |
| Unresolvable |
Factual |
29 Sep 2020 |
The final lecture of the previous semester's Deep Learning course has been posted online.
Factual · 29 Sep 2020 |
Field building and careers |
| Unresolvable |
Factual |
28 Sep 2020 |
Konbini published a short interview with Yann LeCun on the history of deep learning and his career.
Factual · 28 Sep 2020 |
Their own work or organisation |
| Unresolvable |
Factual |
19 Aug 2020 |
Africa has been developing quickly over the last decades.
Factual · 19 Aug 2020 |
Economics and markets |
| Unresolvable |
Factual |
14 Aug 2020 |
The Wall Street Journal published a piece on self-supervised learning involving Kyunghyun Cho and Yann LeCun.
Factual · 14 Aug 2020 |
Their own work or organisation |
| Unresolvable |
Factual |
9 Aug 2020 |
The double descent test-error peak does not appear with multilayer neural networks because they are implicitly regularized.
Factual · 9 Aug 2020 |
Science and research methods |
| Unresolvable |
Factual |
18 Jun 2019 |
Calibra is a Facebook subsidiary and the first member of Libra.
Factual · 18 Jun 2019 |
Economics and markets |
| Unresolvable |
Factual |
18 Jun 2019 |
French fries originated in France.
Factual · 18 Jun 2019 |
Other |
| Unresolvable |
Factual |
11 Jun 2019 |
The figure given for PhD in Data Science is 47%.
Factual · 11 Jun 2019 |
Field building and careers |
| Unresolvable |
Factual |
9 Jun 2019 |
In US facilities holding immigrant children, in violation of the law, no services are provided beyond food, water and very basic shelter.
Factual · 9 Jun 2019 |
Philosophy, ethics and society |
| Unresolvable |
Factual |
9 Jun 2019 |
The US operates concentration camps for immigrant children.
Factual · 9 Jun 2019 |
Philosophy, ethics and society |
| Unresolvable |
Factual |
2019 |
Current model-free RL methods would likely need millions of hours of practice, with numerous accidents, for an autonomous car to learn to drive.
Factual · 2019 |
AI capabilities |
| Unresolvable |
Factual |
2019 |
Training a video predictor with a least-square criterion yields blurry frames that average all possible futures.
Factual · 2019 |
AI capabilities |
| Unresolvable |
Prediction |
2019 |
The demands on DL-specific hardware will undoubtedly increase.
Prediction · 2019 |
AI compute, hardware and data |
| Unresolvable |
Prediction |
2019 |
Chances are that the bulk of computation in future deep learning systems will still consist primarily of convolutions.
Prediction · 2019 |
AI compute, hardware and data |
| Unresolvable |
Prediction |
2019 |
Programmable resistor technology may become sufficiently compact, reliable, durable and configurable for deep learning applications.
Prediction · 2019 |
AI compute, hardware and data |
| Unresolvable |
Prediction |
2019 |
Augmented/virtual reality and telepresence applications will require extremely low-power ASICs for DL inference.
Prediction · 2019 |
AI compute, hardware and data |
| Unresolvable |
Factual |
2019 |
Dataflow stream processors have become a popular design for ConvNet accelerators, such as the Eyeriss project.
Factual · 2019 |
AI compute, hardware and data |
| Unresolvable |
Prediction |
2019 |
The ultimate solution to DL power constraints may be exploiting sparse activations, perhaps with event-based computation.
Prediction · 2019 |
AI compute, hardware and data |
| Unresolvable |
Prediction |
2019 |
What the AI hardware and software communities produce over the next few years will shape AI research for the coming decades.
Prediction · 2019 |
AI compute, hardware and data |
| Unresolvable |
Prediction |
2019 |
Self-supervised latent-variable predictive models will be the centerpiece of intelligent systems based on model-predictive control and model-based reinforcement learning, e.g. for robotic manipulation and autonomous driving.
Prediction · 2019 |
AI capabilities |
| Unresolvable |
Prediction |
2019 |
New high-performance hardware will be required to enable progress towards deep learning systems trained to acquire vast amounts of background knowledge and a form of common sense.
Prediction · 2019 |
AI compute, hardware and data |
| Unresolvable |
Promise |
28 Jul 2016 |
LeCun will teach his NYU deep learning course again in the Spring of 2017.
Promise · 28 Jul 2016 |
Their own work or organisation |
| Unresolvable |
Factual |
28 Jul 2016 |
There have been many proposals to combine neural nets and structured prediction, going back to the early 1990s.
Factual · 28 Jul 2016 |
AI capabilities |
| Unresolvable |
Factual |
28 Jul 2016 |
Videos of LeCun's 2015 NYU deep learning course lectures were taken down for legal reasons, while the slides remain available.
Factual · 28 Jul 2016 |
Their own work or organisation |
| Unresolvable |
Factual |
28 Jul 2016 |
LeCun's Collège de France lectures were taught in French and later dubbed in English.
Factual · 28 Jul 2016 |
Their own work or organisation |
| Unresolvable |
Factual |
27 May 2015 |
Deep convolutional nets have brought about breakthroughs in processing images, video, speech and audio.
Factual · 27 May 2015 |
AI capabilities |
| Unresolvable |
Factual |
27 May 2015 |
The authors of the paper declare no competing financial interests.
Factual · 27 May 2015 |
Science and research methods |
| Unresolvable |
Prediction |
18 Feb 2015 |
Self-driving cars will use convolutional neural networks.
Prediction · 18 Feb 2015 |
AI capabilities |
| Unresolvable |
Prediction |
18 Feb 2015 |
A form of common sense could be acquired by machines through predictive unsupervised learning.
Prediction · 18 Feb 2015 |
AI capabilities |
| Unresolvable |
Factual |
18 Feb 2015 |
Yann LeCun has been obsessed with integrating learning end to end so machines learn good representations for over 30 years.
Factual · 18 Feb 2015 |
Their own work or organisation |
| Unresolvable |
Prediction |
18 Feb 2015 |
Deep Learning will be part of the solution for generalized intelligence.
Prediction · 18 Feb 2015 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
18 Feb 2015 |
Deep Learning is part of the solution for machines representing relational and factual knowledge, but not the whole answer.
Prediction · 18 Feb 2015 |
AI capabilities |
| Unresolvable |
Prediction |
18 Feb 2015 |
AI hype could easily lead to another AI "winter cycle".
Prediction · 18 Feb 2015 |
AI timelines and forecasting |