| Not checkable |
Not checkable |
1 Aug 2016 |
Combining learning systems with factor graphs is known as “structured prediction” in machine learning.
Not checkable · 1 Aug 2016 |
|
| Not checkable |
Not checkable |
1 Aug 2016 |
It can then be used as a feature extractor for a classifier, for example.
Not checkable · 1 Aug 2016 |
|
| Not checkable |
Not checkable |
1 Aug 2016 |
This, and the variations that are now being proposed is the most interesting idea in the last 10 years in ML, in my opinion.
Not checkable · 1 Aug 2016 |
|
| Unresolvable |
Promise |
28 Jul 2016 |
LeCun will teach his NYU deep learning course again in the Spring of 2017.
Promise · 28 Jul 2016 |
Their own work or organisation |
| Resolved true |
Factual |
28 Jul 2016 |
There have been a number of recent works putting graphical models on top of ConvNets and training end to end.
Factual · 28 Jul 2016 |
AI capabilities |
| Unresolvable |
Factual |
28 Jul 2016 |
There have been many proposals to combine neural nets and structured prediction, going back to the early 1990s.
Factual · 28 Jul 2016 |
AI capabilities |
| Mostly true |
Factual |
28 Jul 2016 |
The check reading system LeCun and a colleague built at Bell Labs in the early 1990s used structured prediction on top of convolutional nets, called Graph Transformer Networks.
Factual · 28 Jul 2016 |
AI capabilities |
| Unresolvable |
Factual |
28 Jul 2016 |
Videos of LeCun's 2015 NYU deep learning course lectures were taken down for legal reasons, while the slides remain available.
Factual · 28 Jul 2016 |
Their own work or organisation |
| Resolved true |
Factual |
28 Jul 2016 |
Yann LeCun gave a recent series of 8 lectures on deep learning at Collège de France in Paris.
Factual · 28 Jul 2016 |
Their own work or organisation |
| Unresolvable |
Factual |
28 Jul 2016 |
LeCun's Collège de France lectures were taught in French and later dubbed in English.
Factual · 28 Jul 2016 |
Their own work or organisation |
| Not checkable |
Not checkable |
Jan 2016 |
How I learned to stop worrying and love unsupervised learning
Not checkable · Jan 2016 |
|
| Not checkable |
Not checkable |
Jan 2016 |
the cherry on the cake
Not checkable · Jan 2016 |
|
| Unresolvable |
Factual |
27 May 2015 |
Deep convolutional nets have brought about breakthroughs in processing images, video, speech and audio.
Factual · 27 May 2015 |
AI capabilities |
| Resolved true |
Factual |
27 May 2015 |
Deep learning methods have dramatically improved the state of the art in speech recognition, visual object recognition and object detection.
Factual · 27 May 2015 |
AI capabilities |
| Mixed |
Factual |
27 May 2015 |
Deep learning methods have dramatically improved the state of the art in many other domains such as drug discovery and genomics.
Factual · 27 May 2015 |
AI capabilities |
| Not checkable |
Not checkable |
27 May 2015 |
recurrent nets have shone light on sequential data such as text and speech.
Not checkable · 27 May 2015 |
|
| Mostly true |
Factual |
27 May 2015 |
Deep learning uses the backpropagation algorithm to indicate how a machine should change the internal parameters that compute each layer's representation from the previous layer's.
Factual · 27 May 2015 |
AI capabilities |
| Unresolvable |
Factual |
27 May 2015 |
The authors of the paper declare no competing financial interests.
Factual · 27 May 2015 |
Science and research methods |
| Not checkable |
Not checkable |
27 May 2015 |
The authors would like to thank the Natural Sciences and Engineering Research Council of Canada, the Canadian Institute For Advanced…
Not checkable · 27 May 2015 |
|
| Mostly true |
Factual |
27 May 2015 |
The acknowledgements, dated 2015, state that the authors Y.L. and Y.B. are fellows of the Canadian Institute For Advanced Research (CIFAR).
Factual · 27 May 2015 |
Field building and careers |
| Not checkable |
Not checkable |
27 May 2015 |
Deep learning allows computational models that are composed of multiple processing layers to learn representations of data with multiple…
Not checkable · 27 May 2015 |
|
| Not checkable |
Not checkable |
27 May 2015 |
Deep learning discovers intricate structure in large data sets
Not checkable · 27 May 2015 |
|
| Not researched |
Factual |
18 Feb 2015 |
Unsupervised learning techniques that actually work now exist.
Factual · 18 Feb 2015 |
AI capabilities |
| Not checkable |
Not checkable |
18 Feb 2015 |
IBM built the wrong thing.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
It’s a very bad way to approach an engineering problem.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
The problem with symbols is that a symbol is a meaningless string of bits.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
I’m not pompous, I think, and Facebook is a very non-pompous company.
Not checkable · 18 Feb 2015 |
|
| Unresolvable |
Prediction |
18 Feb 2015 |
Self-driving cars will use convolutional neural networks.
Prediction · 18 Feb 2015 |
AI capabilities |
| Not researched |
Factual |
18 Feb 2015 |
With hundreds of millions of faces in the gallery, face recognition accuracy is nowhere near 97.25 percent.
Factual · 18 Feb 2015 |
AI capabilities |
| Mostly true |
Factual |
18 Feb 2015 |
Deep Learning systems augmented with a memory module are starting to show impressive results in natural language processing.
Factual · 18 Feb 2015 |
AI capabilities |
| Not checkable |
Not checkable |
18 Feb 2015 |
It is not the learning that is shallow or deep, but the architecture that is being trained.
Not checkable · 18 Feb 2015 |
|
| Not researched |
Factual |
18 Feb 2015 |
Facebook's motto is to connect people.
Factual · 18 Feb 2015 |
Other |
| Not checkable |
Not checkable |
18 Feb 2015 |
Our models do not aspire to be models of the brain, and we don’t make claims of neural relevance.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
You could think of Deep Learning as the building of learning machines, say pattern recognition systems or whatever, by assembling lots of…
Not checkable · 18 Feb 2015 |
|
| Not researched |
Factual |
18 Feb 2015 |
Earlier shallow learning systems were limited in the complexity of the functions they could compute.
Factual · 18 Feb 2015 |
AI capabilities |
| Not checkable |
Not checkable |
18 Feb 2015 |
Interacting with PhD students and young researchers is a very good remedy against hubris.
Not checkable · 18 Feb 2015 |
|
| Unresolvable |
Prediction |
18 Feb 2015 |
A form of common sense could be acquired by machines through predictive unsupervised learning.
Prediction · 18 Feb 2015 |
AI capabilities |
| Not checkable |
Not checkable |
18 Feb 2015 |
But designing a feature extractor “by hand” is very difficult and time consuming.
Not checkable · 18 Feb 2015 |
|
| Unresolvable |
Factual |
18 Feb 2015 |
Yann LeCun has been obsessed with integrating learning end to end so machines learn good representations for over 30 years.
Factual · 18 Feb 2015 |
Their own work or organisation |
| Mostly true |
Factual |
18 Feb 2015 |
The brain is much better than current artificial models at unsupervised learning.
Factual · 18 Feb 2015 |
AI capabilities |
| Mostly true |
Factual |
18 Feb 2015 |
Shallow learning systems have one or two layers, while deep learning systems typically have five to 20 layers.
Factual · 18 Feb 2015 |
AI capabilities |
| Not researched |
Factual |
18 Feb 2015 |
The type of learning used in actual Deep Learning systems is very restricted, with supervised learning being what works in practice.
Factual · 18 Feb 2015 |
AI capabilities |
| Not checkable |
Not checkable |
18 Feb 2015 |
There is so much fun I can have with the work. But sometimes I need to build things with my hands.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
But there are things that are worth worrying about today, and there are things that are so far out that we can write science fiction about…
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
So in my opinion—and I used to be a chip designer—you should build a chip only when you’re pretty damn sure it can do something useful.
Not checkable · 18 Feb 2015 |
|
| Mostly true |
Factual |
18 Feb 2015 |
The system would probably not be more accurate, but it can potentially recognize people among hundreds of millions.
Factual · 18 Feb 2015 |
AI capabilities |
| Not checkable |
Not checkable |
18 Feb 2015 |
I have always been enamored of the idea of being able to train an entire system from end to end.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
I don’t think moral questions should be left to scientists alone!
Not checkable · 18 Feb 2015 |
|
| Not researched |
Factual |
18 Feb 2015 |
AI has gone through a number of AI winters because people claimed things they could not deliver.
Factual · 18 Feb 2015 |
AI timelines and forecasting |
| Not checkable |
Not checkable |
18 Feb 2015 |
Actually, I think the basics of machine learning are quite simple to understand.
Not checkable · 18 Feb 2015 |
|
| Unresolvable |
Prediction |
18 Feb 2015 |
Deep Learning will be part of the solution for generalized intelligence.
Prediction · 18 Feb 2015 |
AI timelines and forecasting |
| Not checkable |
Not checkable |
18 Feb 2015 |
describing it like the brain gives a bit of the aura of magic to it, which is dangerous.
Not checkable · 18 Feb 2015 |
|
| Mostly true |
Factual |
18 Feb 2015 |
A typical Deep Learning system is like a box with 500 million knobs, 1,000 light bulbs and 10 million training images.
Factual · 18 Feb 2015 |
AI compute, hardware and data |
| Not checkable |
Not checkable |
18 Feb 2015 |
I think it’s nuts.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
By training the system to predict what the world is going to be like a second, a minute, an hour, or a day from now, you can train it to…
Not checkable · 18 Feb 2015 |
|
| Not researched |
Factual |
18 Feb 2015 |
Computer facial recognition on real Internet pictures would be pretty close to human performance.
Factual · 18 Feb 2015 |
AI capabilities |
| Not checkable |
Not checkable |
18 Feb 2015 |
That’s why we don’t like hype: it is made by people who are either dishonest or self-deluded, and makes the life of serious and honest…
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
The problem is that it’s not going to be able to recognize objects to any degree of accuracy, unless you make it so gigantically big that…
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
Eventually, we should establish ethical guidelines as to how AI can and cannot be used.
Not checkable · 18 Feb 2015 |
|
| Not researched |
Factual |
18 Feb 2015 |
IBM's rat-scale brain simulation on a supercomputer was just a random network of neurons that did nothing useful.
Factual · 18 Feb 2015 |
AI capabilities |
| Not checkable |
Not checkable |
18 Feb 2015 |
What I am most fond of are beautiful and simple theoretical ideas that can be translated into something that works.
Not checkable · 18 Feb 2015 |
|
| Not researched |
Factual |
18 Feb 2015 |
Humans and animals do not learn through supervised labelling of examples the way Deep Learning systems do.
Factual · 18 Feb 2015 |
Science and research methods |
| Not researched |
Factual |
18 Feb 2015 |
Facebook has to automatically select 100 to 150 items that users want or need to see.
Factual · 18 Feb 2015 |
AI capabilities |
| Not checkable |
Not checkable |
18 Feb 2015 |
It’s the idea that every component, every stage in a learning machine can be trained.
Not checkable · 18 Feb 2015 |
|
| Mostly true |
Prediction |
18 Feb 2015 |
Natural language understanding will be the next frontier for Deep Learning.
Prediction · 18 Feb 2015 |
AI timelines and forecasting |
| Not checkable |
Not checkable |
18 Feb 2015 |
My least favorite description is, “It works just like the brain.”
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
I’m a rationalist. I’m also an atheist and a humanist; I’m not afraid of saying that.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
My idea of morality is to maximize overall human happiness and minimize human suffering over the long term.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
These are personal opinions that do not engage my employer.
Not checkable · 18 Feb 2015 |
|
| Not researched |
Factual |
18 Feb 2015 |
The architecture of convolutional nets is inspired by basic knowledge of the visual cortex.
Factual · 18 Feb 2015 |
AI capabilities |
| Mostly true |
Factual |
18 Feb 2015 |
A trained classifier may also correctly classify cars and dogs it has never seen before.
Factual · 18 Feb 2015 |
AI capabilities |
| Not checkable |
Not checkable |
18 Feb 2015 |
I don’t like people saying this because, while Deep Learning gets an inspiration from biology, it’s very, very far from what the brain…
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
It was a very innovative way of doing things; it was never practical, but it was cool.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
Not much has come out so far.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
It leads to hype; people claim things that are not true.
Not checkable · 18 Feb 2015 |
|
| Unresolvable |
Prediction |
18 Feb 2015 |
Deep Learning is part of the solution for machines representing relational and factual knowledge, but not the whole answer.
Prediction · 18 Feb 2015 |
AI capabilities |
| Not checkable |
Not checkable |
18 Feb 2015 |
But I’m very careful not to use words that could lead to hype.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
The equivalent in AI is to try to copy every detail that we know of about how neurons and synapses work, and then turn on a gigantic…
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
I’m kind of puzzled by that phenomenon.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
No, you can’t say never; technology is advancing very quickly, at an accelerating pace.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
I personally don’t think machines should be able to attack targets without a human making the decision.
Not checkable · 18 Feb 2015 |
|
| Unresolvable |
Prediction |
18 Feb 2015 |
AI hype could easily lead to another AI "winter cycle".
Prediction · 18 Feb 2015 |
AI timelines and forecasting |
| Not checkable |
Not checkable |
18 Feb 2015 |
I try not to pull rank.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
It sets expectations for funding agencies, the public, potential customers, start-ups and investors, such that they believe that we are on…
Not checkable · 18 Feb 2015 |
|
| Not researched |
Factual |
18 Feb 2015 |
Unsupervised techniques can be beaten by collecting more data and using supervised learning.
Factual · 18 Feb 2015 |
AI capabilities |
| Not checkable |
Not checkable |
18 Feb 2015 |
But he has not contributed anything to the science of AI, as far as I can tell.
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
18 Feb 2015 |
I think it would be “machines that learn to represent the world.”
Not checkable · 18 Feb 2015 |
|
| Not checkable |
Not checkable |
26 May 2014 |
All three groups are strong and complementary.
Not checkable · 26 May 2014 |
|
| Not checkable |
Not checkable |
26 May 2014 |
I use a lot of math, sometimes at the conceptual level more than at the “detailed proof” level.
Not checkable · 26 May 2014 |
|
| Not checkable |
Not checkable |
26 May 2014 |
There is nothing magical about margin maximization.
Not checkable · 26 May 2014 |
|
| Not checkable |
Not checkable |
26 May 2014 |
Like Kolmogorov, I am fascinated by the concept of complexity, which is at the root of learning theory, compression, and thermodynamics.
Not checkable · 26 May 2014 |
|
| Not checkable |
Not checkable |
26 May 2014 |
I prefer “Data Science”, which is the automatic (or semi-automatic) extraction of knowledge from data.
Not checkable · 26 May 2014 |
|
| Not checkable |
Not checkable |
26 May 2014 |
I do not believe that classical learning theory with “IID samples, convex optimization, and supervised classification and regression” is…
Not checkable · 26 May 2014 |
|
| Not checkable |
Not checkable |
26 May 2014 |
Kernel methods are great for many purposes, but they are merely glorified template matching.
Not checkable · 26 May 2014 |
|
| Not checkable |
Not checkable |
26 May 2014 |
Also, I totally hate sampling.
Not checkable · 26 May 2014 |
|
| Not checkable |
Not checkable |
26 May 2014 |
The principals don’t have a particularly good track record of success.
Not checkable · 26 May 2014 |
|
| Not checkable |
Not checkable |
26 May 2014 |
Physics is about modeling actual systems and processes.
Not checkable · 26 May 2014 |
|
| Not checkable |
Not checkable |
26 May 2014 |
Larger networks tend to work better.
Not checkable · 26 May 2014 |
|
| Not checkable |
Not checkable |
26 May 2014 |
I learned a lot by reading things that are not apparently connected with AI or computer science
Not checkable · 26 May 2014 |
|
| Not checkable |
Not checkable |
26 May 2014 |
I still think [Vicarious] is mostly hype.
Not checkable · 26 May 2014 |
|