| Not checkable |
Not checkable |
18 Apr 2024 |
I don't think AGI is one thing.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I'm simultaneously very optimistic that this stuff will continue to improve quickly and also a little more measured than I think some…
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I think it’s worth investing the $10Bs or $100B+ in building the infrastructure and assuming that if it keeps going you're going to get…
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
The specific products evolve, and to some degree come and go, but the advances for humanity persist and that's a cool part of what we all…
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I stay up at night worrying more about an untrustworthy actor having the super strong AI, whether it's an adversarial government or an…
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I don't believe that there's a single threshold of intelligence for humanity because people have different skills.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
Our bet is that it's going to basically change all of the products.
Not checkable · 18 Apr 2024 |
|
| Unresolvable |
Prediction |
18 Apr 2024 |
A 70B model trained with the Llama-3 architecture can keep improving with more data.
Prediction · 18 Apr 2024 |
AI capabilities |
| Own records only |
Factual |
18 Apr 2024 |
With unconnected content recommendations, Meta's pool of candidate content expanded from thousands to hundreds of millions.
Factual · 18 Apr 2024 |
Technology |
| Not checkable |
Not checkable |
18 Apr 2024 |
A lot of investors, and other people, can't wrap their head around why we would open source this.
Not checkable · 18 Apr 2024 |
|
| Unresolvable |
Factual |
18 Apr 2024 |
Zuckerberg said he thinks Meta had the extra GPU capacity because it was working on Reels.
Factual · 18 Apr 2024 |
Their own work or organisation |
| Not researched |
Factual |
18 Apr 2024 |
Llama 3 8B and 70B models lead their scale (size class) on benchmarks.
Factual · 18 Apr 2024 |
AI capabilities |
| Not checkable |
Not checkable |
18 Apr 2024 |
Probably the best way to mitigate that is to have good open source AI that becomes the standard and in a lot of ways can become the leader.
Not checkable · 18 Apr 2024 |
|
| Own records only |
Factual |
18 Apr 2024 |
Meta concluded it must solve general intelligence and increased its investment to do so.
Factual · 18 Apr 2024 |
Their own work or organisation |
| Not checkable |
Not checkable |
18 Apr 2024 |
I'm really interested in American history and classical history.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
In general in history, you hit bottlenecks at certain points.
Not checkable · 18 Apr 2024 |
|
| Not researched |
Factual |
18 Apr 2024 |
Llama 3 8B is nearly as powerful as the largest Llama 2 model.
Factual · 18 Apr 2024 |
AI capabilities |
| Own records only |
Factual |
18 Apr 2024 |
Zuckerberg decided Meta should order enough GPUs for Reels and ranking needs, plus double that amount.
Factual · 18 Apr 2024 |
Their own work or organisation |
| Not researched |
Factual |
18 Apr 2024 |
Meta AI is integrating Google and Bing for real-time knowledge.
Factual · 18 Apr 2024 |
AI capabilities |
| Not researched |
Factual |
18 Apr 2024 |
Over the previous 18 months it emerged that training models on coding helps them across many non-coding domains.
Factual · 18 Apr 2024 |
AI capabilities |
| Not checkable |
Not checkable |
18 Apr 2024 |
Actually, most of the times where we make some decision that ends up seeming good is because we messed something up before and just didn't…
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
If you're like Microsoft Azure or Amazon, if you're going to be reselling the model then we should have some revenue share on that.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
It just ensures that it's a much more even and balanced playing field.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
The current incarnation of all this stuff feels like it's going in a direction where intelligence can be pretty separated from…
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I specifically like building things around how people communicate and understanding how people express themselves and how people work.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I also think there is a fundamental limitation on the model architecture.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I don’t want to overstate it. It’s in a similar order of magnitude.
Not checkable · 18 Apr 2024 |
|
| Own records only |
Factual |
18 Apr 2024 |
Meta's ratio of inference compute to training compute is probably much higher than most other AI companies.
Factual · 18 Apr 2024 |
AI compute, hardware and data |
| Unresolvable |
Factual |
18 Apr 2024 |
Feeding the Llama 3 model more tokens would probably have made it somewhat better.
Factual · 18 Apr 2024 |
AI capabilities |
| Resolved true |
Factual |
18 Apr 2024 |
Meta started Facebook AI Research (FAIR) about 10 years before 2024.
Factual · 18 Apr 2024 |
Their own work or organisation |
| Unresolvable |
Prediction |
18 Apr 2024 |
A runaway AI intelligence scenario is not particularly likely.
Prediction · 18 Apr 2024 |
AI timelines and forecasting |
| Resolved true |
Prediction |
18 Apr 2024 |
A 1GW data center will be built eventually, but not in 2025 (next year).
Prediction · 18 Apr 2024 |
AI compute, hardware and data |
| Not checkable |
Not checkable |
18 Apr 2024 |
The main thing is just the ability to feel present with people, no matter where you are.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
So if we can do that 10% more efficiently, we're saving billions or tens of billions of dollars.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I do think that a concentration of AI in the future has the potential to be as dangerous as it being widespread.
Not checkable · 18 Apr 2024 |
|
| Mostly true |
Factual |
18 Apr 2024 |
Meta AI now generates high-quality images fast enough to generate and update them in real time as the user types.
Factual · 18 Apr 2024 |
AI capabilities |
| Mixed |
Factual |
18 Apr 2024 |
Meta's whole GPU fleet is the roughly 350,000 GPUs the interviewer cited as planned by end of year.
Factual · 18 Apr 2024 |
AI compute, hardware and data |
| Not checkable |
Not checkable |
18 Apr 2024 |
One modality that I'm pretty focused on, that I haven't seen as many other people in the industry focus on, is emotional understanding.
Not checkable · 18 Apr 2024 |
|
| Own records only |
Factual |
18 Apr 2024 |
Meta believes Meta AI is now the most intelligent, freely available AI assistant people can use.
Factual · 18 Apr 2024 |
AI capabilities |
| Not checkable |
Not checkable |
18 Apr 2024 |
But in all these subtle ways, through working on them, I think it's actually become clear that you do.
Not checkable · 18 Apr 2024 |
|
| Not researched |
Factual |
18 Apr 2024 |
After the industry standardized on Meta's open-sourced designs, volumes rose, costs fell for everyone, and Meta saved billions of dollars.
Factual · 18 Apr 2024 |
Economics and markets |
| Not checkable |
Not checkable |
18 Apr 2024 |
I think it's going to really enable people to do the things that they want a lot more.
Not checkable · 18 Apr 2024 |
|
| Not researched |
Factual |
18 Apr 2024 |
Zuckerberg has not committed to open sourcing everything Meta develops, though Meta is strongly pro open source.
Factual · 18 Apr 2024 |
AI policy and governance |
| Not checkable |
Not checkable |
18 Apr 2024 |
I actually think for most companies, of this scale at least, it's focus.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I don't want any of those other companies telling us what we can build.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I just feel constitutionally that I'm doing something wrong if I'm not building something new.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
But you can't know for certain from the outset.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
There is one world where maybe that’s not the case.
Not checkable · 18 Apr 2024 |
|
| Not researched |
Factual |
18 Apr 2024 |
Meta is releasing Llama 3 as open source and Llama 3 now powers Meta AI.
Factual · 18 Apr 2024 |
AI capabilities |
| Unresolvable |
Prediction |
18 Apr 2024 |
Many people will use off-the-shelf open models, while some bad-faith actors will try to strip out safeguards.
Prediction · 18 Apr 2024 |
AI safety and alignment |
| Not researched |
Factual |
18 Apr 2024 |
Getting energy permitted is a very heavily regulated government function.
Factual · 18 Apr 2024 |
AI policy and governance |
| Not checkable |
Not checkable |
18 Apr 2024 |
I think it's this very profound thing in tech that it actually creates a lot of winners.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I didn't really have the financial sophistication to really engage with that kind of debate.
Not checkable · 18 Apr 2024 |
|
| Not researched |
Factual |
18 Apr 2024 |
In the last few years, GPU production supply constraints limited how many GPUs companies could get, even those with money to pay.
Factual · 18 Apr 2024 |
AI compute, hardware and data |
| Not checkable |
Not checkable |
18 Apr 2024 |
We thought it was going to be something that had to do with training large models.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
In the meantime, I'd say the program is going quite well and we're just rolling it out methodically and we have a long-term roadmap for it.
Not checkable · 18 Apr 2024 |
|
| Own records only |
Factual |
18 Apr 2024 |
Meta spends a lot of time trying to make sure Llama-2 does not help people commit violent acts or things like that.
Factual · 18 Apr 2024 |
AI safety and alignment |
| Not checkable |
Not checkable |
18 Apr 2024 |
I consider the generation of synthetic data to be more inference than training today.
Not checkable · 18 Apr 2024 |
|
| Resolved true |
Promise |
18 Apr 2024 |
Meta has a roadmap of new Llama releases bringing multimodality, more multilinguality and bigger context windows.
Promise · 18 Apr 2024 |
AI capabilities |
| Not checkable |
Not checkable |
18 Apr 2024 |
I think we would probably build out bigger clusters than we currently can if we could get the energy to do it.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
Soon, not Llama-4.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
For the foreseeable future I'm optimistic we will be able to.
Not checkable · 18 Apr 2024 |
|
| Not researched |
Factual |
18 Apr 2024 |
As of April 2024, GPU supply constraints are easing.
Factual · 18 Apr 2024 |
AI compute, hardware and data |
| Own records only |
Factual |
18 Apr 2024 |
There are about 200 million creators on Meta's platforms.
Factual · 18 Apr 2024 |
Economics and markets |
| Not researched |
Factual |
18 Apr 2024 |
Picasso said that all children are artists and the challenge is to remain an artist as you grow up.
Factual · 18 Apr 2024 |
Other |
| Resolved true |
Factual |
18 Apr 2024 |
Meta did not prioritize coding when working on Llama 2.
Factual · 18 Apr 2024 |
AI capabilities |
| Not checkable |
Not checkable |
18 Apr 2024 |
We're not trying to prevent them from using it.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I think one lesson of technology is that you want to move things from the physical constraint realm into software as much as possible…
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
That’s something that's really fundamental: the bounds on what people can conceive of at the time as rational ways to work.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I don't think anyone in the industry can really tell you that it will continue scaling at that rate for sure.
Not checkable · 18 Apr 2024 |
|
| Unresolvable |
Prediction |
18 Apr 2024 |
AI is unlikely to go from somewhat intelligent to extremely intelligent overnight because of physical constraints.
Prediction · 18 Apr 2024 |
AI timelines and forecasting |
| Not researched |
Factual |
18 Apr 2024 |
In April 2024, Zuckerberg said he did not think anyone had yet built a gigawatt single AI training cluster.
Factual · 18 Apr 2024 |
AI compute, hardware and data |
| Not checkable |
Not checkable |
18 Apr 2024 |
As long as it's helping us then yeah.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
It's an arms race but I think we're at least winning that arms race currently.
Not checkable · 18 Apr 2024 |
|
| Unresolvable |
Prediction |
18 Apr 2024 |
ChatGPT and image diffusion models will clearly affect how people interact with every app.
Prediction · 18 Apr 2024 |
AI capabilities |
| Not researched |
Factual |
18 Apr 2024 |
The Llama 3 405B model, still in training, is already at around 85 MMLU.
Factual · 18 Apr 2024 |
AI capabilities |
| Not checkable |
Not checkable |
18 Apr 2024 |
I think that's a big step function.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
You’re earlier on in your trajectory so it's easier to pivot and take in new ideas without disrupting other commitments to different things.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
Obviously it's very difficult to predict what direction this stuff goes in over time, which is why I don't think anyone should be dogmatic…
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
But overall, I think it's just going to be really powerful for socializing, for feeling connected with people, for working, for parts of…
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I think that's going to be a pretty big deal and I'm really excited to get that in people's hands.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I actually think the real harms that need more energy in being mitigated are things where someone takes a model and does something to hurt…
Not checkable · 18 Apr 2024 |
|
| Not researched |
Factual |
18 Apr 2024 |
Llama 3 70B scores around 82 MMLU and has leading scores on math and reasoning.
Factual · 18 Apr 2024 |
AI capabilities |
| Not checkable |
Not checkable |
18 Apr 2024 |
I think it's going to be more like the creation of computing in the first place.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
But from what I can see so far, it doesn't seem like we're in that zone.
Not checkable · 18 Apr 2024 |
|
| Not checkable |
Not checkable |
18 Apr 2024 |
I'm not sure the metaverse is going to let you do that because it's going to be hard to go back in time for things that we don't have…
Not checkable · 18 Apr 2024 |
|
| Not researched |
Factual |
18 Apr 2024 |
Meta has a long history of open sourcing software.
Factual · 18 Apr 2024 |
Technology |
| Unresolvable |
Prediction |
18 Apr 2024 |
Zuckerberg said he thinks AI will probably surpass people at most skills at some point, depending on how powerful the models are.
Prediction · 18 Apr 2024 |
AI timelines and forecasting |
| Not researched |
Factual |
18 Apr 2024 |
At the time being discussed, people understood peace as the temporary time between enemy attacks.
Factual · 18 Apr 2024 |
Other |
| Not checkable |
Not checkable |
18 Apr 2024 |
it's probably also pretty bad for one institution to have an AI that is way more powerful than everyone else's AI.
Not checkable · 18 Apr 2024 |
|
| Not researched |
Factual |
18 Apr 2024 |
Meta does not tend to open source its products, such as Instagram's code, but open sources low-level infrastructure.
Factual · 18 Apr 2024 |
Technology |
| Not checkable |
Not checkable |
18 Apr 2024 |
For us I can say it is worth it to go build a model ourselves to make sure that we're not in that position.
Not checkable · 18 Apr 2024 |
|
| Unresolvable |
Prediction |
18 Apr 2024 |
People will not interact with just one singular AI; each business will want its own AI representing its interests.
Prediction · 18 Apr 2024 |
AI capabilities |
| Not checkable |
Not checkable |
18 Apr 2024 |
But I think open source is really powerful as a new way of building things.
Not checkable · 18 Apr 2024 |
|
| Not researched |
Factual |
18 Apr 2024 |
Augustus became Roman emperor and sought to establish peace.
Factual · 18 Apr 2024 |
Other |
| Not researched |
Factual |
18 Apr 2024 |
Zuckerberg said the Open Compute Project was probably the biggest open-source effort in Meta's history, describing it as open sourcing the designs for its servers, network switches and data centers.
Factual · 18 Apr 2024 |
Technology |
| Not checkable |
Not checkable |
18 Apr 2024 |
Our app specific work that we do will then still be so differentiated that it won't really matter.
Not checkable · 18 Apr 2024 |
|
| Unresolvable |
Factual |
18 Apr 2024 |
Meta has identified about 18 or 19 categories of harmful activity on social media and built AI systems to detect them.
Factual · 18 Apr 2024 |
AI safety and alignment |
| Unresolvable |
Prediction |
18 Apr 2024 |
AI scaling will run into energy constraints before capital investment stops being worth it.
Prediction · 18 Apr 2024 |
AI compute, hardware and data |
| Not checkable |
Not checkable |
18 Apr 2024 |
It's not actually clear that it is.
Not checkable · 18 Apr 2024 |
|