| Not researched |
Factual |
26 Oct 2023 |
The UK AI Summit appears to be focusing primarily on long-term AI risk, the risk of future machines going beyond human control.
Factual · 26 Oct 2023 |
AI policy and governance |
| Not researched |
Factual |
26 Oct 2023 |
Current AI has no reliable way to anticipate the consequences of actions it might recommend.
Factual · 26 Oct 2023 |
AI safety and alignment |
| Mostly true |
Factual |
26 Oct 2023 |
A newly published technique shows that current LLMs can be jailbroken quickly and automatically.
Factual · 26 Oct 2023 |
AI safety and alignment |
| Resolved true |
Factual |
26 Oct 2023 |
There is currently no way to guarantee that large language models won't be jailbroken into saying unethical things.
Factual · 26 Oct 2023 |
AI safety and alignment |
| Mostly true |
Factual |
26 Oct 2023 |
Gary Marcus emphasized a CERN for AI and global AI governance in April 2023 in his TED talk and in The Economist.
Factual · 26 Oct 2023 |
Their own work or organisation |
| Not researched |
Factual |
Apr 2023 |
In April 2023 Gary Marcus and Anka Reuel proposed a global, neutral, non-profit International Agency for AI (IAAI).
Factual · Apr 2023 |
Their own work or organisation |
| Unresolvable |
Factual |
30 Mar 2023 |
Gary Marcus wrote a long Twitter thread on the morning of 2023-03-30 responding to criticism of the FLI letter.
Factual · 30 Mar 2023 |
Their own work or organisation |
| Not researched |
Factual |
30 Mar 2023 |
The FLI open letter did not call for a ban on GPT-4.
Factual · 30 Mar 2023 |
Their own work or organisation |
| Not researched |
Factual |
30 Mar 2023 |
Most signers of the FLI open letter, including Gary Marcus and Yoshua Bengio, have no connection to the Future of Life Institute.
Factual · 30 Mar 2023 |
Their own work or organisation |
| Not researched |
Factual |
30 Mar 2023 |
The letter Marcus was discussing did not call for a ban on most AI research, only for a brief pause on one very specific project involving a technology with known risks and no known solutions.
Factual · 30 Mar 2023 |
Their own work or organisation |
| Resolved true |
Factual |
30 Mar 2023 |
The FLI open letter called for more AI research.
Factual · 30 Mar 2023 |
Their own work or organisation |
| Not researched |
Factual |
30 Mar 2023 |
Virtually everyone, including people at OpenAI, has acknowledged serious AI risks, but as of March 2023 few tangible steps to mitigate them have been taken by government or industry.
Factual · 30 Mar 2023 |
AI policy and governance |
| Resolved true |
Factual |
30 Mar 2023 |
The FLI open letter did not call for a ban on AI or for a permanent ban.
Factual · 30 Mar 2023 |
Their own work or organisation |
| Mostly true |
Factual |
30 Mar 2023 |
As of March 2023, none of the top AI labs is remotely transparent, AI governance basically doesn't exist, and there are basically no safeguards in place.
Factual · 30 Mar 2023 |
AI policy and governance |
| Unresolvable |
Factual |
30 Mar 2023 |
Gary Marcus signed the Future of Life Institute open letter and promoted it publicly.
Factual · 30 Mar 2023 |
Their own work or organisation |
| Resolved true |
Factual |
24 Mar 2023 |
There have already been reports of contamination in GPT-4's training data.
Factual · 24 Mar 2023 |
AI capabilities |
| Mostly true |
Factual |
24 Mar 2023 |
The OpenAI and Microsoft GPT-4 papers reveal nothing about the model's architecture or training set.
Factual · 24 Mar 2023 |
AI capabilities |
| Mostly true |
Factual |
24 Mar 2023 |
Citing Ernie Davis, Marcus said OpenAI had begun to incorporate user experiments into its models' training corpus.
Factual · 24 Mar 2023 |
AI capabilities |
| Resolved true |
Factual |
24 Mar 2023 |
GPT-4 has not solved hallucinations, reliability or planning on complex tasks, as the paper's authors acknowledge for planning.
Factual · 24 Mar 2023 |
AI capabilities |
| Mostly true |
Factual |
24 Mar 2023 |
Gary Marcus said that on 2023-03-23 Microsoft had put out what he called a press release masquerading as science, which claimed that GPT-4 was an early (yet still incomplete) version of an AGI system.
Factual · 24 Mar 2023 |
AI capabilities |
| Not researched |
Factual |
24 Mar 2023 |
OpenAI CEO Sam Altman has recently publicly expressed fears about where AI development is going.
Factual · 24 Mar 2023 |
AI safety and alignment |
| Not researched |
Factual |
Feb 2023 |
Marcus's February 2023 warning that generative AI would corrupt the internet increasingly appears correct.
Factual · Feb 2023 |
AI safety and alignment |
| Mostly true |
Factual |
25 Dec 2022 |
ChatGPT regularly makes things up, and a fair bit of what it says is untrue.
Factual · 25 Dec 2022 |
AI capabilities |
| Unresolvable |
Factual |
25 Dec 2022 |
ChatGPT is frequently retuned based on feedback, but weeks later Marcus still keeps being sent tweets showing its blunders.
Factual · 25 Dec 2022 |
AI capabilities |
| Mostly true |
Factual |
25 Dec 2022 |
ChatGPT might sound like the Star Trek computer, but for now it still cannot be trusted.
Factual · 25 Dec 2022 |
AI capabilities |
| Unresolvable |
Factual |
25 Dec 2022 |
GPT-4 is architecturally essentially the same as GPT-3, according to rumors.
Factual · 25 Dec 2022 |
AI capabilities |
| Own records only |
Factual |
25 Dec 2022 |
Marcus knows several people who have tried GPT-4, and all were impressed.
Factual · 25 Dec 2022 |
AI capabilities |
| Mostly true |
Factual |
25 Dec 2022 |
ChatGPT can write about anything but is easily confused.
Factual · 25 Dec 2022 |
AI capabilities |
| Mostly true |
Factual |
Dec 2022 |
AI-generated misinformation became increasingly widespread, as Marcus warned in December 2022, but its effects have so far been less than he feared.
Factual · Dec 2022 |
AI safety and alignment |
| Not researched |
Factual |
Dec 2022 |
Marcus's December 2022 prediction of chatbot-associated deaths was confirmed in 2023, with another apparent incident in 2024.
Factual · Dec 2022 |
AI safety and alignment |
| Mostly true |
Factual |
Mar 2022 |
Gary Marcus's March 2022 article argued pure scaling would not solve hallucinations or abstraction and concluded there are serious holes in the scaling argument.
Factual · Mar 2022 |
Their own work or organisation |
| Resolved true |
Factual |
Mar 2022 |
In March 2022 Gary Marcus published an article arguing that deep learning is hitting a wall.
Factual · Mar 2022 |
Their own work or organisation |
| Not researched |
Factual |
2022 |
Marcus's predictions since 2022 that pure LLM scaling would run out appear to have been confirmed in November and December 2024 by comments from industry insiders.
Factual · 2022 |
AI timelines and forecasting |
| Unresolvable |
Factual |
20 Dec 2021 |
Gary Marcus wrote the 2001 book The Algebraic Mind, and its predictions have so far held true.
Factual · 20 Dec 2021 |
Their own work or organisation |
| Resolved true |
Factual |
16 Nov 2021 |
In open-ended tasks such as driving, humans outperform AI systems.
Factual · 16 Nov 2021 |
AI capabilities |
| Mostly true |
Factual |
15 Nov 2021 |
Deep neural nets, nearly 10 years after their celebrated rebirth, are still utterly fooled by images like the one shown.
Factual · 15 Nov 2021 |
AI capabilities |
| Resolved true |
Factual |
1 Nov 2021 |
Aaron Beck, developer of cognitive therapy, has died.
Factual · 1 Nov 2021 |
Other |
| Not researched |
Factual |
22 May 2021 |
As of May 2021, no current self-driving car is as good as a typical human driver.
Factual · 22 May 2021 |
AI capabilities |
| Mostly true |
Factual |
12 May 2021 |
Biological brains have a high degree of precise internal structure that artificial neural networks lack.
Factual · 12 May 2021 |
AI capabilities |
| Mostly true |
Factual |
8 May 2021 |
Covid-19 is transmitted through the air (airborne).
Factual · 8 May 2021 |
Biosecurity |
| Not researched |
Factual |
19 Apr 2021 |
British Columbia has been targeted by disinformation from Cambridge Analytica.
Factual · 19 Apr 2021 |
Other |
| Resolved true |
Factual |
17 Apr 2021 |
Garry Kasparov beat Gary Marcus at a chess exhibition.
Factual · 17 Apr 2021 |
Other |
| Unresolvable |
Factual |
13 Apr 2021 |
As of 2021, neural networks still struggle with notions that are obvious to babies.
Factual · 13 Apr 2021 |
AI capabilities |
| Resolved true |
Factual |
13 Apr 2021 |
Gary Marcus published a 1999 Science article on infant rule learning.
Factual · 13 Apr 2021 |
Science and research methods |
| Own records only |
Factual |
28 Oct 2020 |
Marcus spent three months recruiting Rodney Brooks to join his robotics company idea.
Factual · 28 Oct 2020 |
Their own work or organisation |
| Mostly true |
Factual |
28 Oct 2020 |
As of 2020 there is no off-the-shelf software platform for building a domestic robot comparable to a game engine for building video games.
Factual · 28 Oct 2020 |
Technology |
| Not researched |
Factual |
25 Jun 2020 |
There have been apparent efforts in the US to reduce COVID-19 testing in order to deny the scope of the problem.
Factual · 25 Jun 2020 |
Biosecurity |
| Not researched |
Factual |
16 Jun 2020 |
Dexamethasone shows very encouraging results treating covid and appears to reduce mortality for some patients, though it is not a cure for all.
Factual · 16 Jun 2020 |
Biosecurity |
| Not researched |
Factual |
8 Jun 2020 |
Over 200 Zuckerberg-funded scientists have called on Facebook to rein in Trump.
Factual · 8 Jun 2020 |
Other |
| Unresolvable |
Factual |
4 Jun 2020 |
Anima Anandkumar misrepresented private correspondence with Gary Marcus.
Factual · 4 Jun 2020 |
Their own work or organisation |
| Not researched |
Factual |
4 Jun 2020 |
Fewer than 1% of Facebook's employees have spoken up publicly about Zuckerberg's decision on Trump's remarks.
Factual · 4 Jun 2020 |
Other |
| Unresolvable |
Factual |
4 Jun 2020 |
Gary Marcus said that Sergey Brin, Larry Page and Elon Musk lead a "hall of shame" list of billionaires who have made no known charitable contributions to helping the world cope with Covid.
Factual · 4 Jun 2020 |
Other |
| Unresolvable |
Factual |
2 Jun 2020 |
Robust.AI is closed on 2 June 2020 in solidarity with those seeking justice and in memory of George Floyd.
Factual · 2 Jun 2020 |
Other |
| Not researched |
Factual |
1 Jun 2020 |
Tear gas was used near the White House and the White House was dark on 1 June 2020.
Factual · 1 Jun 2020 |
Other |
| Not researched |
Factual |
16 May 2020 |
Without a big training set, current AI techniques do not work very well.
Factual · 16 May 2020 |
AI capabilities |
| Not researched |
Factual |
15 May 2020 |
Gary Marcus has frequently criticized Elon Musk's views on AI publicly on Twitter.
Factual · 15 May 2020 |
Their own work or organisation |
| Not researched |
Factual |
13 May 2020 |
Genetic factors likely contribute to differences in coronavirus outcomes, and the UK has launched a large gene sequencing study to find predictors.
Factual · 13 May 2020 |
Biosecurity |
| Resolved true |
Factual |
12 May 2020 |
When the environment changes, as during the pandemic, many AI models start to break.
Factual · 12 May 2020 |
AI capabilities |
| Not researched |
Factual |
7 May 2020 |
On February 13, Senator Burr and his brother-in-law sold stock, apparently based on privileged knowledge that could have saved thousands of lives.
Factual · 7 May 2020 |
Economics and markets |
| Not researched |
Factual |
4 May 2020 |
Delivery robots not being ready is another failure of current AI to handle open-ended real-world problems, as Marcus anticipated.
Factual · 4 May 2020 |
AI capabilities |
| Mostly false |
Factual |
4 May 2020 |
Published numbers for flu deaths are likely overestimates.
Factual · 4 May 2020 |
Biosecurity |
| Not researched |
Factual |
1 May 2020 |
Sweden's lax COVID-19 policy, made stricter in the week of 1 May 2020, has cost lives.
Factual · 1 May 2020 |
Biosecurity |
| Resolved true |
Factual |
30 Apr 2020 |
A piece on common sense in AI by John Pavlus includes some chortling and skepticism from Gary Marcus.
Factual · 30 Apr 2020 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
What current game-playing AI systems learn is very superficial and does not transfer to similar games.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Current pixels-to-action end-to-end AI systems are incredibly fragile.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Retraining the system to play on an 18-by-18 board would require it to play another 30 million games.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Robotics feats like the Rubik's Cube demonstration are not seen in the real world, only in laboratory demonstrations.
Factual · 14 Nov 2019 |
Technology |
| Not researched |
Factual |
14 Nov 2019 |
The Atari reinforcement learning system makes many mistakes when the paddle is moved a few pixels.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Gary Marcus said that a system trained on a dataset in which white people are better represented than their share of the world's population does not know the difference between what is represented in the data and what is out there in the world.
Factual · 14 Nov 2019 |
AI safety and alignment |
| Unresolvable |
Factual |
14 Nov 2019 |
Asked whether "they" understand the "no free lunch" point, Marcus said "about 75 percent" and "They do not yet"; the quote does not say who "they" are or what the 75 percent measures.
Factual · 14 Nov 2019 |
Field building and careers |
| Not researched |
Factual |
14 Nov 2019 |
Gary Marcus said his coauthor is Ernie Davis, a computer scientist at NYU.
Factual · 14 Nov 2019 |
Their own work or organisation |
| Not researched |
Factual |
14 Nov 2019 |
Marcus said that moving the paddle up a few pixels, as Vicarious did in a paper, shows that the system does not actually understand anything at all, including a ricochet technique once the paddle is moved from memorised positions.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Driverless car intervention rates are many orders of magnitude away from human safety statistics for fatalities.
Factual · 14 Nov 2019 |
Technology |
| Not researched |
Factual |
14 Nov 2019 |
Current robotic systems are not good at handling variation in objects and placement when real conditions differ from the blueprint.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
No machine yet exists that can decide to tidy up an out-of-place object like a fan in a room.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Current AI systems do not understand that chairs are for sitting on or that removing a leg could make a chair fall over.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Deep learning systems for the most part do not allow symbolic basic operations of the kind found in ordinary programming, such as basic Fortran.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Current AI systems are essentially illiterate: they cannot read and understand books.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
For the most part, current AI approaches do not handle compositionality; they look at all the words in a sentence and try to find other sentences with similar vocabulary.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
No one other than Cyc currently has a system good at making logical inferences about people and actions.
Factual · 14 Nov 2019 |
AI capabilities |
| Resolved true |
Factual |
14 Nov 2019 |
Gary Marcus wrote a book called The Birth of the Mind about how a small number of genes builds a complex brain.
Factual · 14 Nov 2019 |
Their own work or organisation |
| Not researched |
Factual |
14 Nov 2019 |
As of 2019 no commercial AI system is remotely close to natural language understanding.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Cyc is, to his knowledge, the biggest knowledge engineering project of all time.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Current robots are not robust and autonomous enough to make their own decisions.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Cyc is generally regarded as a failure.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Cognitive architectures were mostly built originally for cognitive psychology rather than for AI.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
As of 2019 no commercial AI system is close to transferring between different tasks the way a person moves from one war game to another.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Facebook's AI research is still mostly dominated by the deep learning approach.
Factual · 14 Nov 2019 |
AI capabilities |
| Resolved true |
Factual |
14 Nov 2019 |
Cyc is not an end-to-end system.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Published statistics show driverless cars need a human intervention about once every 10,000 miles.
Factual · 14 Nov 2019 |
Technology |
| Not researched |
Factual |
14 Nov 2019 |
DeepMind claimed its system mastered Go without human knowledge, which is not actually correct.
Factual · 14 Nov 2019 |
AI capabilities |
| Unresolvable |
Factual |
14 Nov 2019 |
Most of the current best AI systems fundamentally just learn contingencies rather than general abstract concepts that humans can apply quickly.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
There is no formal argument out there that the person Marcus is discussing (referred to only as "he") is wrong.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
As of November 2019, there was no systematic way of solving this problem and its many variations, and Marcus said he thinks there may be no possibility of doing so.
Factual · 14 Nov 2019 |
AI safety and alignment |
| Not researched |
Factual |
14 Nov 2019 |
No current AI system, deep learning or otherwise, can induce heuristics that transfer from one game to the next.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Nobody knows how to build a machine that can tidy a room containing arbitrary objects.
Factual · 14 Nov 2019 |
Technology |
| Unresolvable |
Factual |
14 Nov 2019 |
The best-selling domestic robot of all time is still the Roomba, which does not manipulate objects.
Factual · 14 Nov 2019 |
Technology |
| Mixed |
Factual |
14 Nov 2019 |
AI currently lacks a way of building reusable skills.
Factual · 14 Nov 2019 |
AI capabilities |
| Not researched |
Factual |
14 Nov 2019 |
Part of the Tesla Model 3 production problem was that Elon Musk overestimated how easy it would be to get robots to work in complex assembly lines.
Factual · 14 Nov 2019 |
AI, the economy and work |
| Not researched |
Factual |
14 Nov 2019 |
In the early 1990s nobody had any idea how big the internet would become.
Factual · 14 Nov 2019 |
AI timelines and forecasting |