| Unresolvable |
Factual |
27 Oct 2020 |
In summer 2020 there was a limited window to rapidly test COVID-19 vaccines using many volunteers for human challenge trials, and it was not used.
Factual · 27 Oct 2020 |
Biosecurity |
| Unresolvable |
Prediction |
28 Feb 2018 |
Once artificial general intelligence capabilities exist, they will scale too fast for an economic framing to be a useful way to view the problem.
Prediction · 28 Feb 2018 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
28 Feb 2018 |
Very powerful and smart AI systems will redesign and improve themselves unless prevented for some reason.
Prediction · 28 Feb 2018 |
AI safety and alignment |
| Unresolvable |
Prediction |
28 Feb 2018 |
No AI development will ever look like a socially agreed, undeniable fire alarm for AGI.
Prediction · 28 Feb 2018 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
28 Feb 2018 |
Once artificial general intelligence capabilities exist, something like AlphaZero going "from 0 to 120 mph in four hours or a day" is not out of the question.
Prediction · 28 Feb 2018 |
AI timelines and forecasting |
| Unresolvable |
Factual |
28 Feb 2018 |
Yudkowsky said he was pretty sure he was not the one who invented the term under discussion.
Factual · 28 Feb 2018 |
Other |
| Unresolvable |
Prediction |
28 Feb 2018 |
An AI built narrowly enough to be understood will not be able to defend against arbitrary unrestrained superintelligences.
Prediction · 28 Feb 2018 |
AI safety and alignment |
| Unresolvable |
Prediction |
28 Feb 2018 |
Yudkowsky thinks AGI will be built on purpose about 10 years before it would otherwise happen by accident.
Prediction · 28 Feb 2018 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
28 Feb 2018 |
The first artificial general intelligence will be built in a research lab specifically dedicated to building it, not arise spontaneously from an unrelated system.
Prediction · 28 Feb 2018 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
28 Feb 2018 |
Yudkowsky said he thinks the artificial general intelligence timeline is likely to run out before humanity gets much better at solving inadequacy and systemic problems in general.
Prediction · 28 Feb 2018 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
28 Feb 2018 |
Better anti-virus software will not give automatic defense against superintelligence.
Prediction · 28 Feb 2018 |
AI safety and alignment |
| Unresolvable |
Factual |
2008 |
The Dartmouth Proposal on AI makes no mention of building nice, good or benevolent AI.
Factual · 2008 |
AI policy and governance |
| Unresolvable |
Prediction |
2008 |
Yudkowsky said he did not think it plausible that Homo sapiens would continue indefinitely without a mind arising that exceeds the current upper bound on intelligence.
Prediction · 2008 |
AI timelines and forecasting |
| Unresolvable |
Factual |
2008 |
Human beings use heuristics that quickly give good approximate answers in many cases but also produce systematic errors called biases.
Factual · 2008 |
Science and research methods |
| Unresolvable |
Prediction |
2008 |
Yudkowsky suggested that if the Earth is destroyed, it will probably be by mistake rather than deliberately.
Prediction · 2008 |
Other global risks |
| Unresolvable |
Prediction |
2008 |
It is more likely that Friendly AI is solvable but no one will solve it in time than that it is humanly impossible.
Prediction · 2008 |
AI safety and alignment |
| Unresolvable |
Prediction |
2008 |
An Artificial Intelligence might increase in intelligence extremely fast.
Prediction · 2008 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
2008 |
Yudkowsky said he thinks Artificial Intelligence is the road we will end up taking into "that challenge", which the surrounding text describes as the way out of the high-mortality phase of the life cycle and probably the single most dangerous risk we face.
Prediction · 2008 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
2008 |
When technology first becomes capable of uploading, it will have overwhelmingly more computing power and probably far better cognitive science than building an AI requires.
Prediction · 2008 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
2008 |
Yudkowsky said he feared regulatory agencies would not approve human experiments, in the context of augmenting human intelligence through biology.
Prediction · 2008 |
AI policy and governance |
| Unresolvable |
Prediction |
2008 |
A superintelligent AI whose goal system operates in an unforeseen fashion may actively resist human attempts to correct it.
Prediction · 2008 |
AI safety and alignment |
| Unresolvable |
Factual |
2008 |
It seems that people do not extrapolate from experienced small hazards to the possibility of large risks.
Factual · 2008 |
Philosophy, ethics and society |
| Unresolvable |
Factual |
2008 |
The obvious experimental manipulations of heuristics-and-biases studies have already been tried, and the results were found to be robust.
Factual · 2008 |
Science and research methods |
| Unresolvable |
Prediction |
2008 |
Yudkowsky said he thinks it will prove easier, in the end, to build a 747 from scratch than to scale up an existing bird or graft on jet engines, an analogy he used for building Artificial Intelligence rather than taking another road into the challenge of smarter-than-human intelligence.
Prediction · 2008 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
2008 |
With molecular nanotechnology, an AI could potentially rewrite the solar system unopposed.
Prediction · 2008 |
Other global risks |
| Unresolvable |
Prediction |
2008 |
Human uploading and upgrading will very probably not be the ground on which humanity first confronts smarter-than-human intelligence.
Prediction · 2008 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
2008 |
An AI might make a huge jump in intelligence after reaching some threshold of criticality.
Prediction · 2008 |
AI timelines and forecasting |
| Unresolvable |
Factual |
2008 |
The people who first invented and spread communism were idealists acting with good intentions.
Factual · 2008 |
Philosophy, ethics and society |
| Unresolvable |
Prediction |
2008 |
An Artificial Intelligence could rewrite its code from scratch and change the underlying dynamics of optimization.
Prediction · 2008 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
2008 |
Yudkowsky said he thinks it is possible for fallible humans to succeed at building Friendly AI, but only if intelligence ceases to be a sacred mystery to us.
Prediction · 2008 |
AI safety and alignment |
| Unresolvable |
Prediction |
2008 |
There will not necessarily be distant advance warning before AI is created, so it cannot be relied upon.
Prediction · 2008 |
AI timelines and forecasting |
| Unresolvable |
Prediction |
2008 |
In Yudkowsky's opinion at the time, which he said did not rest on a precise calculation using a precisely confirmed theory, sharp jumps in intelligence are possible and likely, and constitute the dominant probability.
Prediction · 2008 |
AI timelines and forecasting |
| Unresolvable |
Factual |
2007 |
Humans were created by evolution, an unintelligent process, whereas AI will be created by intelligent human processes.
Factual · 2007 |
AI capabilities |
| Unresolvable |
Prediction |
2007 |
An AI project will not succeed merely by implementing a five-layer model of intelligence like the human brain's.
Prediction · 2007 |
AI capabilities |
| Unresolvable |
Prediction |
2007 |
A deliberately designed AI is likely to begin as a set of subsystems in a primitive, undeveloped state already designed to form a functioning supersystem.
Prediction · 2007 |
AI capabilities |
| Unresolvable |
Factual |
2007 |
Yudkowsky, on first visualizing a triangular light bulb, saw a pyramidal bulb with smoothed edges and a bulb on the square base.
Factual · 2007 |
Philosophy, ethics and society |
| Unresolvable |
Prediction |
2007 |
Yudkowsky conjectured that matching imagery against large concept sets will be one of the most computationally intensive subprocesses in AI, perhaps the most expensive subprocess.
Prediction · 2007 |
AI capabilities |
| Unresolvable |
Factual |
2007 |
Yudkowsky estimated that the whole process of forming the mental image in his example took less than one second.
Factual · 2007 |
Philosophy, ethics and society |
| Unresolvable |
Prediction |
2007 |
Cautiously considering what a more foresightful and less accretive design for intelligence might look like, Yudkowsky suggested that in an AI the center of gravity of intelligence, the process humans observe through their internal narrative, would probably become the central supersystem of the mind, to an even greater degree than in humans.
Prediction · 2007 |
AI capabilities |
| Unresolvable |
Factual |
2007 |
Yudkowsky cannot introspect on how the salient facet of a concept is selected during concept combination.
Factual · 2007 |
Philosophy, ethics and society |
| Unresolvable |
Factual |
2007 |
The mental image of the pyramidal light bulb carried semantic content, such as knowledge of its glass composition, imported from the "light bulb" concept.
Factual · 2007 |
Philosophy, ethics and society |
| Unresolvable |
Prediction |
2007 |
Early-stage AIs will likely be less adept than humans at visualizing concepts only as far as needed, and so may need full visualizations where humans use abstract reasoning.
Prediction · 2007 |
AI capabilities |
| Unresolvable |
Factual |
2007 |
When a person reads the letters spelling "light bulb", the phonemes for it flow through the auditory cortex.
Factual · 2007 |
Science and research methods |
| Unresolvable |
Prediction |
2007 |
The distinction between sharp, fragile human-written code and smooth biological computation is unlikely to be erased by programmer effort or new programming languages.
Prediction · 2007 |
AI capabilities |
| Unresolvable |
Prediction |
2007 |
Software-level parallelism, poorly handled by present-day languages, will likely be one of the greatest challenges in AI development.
Prediction · 2007 |
AI capabilities |
| Unresolvable |
Factual |
2007 |
The mental image of a triangular light bulb would intuitively appear to result from imposing "triangular" on the "light bulb" concept.
Factual · 2007 |
Philosophy, ethics and society |
| Unresolvable |
Factual |
2007 |
The idea of 'pure' abstract reasoning has historically given rise to pathologies in AI research.
Factual · 2007 |
AI capabilities |