The Transformer algorithm was invented in 2017.
Resolved true The record shows it happened or was so.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge said mostly true; the verdict shown is the first judge's.
What would count as true or false
True: the Transformer architecture was first introduced in 2017, e.g. in the paper 'Attention Is All You Need' (Vaswani et al., arXiv June 2017, NeurIPS 2017). Mostly true: it was introduced in 2017, but key components (attention mechanisms) predate it. That is consistent with 'invented in 2017'. Mostly false: the architecture as named was first published in an adjacent year. False: the Transformer was introduced well before or after 2017.
Set before the research began.
Evidence (4)
-
E1 Attention Is All You Need - Wikipedia Wikipedia
“is a 2017 research paper on machine learning authored by eight scientists and engineers working at Google. The paper introduced a new deep learning architecture known as the transformer, based on the attention mechanism proposed in 2014 by Bahdanau et al.”
-
E2 Attention Is All You Need - Wikipedia Wikipedia
“On 2017-06-12, the original (100M-parameter) encoder–decoder transformer model was published in the "Attention is All you need" paper.”
-
E3 Attention Is All You Need - Wikipedia Wikipedia
“Polosukhin, Illia (December 2017). "Attention is All you Need" (PDF).”
-
E4 Attention Is All You Need - Wikipedia Wikipedia
“31st Conference on Neural Information Processing Systems (NIPS). Advances in Neural Information Processing Systems. Vol. 30. Curran Associates, Inc. arXiv:1706.03762.”
Reasoning
E1 describes 'Attention Is All You Need' as a 2017 paper that introduced the transformer architecture. E2 dates the publication of the original transformer model to 2017-06-12. E3 and E4 place the paper in the NIPS 2017 proceedings (December 2017) with arXiv identifier 1706.03762. E1 says the underlying attention mechanism dates from 2014, but the claim is about the Transformer architecture itself, which the evidence shows was first introduced in 2017. That matches the criterion for true.
Cite this claim
Marc Andreessen, “The Transformer algorithm was invented in 2017.” (said 12 June 2023). Verdict: resolved true. Reliability API, claim c_27240c522a0b, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_27240c522a0b
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Marc Andreessen
-
Mixed
“Basically, within less than 12 months, four or five Chinese companies have caught up to the industry front - line.”
-
Mostly true
“It's completely open - source, and anyone can download and run it.”
The DeepSeek model is completely open-source and anyone can download and run it.
-
Mostly true
“The idea of neural networks was explored by a small group of people for 80 years.”
Neural networks were explored by a small group of people for about 80 years.
-
Mostly true
“When I was in college in the 1980s, AI was a niche field, and everyone thought it would never come true.”
-
Resolved true
“If you track the capabilities of cutting - edge models over time, you'll find that after 6 or 12 months, there will be a small model with the same capabilities.”
Verdicts are made automatically; how verdicts are made.