| Not researched |
Factual |
20 Feb 2023 |
In 2023 he graded predictions 3 and 4 of his earlier list as having happened and predictions 1 and 2 as not having happened.
Factual · 20 Feb 2023 |
Their own work or organisation |
| Mostly true |
Prediction |
20 Feb 2023 |
Scaling AI models will continue to produce gains, though less obviously than in the past five years.
Prediction · 20 Feb 2023 |
AI capabilities |
| Not yet due |
Prediction |
20 Feb 2023 |
His decision to devote more space to AI than to all non-AI topics combined will look prescient by 2028, even if his explicit predictions are wrong.
Prediction · 20 Feb 2023 |
Their own work or organisation |
| Not checkable |
Not checkable |
20 Feb 2023 |
Wokeness has peaked - but Mt. Everest has peaked, and that doesn’t mean it’s weak or irrelevant or going anywhere.
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
20 Feb 2023 |
I think I nailed this.
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
20 Feb 2023 |
I don’t think the Officialness Divide or the Ability-To-Circumvent-Regulations Age arrived in any meaningful way.
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
20 Feb 2023 |
I didn’t even think it was on the radar back then!
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
20 Feb 2023 |
I judge 1, 4, 5, and 6 as having happened, and 2 and 3 as not having happened, making me directionally correct on all predictions.
Not checkable · 20 Feb 2023 |
|
| Not researched |
Factual |
20 Feb 2023 |
The Democratic Party has not had a crisis since 2018; it nominated Joe Biden as a compromise candidate and that worked.
Factual · 20 Feb 2023 |
Other |
| Not yet due |
Prediction |
20 Feb 2023 |
AI will not immediately revolutionize the economy, and he would be mildly surprised if it showed up as a visible break from trend in major macroeconomic indicators (GDP, unemployment, productivity); the claim is assessed by 2028.
Prediction · 20 Feb 2023 |
AI, the economy and work |
| Not researched |
Factual |
20 Feb 2023 |
In 2018, for the fifth anniversary of his old blog, Scott Alexander made predictions about the next five years.
Factual · 20 Feb 2023 |
Their own work or organisation |
| Not checkable |
Not checkable |
20 Feb 2023 |
Everyone who hasn’t been looking at Bing screenshots the past week is light-years behind on thinking about this.
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
20 Feb 2023 |
Really all that this proves is that, like every rationalist, I’ve been in a constant state of mild panic about pandemic-related risks since…
Not checkable · 20 Feb 2023 |
|
| Not yet due |
Prediction |
20 Feb 2023 |
Ethereum and Bitcoin will do fine by 2028 (Ethereum because stablecoins are built on its chain).
Prediction · 20 Feb 2023 |
Economics and markets |
| Mostly true |
Factual |
20 Feb 2023 |
As of early 2023 nobody is talking about technological unemployment, because unemployment rates are historically low.
Factual · 20 Feb 2023 |
AI, the economy and work |
| Not checkable |
Not checkable |
20 Feb 2023 |
The prediction I am most proud of is the (admittedly conditional, not strongly asserted) possibility that AIs would be able to generate…
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
20 Feb 2023 |
I think all of this is basically true, though I’m probably judging this through the same biased idiosyncratic social lens that I used in…
Not checkable · 20 Feb 2023 |
|
| Mostly true |
Factual |
20 Feb 2023 |
impute.me may provide the consumer polygenic score service Scott Alexander predicted, but it has made no public waves.
Factual · 20 Feb 2023 |
Technology |
| Not checkable |
Not checkable |
20 Feb 2023 |
I think I was riding high off the age of Uber and Bitcoin, and expected people to continue to have that level of creative/entrepreneurial…
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
20 Feb 2023 |
Time has proven me right.
Not checkable · 20 Feb 2023 |
|
| Not yet due |
Prediction |
20 Feb 2023 |
Altcoins will mostly not do fine by 2028.
Prediction · 20 Feb 2023 |
Economics and markets |
| Not checkable |
Not checkable |
20 Feb 2023 |
Overall grade: C-
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
20 Feb 2023 |
We seem to be in the beginning of a slow takeoff.
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
20 Feb 2023 |
Global existential risks will hopefully not be a big part of the 2018-2023 period.
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
20 Feb 2023 |
I don’t think I got any particular details of COVID right.
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
20 Feb 2023 |
My model is something like: start with 1% risk of artificial pandemic catastrophe per decade in 1985, double every ten years.
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
20 Feb 2023 |
I judge 2, 3, 4, and 6 as having happened (though 2 is confounded by COVID).
Not checkable · 20 Feb 2023 |
|
| Not yet due |
Prediction |
20 Feb 2023 |
He said he does not expect advances in genetics by 2028 to yield anything more interesting than one or two last-ditch treatments for rare diseases, "if that".
Prediction · 20 Feb 2023 |
Science and research methods |
| Not checkable |
Not checkable |
20 Feb 2023 |
If you give them access to a gun, they will shoot people, not as part of a 20-dimensional chess strategy that inevitably ends in world…
Not checkable · 20 Feb 2023 |
|
| Not yet due |
Prediction |
20 Feb 2023 |
AI's revolutionary economic effects will show up eventually in macroeconomic indicators, but not by 2028.
Prediction · 20 Feb 2023 |
AI, the economy and work |
| Resolved true |
Prediction |
20 Feb 2023 |
Training GPT-4 will cost $100 million.
Prediction · 20 Feb 2023 |
AI compute, hardware and data |
| Not checkable |
Not checkable |
20 Feb 2023 |
There can’t possibly be a way this ends other than me getting things horrendously wrong and looking like an idiot, to be mocked by people…
Not checkable · 20 Feb 2023 |
|
| Not yet due |
Prediction |
20 Feb 2023 |
By 2028 there will be more of a movement to ban or restrict AI.
Prediction · 20 Feb 2023 |
AI policy and governance |
| Not researched |
Factual |
20 Feb 2023 |
The tenth anniversary of Scott Alexander's old blog was in the week before 20 February 2023.
Factual · 20 Feb 2023 |
Their own work or organisation |
| Not checkable |
Not checkable |
20 Feb 2023 |
Ron DeSantis seems personally successful and good at inciting culture war panics, but I don’t think there is a “DeSantis-ism” that offers a…
Not checkable · 20 Feb 2023 |
|
| Not yet due |
Prediction |
20 Feb 2023 |
Ukraine and Russia will reach an unsatisfying stalemate before 2028, followed by massive growth in Ukraine.
Prediction · 20 Feb 2023 |
Other |
| Unresolvable |
Factual |
20 Feb 2023 |
As far as he could tell, writing in February 2023, none of the space tourism developments he had discussed had worked out, and the field seemed stuck in the same limbo as for the past decade and a half.
Factual · 20 Feb 2023 |
Technology |
| Not yet due |
Prediction |
20 Feb 2023 |
He gave a 60% probability that by 2028 AI would be a smaller political issue than abortion, with 20% each for bigger and equal.
Prediction · 20 Feb 2023 |
AI policy and governance |
| Resolved true |
Factual |
20 Feb 2023 |
In 2018 Scott Alexander partly abandoned his usual clear-resolution probabilistic predictions for rough guesses in his five-year predictions.
Factual · 20 Feb 2023 |
Their own work or organisation |
| Not checkable |
Not checkable |
20 Feb 2023 |
Instead it did just what I predicted.
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
20 Feb 2023 |
I don’t think my country predictions were especially good or bad, except that Russia and the UK have indeed been having a hard time.
Not checkable · 20 Feb 2023 |
|
| Unresolvable |
Prediction |
20 Feb 2023 |
AI will take a long time to conquer fields like biology that involve loops with the physical world.
Prediction · 20 Feb 2023 |
AI capabilities |
| Not checkable |
Not checkable |
20 Feb 2023 |
I’m not sure I had enough information to go higher than that, but it sure is embarrassing.
Not checkable · 20 Feb 2023 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
One possibility is that, by a crazy coincidence, every day some new independent event happened that thwarted Russia and made Ukraine’s…
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
Numbers 1 and 7 are impressive changes!
Not checkable · 14 Mar 2022 |
|
| Not researched |
Citation |
14 Mar 2022 |
Eyeballing the results of the reviewed studies, Scott Alexander said it looks like forecasters often did a bit better than experts, but with lots of caveats and possible exculpatory factors.
Citation · 14 Mar 2022 |
Science and research methods |
| Not checkable |
Not checkable |
14 Mar 2022 |
In efficient markets, there should never be predictable patterns!
Not checkable · 14 Mar 2022 |
|
| Unresolvable |
Factual |
14 Mar 2022 |
Scott Alexander said that in February 2022 he had discussed problems with the Metaculus leaderboard.
Factual · 14 Mar 2022 |
Their own work or organisation |
| Not checkable |
Not checkable |
14 Mar 2022 |
If the point of forecasting tournaments is to figure out who you can trust, the science has spoken, and the answer is “these guys”.
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
I’d go with the forecasters in a situation like this - but again, the studies are too weak to be sure!
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
A fourth possibility is that forecasters biased towards updating too much.
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
Ukrainian propaganda is so good that every extra day you’re exposed to it, you become more and more convinced that Ukraine is winning.
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
Sometimes the results seemed a little silly
Not checkable · 14 Mar 2022 |
|
| Resolved true |
Factual |
14 Mar 2022 |
In February 2022 Scott Alexander suggested that Manifold Markets add a loan feature to boost investment in long-term markets.
Factual · 14 Mar 2022 |
Their own work or organisation |
| Not checkable |
Not checkable |
14 Mar 2022 |
I’m not math-y enough to figure out whether this is a proper scoring rule or not, but it sure does sound unnecessarily complicated.
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
Also, keep in mind that in real life almost no one ever tries to aggregate experts in any meaningful way.
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
which is pretty good - although I think different kinds of questions give different average amounts of points so it’s still not perfect.
Not checkable · 14 Mar 2022 |
|
| Mostly true |
Factual |
14 Mar 2022 |
The probability shown in the chart in the post was almost monotonically decreasing, lower each day than the day before.
Factual · 14 Mar 2022 |
Other global risks |
| Not researched |
Citation |
14 Mar 2022 |
A review of thirteen other studies in a variety of domains, comparing forecasters and experts, showed no clear overall picture.
Citation · 14 Mar 2022 |
Science and research methods |
| Not checkable |
Not checkable |
14 Mar 2022 |
A perfect Bayesian, seeing the failures of the Russian advance over the first few days, would have immediately updated to something like…
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
A third possibility is that forecasters are biased against updating.
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
decentralization is great, but for me it cashes out in “ease of use”
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
Everyone always tells the story of how Tetlock’s superforecasters beat CIA experts.
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
The whole stack of technologies came together: tournaments to determine who the best predictors are, methods for aggregating probabilities…
Not checkable · 14 Mar 2022 |
|
| Not researched |
Factual |
14 Mar 2022 |
Scott Alexander is testing Manifold Markets as a knowledge-generation device, using a market on how he will rank interventions in an updated Biodeterminists' Guide To Pregnancy.
Factual · 14 Mar 2022 |
Their own work or organisation |
| Not checkable |
Not checkable |
14 Mar 2022 |
I agree that, because of those second order effects, decentralization is crucial and needs to be pursued more, and I agree that it’s a…
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
Twenty dice rolls in a row came up natural 20s for Ukraine. Seems unlikely.
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
I’m having trouble figuring out of if this makes sense.
Not checkable · 14 Mar 2022 |
|
| Not researched |
Citation |
14 Mar 2022 |
In the same study, the average forecaster did notably worse than the intelligence community.
Citation · 14 Mar 2022 |
Science and research methods |
| Not checkable |
Not checkable |
14 Mar 2022 |
Along with reassuring me I made the right choice not to run and hide, this is a new landmark in translating forecasting results to the real…
Not checkable · 14 Mar 2022 |
|
| Unresolvable |
Factual |
14 Mar 2022 |
Scott Alexander said that, if he understood it right, in the study the average forecaster did worse than the average expert, but Tetlock used clever aggregation methods for his superforecasters while the CIA did not use such methods for its experts.
Factual · 14 Mar 2022 |
Science and research methods |
| Not checkable |
Not checkable |
14 Mar 2022 |
I imagine everyone involved will be multimillionaires within a week.
Not checkable · 14 Mar 2022 |
|
| Not checkable |
Not checkable |
14 Mar 2022 |
So, kind of weak conclusion, but you can probably believe some vague thing like “forecasters seem around as good as experts in some cases”.
Not checkable · 14 Mar 2022 |
|
| Resolved true |
Factual |
14 Mar 2022 |
A team described as some of the best superforecasters in the world won the CSET-Foretell forecasting competition by a large margin, described as around twice as good as the next-best team in relative Brier score.
Factual · 14 Mar 2022 |
Science and research methods |
| Mostly true |
Factual |
14 Mar 2022 |
Early in the Russia-Ukraine war prediction markets gave Ukraine poor odds, and by March 2022 they were much more optimistic about Ukraine.
Factual · 14 Mar 2022 |
Other global risks |
| Not checkable |
Not checkable |
14 Feb 2021 |
I don’t want to accuse the New York Times of lying about me, exactly
Not checkable · 14 Feb 2021 |
|
| Not checkable |
Not checkable |
14 Feb 2021 |
I will probably miss tomorrow’s Open Thread in the interests of keeping this on the top of the blog.
Not checkable · 14 Feb 2021 |
|
| Unresolvable |
Factual |
14 Feb 2021 |
The NYT journalist has not known about Slate Star Codex for three years, so he read the edited version of the Voldemort post that told people not to take it out of context.
Factual · 14 Feb 2021 |
Their own work or organisation |
| Mixed |
Factual |
14 Feb 2021 |
The NYT's original pitch was interest in how Scott Alexander warned early about the coronavirus pandemic and urged mask-wearing before it was standard advice.
Factual · 14 Feb 2021 |
Their own work or organisation |
| Not checkable |
Not checkable |
14 Feb 2021 |
I suspect he did not personally want to write this and was pressured into it as part of the Times’ retaliatory measures against me.
Not checkable · 14 Feb 2021 |
|
| Unresolvable |
Prediction |
14 Feb 2021 |
Far more people will read the NYT article than will read Scott Alexander's response, so the NYT's plan will probably work.
Prediction · 14 Feb 2021 |
Their own work or organisation |
| Not checkable |
Not checkable |
14 Feb 2021 |
I continue to believe these studies are true
Not checkable · 14 Feb 2021 |
|
| Unresolvable |
Factual |
14 Feb 2021 |
Scott Alexander's Contra Grant post states "My research suggests no average gender difference in ability".
Factual · 14 Feb 2021 |
Their own work or organisation |
| Mostly true |
Factual |
14 Feb 2021 |
Scott Alexander said the NYT's characterisation was true only insofar as he once expressed agreement with an unrelated Charles Murray position: that telling poor people to learn to code is insufficient and a stable income is needed.
Factual · 14 Feb 2021 |
Their own work or organisation |
| Unresolvable |
Factual |
14 Feb 2021 |
Scott Alexander received support from Steven Pinker, Larry Sanger, Jonathan Haidt, Liv Boeree and Yascha Mounk.
Factual · 14 Feb 2021 |
Their own work or organisation |
| Not checkable |
Not checkable |
14 Feb 2021 |
His solution is a basic income guarantee, and I guess that’s mine too.
Not checkable · 14 Feb 2021 |
|
| Not researched |
Factual |
14 Feb 2021 |
After taking safety steps, Scott Alexander resumed blogging under his real name to avoid the ongoing threat of doxxing.
Factual · 14 Feb 2021 |
Their own work or organisation |
| Not checkable |
Not checkable |
14 Feb 2021 |
I didn’t want to spend the rest of my life in hiding
Not checkable · 14 Feb 2021 |
|
| Not checkable |
Not checkable |
14 Feb 2021 |
I think patients having too personal a relationship with their psychiatrist interferes with care.
Not checkable · 14 Feb 2021 |
|
| Not checkable |
Not checkable |
14 Feb 2021 |
I am writing this as a necessary ritual to avoid silence being taken as evidence of guilt.
Not checkable · 14 Feb 2021 |
|
| Own records only |
Factual |
14 Feb 2021 |
Scott Alexander was warned by people "in the know" that the NYT would publish something as negative as possible about him once it had an excuse.
Factual · 14 Feb 2021 |
Their own work or organisation |
| Mixed |
Factual |
14 Feb 2021 |
In early 2020, Scott Alexander learned the New York Times wanted to write an article about him.
Factual · 14 Feb 2021 |
Their own work or organisation |
| Not checkable |
Not checkable |
14 Feb 2021 |
I believe they misrepresented me as retaliation for my publicly objecting to their policy of doxxing bloggers in a way that threatens their…
Not checkable · 14 Feb 2021 |
|
| Mixed |
Factual |
14 Feb 2021 |
Scott Alexander wrote a 30,000-word condemnation of one of the right-wing figures named in the article on his blog a few years ago.
Factual · 14 Feb 2021 |
Their own work or organisation |
| Not checkable |
Not checkable |
14 Feb 2021 |
I deny this claim.
Not checkable · 14 Feb 2021 |
|
| Not researched |
Factual |
14 Feb 2021 |
Scott Alexander has 1,557 other posts the journalist could have used.
Factual · 14 Feb 2021 |
Their own work or organisation |
| Not researched |
Factual |
14 Feb 2021 |
Scott Alexander wrote his blog under his first and middle names, omitting his last name, to stay anonymous.
Factual · 14 Feb 2021 |
Their own work or organisation |
| Own records only |
Factual |
14 Feb 2021 |
Scott Alexander met Peter Thiel once at a party, long before Trump was in the news, and exchanged about two sentences with him.
Factual · 14 Feb 2021 |
Their own work or organisation |
| Not researched |
Factual |
14 Feb 2021 |
There is no evidence that women are inherently less intelligent or worse at math than men.
Factual · 14 Feb 2021 |
Philosophy, ethics and society |
| Not researched |
Factual |
14 Feb 2021 |
Scott Alexander has repeatedly blogged about studies suggesting women are underrepresented in tech because they lose interest early, by high school, not because of explicit discrimination by tech companies.
Factual · 14 Feb 2021 |
Philosophy, ethics and society |