Scott Alexander said that in February 2022 he had discussed problems with the Metaculus leaderboard.
Unresolvable The public record could not settle it.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
The evidence is the person's or their organisation's own records.
What would count as true or false
Judge as of 2022-03-14. True: an Astral Codex Ten Mantic Monday post dated February 2022 discusses problems with the Metaculus leaderboard. Mostly true: the discussion appeared in an ACX post from roughly that time (e.g. a non-Mantic-Monday post in February, or very early March) instead. Mixed: the leaderboard was mentioned only briefly, without discussing problems. Mostly false: the discussion took place, but in a clearly different month, or the problems discussed were with a different platform's leaderboard. False: no such ACX discussion took place in February 2022.
Set before the research began.
Evidence (2)
-
E1 Play Money And Reputation Systems Astral Codex Ten · 21 February 2022 Own record
“Metaculus addresses this issue by . . . totally failing to address this issue and just accepting the consequences.”
-
E2 Play Money And Reputation Systems Astral Codex Ten · 21 February 2022 Own record
“But it turns a lot of people off from them.”
Reasoning
The evidence shows a February 2022 Astral Codex Ten post criticising how Metaculus handles an unspecified issue [E1]. Neither quoted passage mentions the Metaculus leaderboard or problems with it [E1][E2], so the evidence does not settle whether the post discussed leaderboard problems.
Cite this claim
Scott Alexander, “Scott Alexander said that in February 2022 he had discussed problems with the Metaculus leaderboard.” (said 14 March 2022). Verdict: unresolvable. Reliability API, claim c_2db8a97cc742, method 0.1.0+8bea457b, dataset release v1.1.2. https://epistacklabs.com/claims/c_2db8a97cc742
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Scott Alexander
-
Mostly true
“Reader Nikita Sokolsky has completed his work getting some extra Fatima documents from Portugal and translating them into English.”
-
Resolved true
“Rob Ennals, who made this year’s book review contest site, has gathered the reviews from earlier years into epubs here.”
-
Resolved true
“There’s a good interview with Skarbek in last month’s issue of Asterisk, I think it will be online shortly.”
-
Resolved true
“Things felt so fuzzy that I (partly) abandoned my usual clear-resolution probabilistic predictions for total guesses.”
-
Resolved true
“Also last month, I suggested Manifold Markets have a loan feature to help boost investment in long-term markets.”
Verdicts are made automatically; how verdicts are made.