ClaimsScott Alexander

“At the beginning of every year, I make predictions. At the end of every year, I score them.”

Scott Alexander, blogger 31 December 2016 2016 Predictions: Calibration Results (Slate Star Codex) archived copy

Factual Their own work or organisation

Scott Alexander makes predictions at the start of every year and scores them at the end of every year.

Unresolvable The public record could not settle it.

Factual: Statements about the present or the past, checked against the record: did they hold up?

The second judge would not resolve this claim; the verdict shown is the first judge's.

The evidence is the person's or their organisation's own records.

What would count as true or false

This is judged as of 31 Dec 2016. TRUE if, for every year from the start of his practice through 2016, Scott Alexander published a set of predictions at or near the start of the year and a scoring of them at or near the end of the year (or very early the next year). MOSTLY TRUE if the practice was annual but some predictions or scorings were published weeks late (for example predictions in February or scorings in January), or one early year was not fully scored. MOSTLY FALSE if the practice was irregular, with several years missing either predictions or scorings. FALSE if he did not have such a yearly practice.

Set before the research began.

Evidence (2)

  1. E1 (Late) Predictions for 2015 Slate Star Codex (Scott Alexander's blog) · 13 June 2015 Own record

    “Everything went according to plan last year – last January I made predictions for 2014 and then this January I scored them.”
  2. E2 (Late) Predictions for 2015 Slate Star Codex (Scott Alexander's blog) · 13 June 2015 Own record

    “So now that it’s June and predicting what will happen in 2015 is about 40% easier, I might as well get started.”

Reasoning

The evidence shows that 2014 was predicted in January and scored the next January [E2], and that the 2015 predictions were published in June [E3]. It does not cover the 2015 scoring or the 2016 predictions and scoring, so it cannot settle the claim under the criteria, which require every year through 2016.

Cite this claim

Scott Alexander, “Scott Alexander makes predictions at the start of every year and scores them at the end of every year.” (said 31 December 2016). Verdict: unresolvable. Reliability API, claim c_bedc1504fe64, method 0.1.0+8bea457b, dataset release v1.1.2. https://epistacklabs.com/claims/c_bedc1504fe64

This claim is in dataset release v1.1.2, with the same verdict.

Reply to this claim

For Scott Alexander, or someone speaking for them: a correction or counter-evidence. Replies are read before anything is shown; an approved reply shows your name, role, date, statement and link. Your email address is never shown and is deleted 30 days after the decision (privacy).

More factual claims by Scott Alexander

  1. Mostly true Factual 5 October 2026
    “Reader Nikita Sokolsky has completed his work getting some extra Fatima documents from Portugal and translating them into English.”

    Reader Nikita Sokolsky has finished obtaining extra Fatima documents from Portugal and translating them into English.

  2. Resolved true Factual 5 October 2026
    “Rob Ennals, who made this year’s book review contest site, has gathered the reviews from earlier years into epubs here.”

    Rob Ennals, who made this year's ACX book review contest site, has gathered reviews from earlier years into epubs.

  3. Resolved true Factual 10 December 2024
    “There’s a good interview with Skarbek in last month’s issue of Asterisk, I think it will be online shortly.”

    Last month's issue of Asterisk (November 2024) contains an interview with Skarbek, which Scott thinks will be online shortly.

  4. Resolved true Factual 20 February 2023
    “Things felt so fuzzy that I (partly) abandoned my usual clear-resolution probabilistic predictions for total guesses.”

    In 2018 Scott Alexander partly abandoned his usual clear-resolution probabilistic predictions for rough guesses in his five-year predictions.

  5. Resolved true Factual 14 March 2022
    “Also last month, I suggested Manifold Markets have a loan feature to help boost investment in long-term markets.”

    In February 2022 Scott Alexander suggested that Manifold Markets add a loan feature to boost investment in long-term markets.

All of them

Verdicts are made automatically; how verdicts are made.