Scores by kind of claim
Each kind of claim is scored on its own, out of 100: the share that held up, with the range it likely falls in. Fewer resolved claims give a wider range.
-
Factual claims
Statements about the present or the past, checked against the record: did they hold up?
83 77 88 -
Predictions
Statements about events outside the person's control, checked once they fell due: did they come true?
69 49 87 -
Promises
Commitments to the person's or organisation's own future action, with something to deliver: was it delivered?
69 49 87
All types combined: 81 (likely 76 to 86, high confidence), from 87 claims: 77 factual claims, 5 predictions, 5 promises. It mixes kinds of claim in different proportions for different people, so compare people kind by kind.
Sam Altman's claims
41 claims
“We share your concern about bias and safety in language models, and it's a big part of why we're starting off with a beta and have safety review before apps can go live.”
Sam Altman, OpenAI CEO, replying on X 22 July 2020 Post by @sama on X, 2020-07-22 (X)
Altman said that "we" share concerns about bias and safety in language models, and that this is a big part of why "we" are starting off with a beta and have safety review before apps can go live.
Resolved true The record shows it happened or was so.
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
The test is whether Altman made this statement on or around 2020-07-22 (likely a tweet about the GPT-3 API). True: an archived tweet or other record shows him saying that 'we' share concerns about bias and safety in language models, and that this is a big part of why they started with a beta and have safety review before apps can go live. Mostly true: the statement exists with minor wording or date differences. Mixed: only part of the statement can be found, for example the concern about bias but not the beta and safety-review reasoning. Mostly false: the wording found conveys a materially different point. False: the record shows no such statement by Altman, for example the quote comes from someone else.
Evidence
- Tech Tent: Have we seen our AI future? BBC News · 24 July 2020
“We share your concern about bias and safety in language models, and it's a big part of why we're starting off with a beta and have a safety review before apps can go live.”
- As Its GPT-3 Model Wows the World, OpenAI CEO Suggests 'the Hype Is Way Too Much' | Synced Synced · 4 August 2020
“We share your concern about bias and safety in language models, and it’s a big part of why we’re starting off with a beta and have safety review before apps can go live,” adding, “We do not (yet) have a service in production for billions of users”
- GPT-3 (May 2020) Frontier Minds
“On June 11, 2020 it opened a waitlisted commercial API, saying it chose an API over open-sourcing because”
- GPT-3 Generates Hype in Closed Beta Emerging Tech Brew · 20 July 2020
““The GPT-3 hype is way too much,” OpenAI CEO Sam Altman said yesterday.”
Reasoning
Two independent outlets, the BBC (E1, published 2020-07-24) and Synced (E2), attribute this statement to Altman. Synced's wording matches the quote exactly, and the BBC's differs only by an added "a" ("have a safety review"). Neither gives the exact tweet date, but the BBC's 2020-07-24 publication shows the statement was made by then, which is consistent with "on or around 2020-07-22." E4 shows that Altman was commenting publicly on GPT-3 at the time.
Cite this claim
Sam Altman, “Altman said that "we" share concerns about bias and safety in language models, and that this is a big part of why "we" are starting off with a beta and have safety review before apps can go live.” (said 22 July 2020). Verdict: resolved true. Reliability API, claim c_33dfa05555f1, method 0.1.0+c876030c. https://epistacklabs.com/claims/c_33dfa05555f1
Claims without a verdict
Is a verdict here wrong, or do you speak for Sam Altman? Reply on the claim's own page, with the form at its foot (how replies work). Verdicts are made automatically; how verdicts and scores are made.