Altman said that "we" share concerns about bias and safety in language models, and that this is a big part of why "we" are starting off with a beta and have safety review before apps can go live.
Resolved true The record shows it happened or was so.
Factual: Statements about the present or the past, checked against the record: did they hold up?
Said for an organisation they lead or work for; it counts on both records.
What would count as true or false
The test is whether Altman made this statement on or around 2020-07-22 (likely a tweet about the GPT-3 API). True: an archived tweet or other record shows him saying that 'we' share concerns about bias and safety in language models, and that this is a big part of why they started with a beta and have safety review before apps can go live. Mostly true: the statement exists with minor wording or date differences. Mixed: only part of the statement can be found, for example the concern about bias but not the beta and safety-review reasoning. Mostly false: the wording found conveys a materially different point. False: the record shows no such statement by Altman, for example the quote comes from someone else.
Set before the research began.
Evidence (4)
-
E1 Tech Tent: Have we seen our AI future? BBC News · 24 July 2020
“We share your concern about bias and safety in language models, and it's a big part of why we're starting off with a beta and have a safety review before apps can go live.”
-
E2 As Its GPT-3 Model Wows the World, OpenAI CEO Suggests 'the Hype Is Way Too Much' | Synced Synced · 4 August 2020
“We share your concern about bias and safety in language models, and it’s a big part of why we’re starting off with a beta and have safety review before apps can go live,” adding, “We do not (yet) have a service in production for billions of users”
-
E3 GPT-3 (May 2020) Frontier Minds
“On June 11, 2020 it opened a waitlisted commercial API, saying it chose an API over open-sourcing because”
-
E4 GPT-3 Generates Hype in Closed Beta Emerging Tech Brew · 20 July 2020
““The GPT-3 hype is way too much,” OpenAI CEO Sam Altman said yesterday.”
Reasoning
Two independent outlets, the BBC (E1, published 2020-07-24) and Synced (E2), attribute this statement to Altman. Synced's wording matches the quote exactly, and the BBC's differs only by an added "a" ("have a safety review"). Neither gives the exact tweet date, but the BBC's 2020-07-24 publication shows the statement was made by then, which is consistent with "on or around 2020-07-22." E4 shows that Altman was commenting publicly on GPT-3 at the time.
Cite this claim
Sam Altman, “Altman said that "we" share concerns about bias and safety in language models, and that this is a big part of why "we" are starting off with a beta and have safety review before apps can go live.” (said 22 July 2020). Verdict: resolved true. Reliability API, claim c_33dfa05555f1, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_33dfa05555f1
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Sam Altman
-
Resolved true
“And right now, we don’t have that.”
-
Mostly true
“The very end of 2015, we announced it, and then the first day of work was like January of 2016.”
-
Mostly true
“not until 2020 did we train GPT-3, which was the first model that I think actually was over some threshold of usability.”
OpenAI trained GPT-3 in 2020, which Altman considers the first model above a threshold of usability.
-
Mostly true
“Absolutely. To go back to the analogy of electricity, there’s this amazing chart of what it cost to have an hour of light at night.”
-
Resolved true
“that it is so capable that it is discovering new knowledge, doing science, able to add huge economic value, create entire pieces of complex software.”
Verdicts are made automatically; how verdicts are made.