Most machine intelligence development involves a fitness function that the program tries to optimize.
Resolved true The record shows it happened or was so.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
Judge as of February 2015. True: standard machine learning practice at that time mostly involved optimising an objective (a loss, reward or fitness function); counting loss and objective functions as 'fitness functions' in the general sense the claim intends. Mostly true: this holds for the great majority of methods, and 'fitness function' is a loose but fair term for the objective. Mixed: a large share of significant machine intelligence approaches at the time did not optimise an explicit objective. Mostly false: optimisation-based methods were a minority of the field. False: the field generally did not involve optimising any objective function.
Set before the research began.
Evidence (3)
-
E1 Deep learning Nature (review by Yann LeCun, Yoshua Bengio & Geoffrey Hinton) · 28 May 2015
“We compute an objective function that measures the error (or distance) between the output scores and the desired pattern of scores. The machine then modifies its internal adjustable parameters to reduce this error.”
-
E2 RLtut.key NIPS 2015 tutorial slides (Sutton and colleagues; lecture slides credit David Silver 2015) · 2015
“Seeking to maximize its cumulative reward in the long run”
-
E3 pypop/docs/sphinx/source/user-guide.rst at main · Evolutionary-Intelligence/pypop GitHub (Evolutionary-Intelligence/pypop open-source library documentation) · 26 January 2021
“First, an *objective function* (also called *fitness function* in evolutionary computation or *loss function* in machine learning) needs to be defined in the function form.”
Reasoning
The 2015 Nature review of deep learning (E1) describes the standard method: a system computes an objective function measuring error and adjusts its parameters to reduce it. The 2015 NIPS reinforcement learning tutorial (E2) describes agents maximising cumulative reward. E3 says objective, fitness and loss functions are names for the same thing across fields, which supports the general sense the criteria accept. Taken together, these independent sources show that optimising an objective was standard practice in the main machine learning approaches around the time of the claim.
Cite this claim
Sam Altman, “Most machine intelligence development involves a fitness function that the program tries to optimize.” (said February 2015). Verdict: resolved true. Reliability API, claim c_a022a45cf9ab, method 0.1.0+c876030c, dataset release v1.1.2. https://epistacklabs.com/claims/c_a022a45cf9ab
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Sam Altman
-
Mostly true
“not until 2020 did we train GPT-3, which was the first model that I think actually was over some threshold of usability.”
OpenAI trained GPT-3 in 2020, which Altman considers the first model above a threshold of usability.
-
Resolved true
“that it is so capable that it is discovering new knowledge, doing science, able to add huge economic value, create entire pieces of complex software.”
-
Mixed
“They now hallucinate a little bit.”
-
Mixed
“They don’t do anything unless you ask, right?”
AI models such as ChatGPT do not do anything unless a user asks them to.
-
Mostly true
“But in terms of figuring out what questions to ask or to work on something over a very long period of time, we are definitely not close to human performance.”
Verdicts are made automatically; how verdicts are made.