There is progress in software, though its doubling factor is much slower than hardware's.
Mostly true True in substance, wrong in a detail.
Factual: Statements about the present or the past, checked against the record: did they hold up?
The second judge would not resolve this claim; the verdict shown is the first judge's.
What would count as true or false
Judge as of December 2002. The claim has two parts: (a) software is making progress; (b) its rate of improvement ('doubling factor') is much slower than that of hardware. True: evidence available around 2002 (studies of software productivity, algorithm performance or software capability) shows real software progress at a pace clearly slower than hardware's roughly 1–2-year doubling. Mostly true: both parts broadly hold, but some well-documented domains show software progress matching hardware. Mixed: the evidence is split, with substantial domains (for example linear programming or other algorithm benchmarks) showing algorithmic gains equal to or greater than hardware gains alongside others showing slower progress. Mostly false: software is progressing, but the best evidence shows its improvement generally comparable to or faster than hardware's. False: the evidence shows no meaningful software progress, or software progress clearly and generally faster than hardware's.
Set before the research began.
Evidence (5)
-
E1 Wirth's law Wikipedia · 21 July 2005
“or, colloquially, "software gets slower faster than hardware gets faster".”
-
E2 Wirth's law Wikipedia · 21 July 2005
“It is a humorous and ironic observation that the speed of commercial software generally slows by 50% every 18 months, thereby negating all the benefits of Moore's law.”
-
E3 The Realities of Software Technology Payoffs cacm.acm.org (Communications of the ACM) · 31 August 2023
“Yet there is little evidence of dramatic change in either the productivity of software developers, or the quality of the products they produce.”
-
E4 The Realities of Software Technology Payoffs cacm.acm.org (Communications of the ACM) · 31 August 2023
“A recent study by Ed Yourdon and Howard Rubin reports, in fact, a 13% decline in productivity in recent years, and a quality increase of a substantial (but not dramatic) 75% for the 12 years since 1985.”
-
E5 The Realities of Software Technology Payoffs cacm.acm.org (Communications of the ACM) · 31 August 2023
“Those bits of light suggest to us that most improvements to the software process offer modest advantages over traditional alternatives.”
Reasoning
The Communications of the ACM article cites a Yourdon/Rubin study that found a 13% decline in productivity in recent years and a 75% rise in software quality over the 12 years since 1985 [E4]. It also reports little sign of dramatic change in developer productivity [E3] and says most process improvements bring only modest gains [E5]. That is real but slow software progress, well below the hardware doubling every one to two years set out in the criteria. The same study reports a productivity decline [E4], the Wirth's law items are informal sayings, not measurements [E1, E2], and none of the evidence directly compares software and hardware improvement rates.
Cite this claim
Ray Kurzweil, “There is progress in software, though its doubling factor is much slower than hardware's.” (said 12 December 2002). Verdict: mostly true. Reliability API, claim c_88f332036e2c, method 0.1.0+28da144b, dataset release v1.1.2. https://epistacklabs.com/claims/c_88f332036e2c
This claim is in dataset release v1.1.2, with the same verdict.
Reply to this claim
More factual claims by Ray Kurzweil
-
Mostly false
“That was not true a year ago. But that’s true today.”
-
Mixed
“AI hallucinations are still there, but are becoming much less frequent.”
AI hallucinations persist but are becoming much less frequent.
-
Mostly true
“And it’s going very, very quickly — at an exponential rate”
AI progress is advancing very quickly, at an exponential rate.
-
Mostly true
“It was not quite as good, but you could recognize it as Mozart or as Chopin.”
-
Mostly true
“Yes, it was very much for AI.”
The prizes received by Geoffrey Hinton and by Demis Hassabis and John Jumper were very much for AI.
Verdicts are made automatically; how verdicts are made.