Occam's Razor: From Ockham's via Moderna to Modern Data Science. (September 2018)

• Record Type: Journal Article
• Authors: Van Den Berg, Hugo A.
• Is Part Of: Science progress. Volume 101:Number 3(2018)
• Page Start: 261
• Page End: 272
• Publication Date: 2018-09
• Subjects: Occam's razor -- William of Ockham -- principle of parsimony -- large deviations -- Kolmogorov complexity -- Bayesian inference; Science -- Periodicals; Research; Science; Science; Electronic journals; Periodicals; Periodicals; 505
• DOI: 10.3184/003685018X15295002645082
• Languages: English
• ISSNs: 0036-8504

Abstract

The principle of parsimony, also known as 'Occam's razor', is a heuristic dictum that is thoroughly familiar to virtually all practitioners of science: Aristotle, Newton, and many others have enunciated it in some form or other. Even though the principle is not difficult to comprehend as a general heuristic guideline, it has proved surprisingly resistant to being put on a rigorous footing – a difficulty that has become more pressing and topical with the 'big data' explosion. We review the significance of Occam's razor in the philosophical and theological writings of William of Ockham, and survey modern developments of parsimony in data science.