ALGORITHMIC INCOMPRESSIBILITY 3)5)
← Back
The impossibility to reduce a string of data to a simpler algorithm that would permit to retrieve them.
G. CHAITIN demonstrated that: "A completely random string of digits cannot be reduced to a shorter program at all ". On the contrary: "… a regular string of 1 s and 0s describing some data such as 0101010101… which continues for 1000 digits can be encapsulated in a shorter instruction "repeat 01 500 times" (1990, p.45-46)
Chaitin related this finding to TURING 's uncomputability theorem and showed that: "the halting probability is arithmetically random" (Ibid)
According to CHAITIN, TURING's "… result that the halting probability is random corresponds to TURING's assertion that the halting problem is undecidable"
From another viewpoint, St. KAUFFMAN states: "One measure of the complexity of an algorithm is the minimal program length which yields the desired output. The more minimal an algorithm is, the less redundancy it contains. Consequently, minor modification of minimal programs grossly alter the output of the algorithm. In contrast, minor alterations of highly redundant algorithms modify output only slightly" (1993, p.231). Thus, algorithmic compression may make an algorithm's behavior more uncertain.
Categories
- 1) General information
- 2) Methodology or model
- 3) Epistemology, ontology and semantics
- 4) Human sciences
- 5) Discipline oriented
Publisher
Bertalanffy Center for the Study of Systems Science(2020).
To cite this page, please use the following information:
Bertalanffy Center for the Study of Systems Science (2020). Title of the entry. In Charles François (Ed.), International Encyclopedia of Systems and Cybernetics (2). Retrieved from www.systemspedia.org/[full/url]
We thank the following partners for making the open access of this volume possible: