Low Complexity, Low Probability Patterns and Consequences for Algorithmic Probability Applications
Developing new ways to estimate probabilities can be valuable for science, statistics, engineering, and other fields. By considering the information content of different output patterns, recent work invoking algorithmic information theory inspired arguments has shown that a priori probability predic...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2023-01-01
|
| Series: | Complexity |
| Online Access: | http://dx.doi.org/10.1155/2023/9696075 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832556656431464448 |
|---|---|
| author | Mohammad Alaskandarani Kamaludin Dingle |
| author_facet | Mohammad Alaskandarani Kamaludin Dingle |
| author_sort | Mohammad Alaskandarani |
| collection | DOAJ |
| description | Developing new ways to estimate probabilities can be valuable for science, statistics, engineering, and other fields. By considering the information content of different output patterns, recent work invoking algorithmic information theory inspired arguments has shown that a priori probability predictions based on pattern complexities can be made in a broad class of input-output maps. These algorithmic probability predictions do not depend on a detailed knowledge of how output patterns were produced, or historical statistical data. Although quantitatively fairly accurate, a main weakness of these predictions is that they are given as an upper bound on the probability of a pattern, but many low complexity, low probability patterns occur, for which the upper bound has little predictive value. Here, we study this low complexity, low probability phenomenon by looking at example maps, namely a finite state transducer, natural time series data, RNA molecule structures, and polynomial curves. Some mechanisms causing low complexity, low probability behaviour are identified, and we argue this behaviour should be assumed as a default in the real-world algorithmic probability studies. Additionally, we examine some applications of algorithmic probability and discuss some implications of low complexity, low probability patterns for several research areas including simplicity in physics and biology, a priori probability predictions, Solomonoff induction and Occam’s razor, machine learning, and password guessing. |
| format | Article |
| id | doaj-art-07883147fc1e448fa69720a895e521e5 |
| institution | Kabale University |
| issn | 1099-0526 |
| language | English |
| publishDate | 2023-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Complexity |
| spelling | doaj-art-07883147fc1e448fa69720a895e521e52025-02-03T05:44:35ZengWileyComplexity1099-05262023-01-01202310.1155/2023/9696075Low Complexity, Low Probability Patterns and Consequences for Algorithmic Probability ApplicationsMohammad Alaskandarani0Kamaludin Dingle1Centre for Applied Mathematics and Bioinformatics (CAMB)Centre for Applied Mathematics and Bioinformatics (CAMB)Developing new ways to estimate probabilities can be valuable for science, statistics, engineering, and other fields. By considering the information content of different output patterns, recent work invoking algorithmic information theory inspired arguments has shown that a priori probability predictions based on pattern complexities can be made in a broad class of input-output maps. These algorithmic probability predictions do not depend on a detailed knowledge of how output patterns were produced, or historical statistical data. Although quantitatively fairly accurate, a main weakness of these predictions is that they are given as an upper bound on the probability of a pattern, but many low complexity, low probability patterns occur, for which the upper bound has little predictive value. Here, we study this low complexity, low probability phenomenon by looking at example maps, namely a finite state transducer, natural time series data, RNA molecule structures, and polynomial curves. Some mechanisms causing low complexity, low probability behaviour are identified, and we argue this behaviour should be assumed as a default in the real-world algorithmic probability studies. Additionally, we examine some applications of algorithmic probability and discuss some implications of low complexity, low probability patterns for several research areas including simplicity in physics and biology, a priori probability predictions, Solomonoff induction and Occam’s razor, machine learning, and password guessing.http://dx.doi.org/10.1155/2023/9696075 |
| spellingShingle | Mohammad Alaskandarani Kamaludin Dingle Low Complexity, Low Probability Patterns and Consequences for Algorithmic Probability Applications Complexity |
| title | Low Complexity, Low Probability Patterns and Consequences for Algorithmic Probability Applications |
| title_full | Low Complexity, Low Probability Patterns and Consequences for Algorithmic Probability Applications |
| title_fullStr | Low Complexity, Low Probability Patterns and Consequences for Algorithmic Probability Applications |
| title_full_unstemmed | Low Complexity, Low Probability Patterns and Consequences for Algorithmic Probability Applications |
| title_short | Low Complexity, Low Probability Patterns and Consequences for Algorithmic Probability Applications |
| title_sort | low complexity low probability patterns and consequences for algorithmic probability applications |
| url | http://dx.doi.org/10.1155/2023/9696075 |
| work_keys_str_mv | AT mohammadalaskandarani lowcomplexitylowprobabilitypatternsandconsequencesforalgorithmicprobabilityapplications AT kamaludindingle lowcomplexitylowprobabilitypatternsandconsequencesforalgorithmicprobabilityapplications |