On the Differential and the Integral Value of Information
A quantitative expression for the value of information within the framework of information theory and of the maximal entropy formulation is discussed. We examine both a local, differential measure and an integral, global measure for the value of the change in information when additional input is pro...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-01-01
|
| Series: | Entropy |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1099-4300/27/1/43 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832588584709783552 |
|---|---|
| author | Raphael D. Levine |
| author_facet | Raphael D. Levine |
| author_sort | Raphael D. Levine |
| collection | DOAJ |
| description | A quantitative expression for the value of information within the framework of information theory and of the maximal entropy formulation is discussed. We examine both a local, differential measure and an integral, global measure for the value of the change in information when additional input is provided. The differential measure is a potential and as such carries a physical dimension. The integral value has the dimension of information. The differential measure can be used, for example, to discuss how the value of information changes with time or with other parameters of the problem. |
| format | Article |
| id | doaj-art-d7fd327782e248d098e4a5950a3c68fe |
| institution | Kabale University |
| issn | 1099-4300 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Entropy |
| spelling | doaj-art-d7fd327782e248d098e4a5950a3c68fe2025-01-24T13:31:47ZengMDPI AGEntropy1099-43002025-01-012714310.3390/e27010043On the Differential and the Integral Value of InformationRaphael D. Levine0Institute of Chemistry, The Hebrew University of Jerusalem, Jerusalem 91904, IsraelA quantitative expression for the value of information within the framework of information theory and of the maximal entropy formulation is discussed. We examine both a local, differential measure and an integral, global measure for the value of the change in information when additional input is provided. The differential measure is a potential and as such carries a physical dimension. The integral value has the dimension of information. The differential measure can be used, for example, to discuss how the value of information changes with time or with other parameters of the problem.https://www.mdpi.com/1099-4300/27/1/43mutual informationLagrange multiplierconstraints on a probability distributioncross correlation of constraints |
| spellingShingle | Raphael D. Levine On the Differential and the Integral Value of Information Entropy mutual information Lagrange multiplier constraints on a probability distribution cross correlation of constraints |
| title | On the Differential and the Integral Value of Information |
| title_full | On the Differential and the Integral Value of Information |
| title_fullStr | On the Differential and the Integral Value of Information |
| title_full_unstemmed | On the Differential and the Integral Value of Information |
| title_short | On the Differential and the Integral Value of Information |
| title_sort | on the differential and the integral value of information |
| topic | mutual information Lagrange multiplier constraints on a probability distribution cross correlation of constraints |
| url | https://www.mdpi.com/1099-4300/27/1/43 |
| work_keys_str_mv | AT raphaeldlevine onthedifferentialandtheintegralvalueofinformation |