Article
Version 1
Preserved in Portico This version is not peer-reviewed
A Measure of Information Available for Prediction
Version 1
: Received: 2 November 2017 / Approved: 2 November 2017 / Online: 2 November 2017 (15:14:40 CET)
Version 2 : Received: 11 May 2018 / Approved: 11 May 2018 / Online: 11 May 2018 (06:24:06 CEST)
Version 2 : Received: 11 May 2018 / Approved: 11 May 2018 / Online: 11 May 2018 (06:24:06 CEST)
How to cite: Isomura, T. A Measure of Information Available for Prediction. Preprints 2017, 2017110020. https://doi.org/10.20944/preprints201711.0020.v1 Isomura, T. A Measure of Information Available for Prediction. Preprints 2017, 2017110020. https://doi.org/10.20944/preprints201711.0020.v1
Abstract
Mutual information between the brain state and the external world state represents the amount of information stored in the brain that is associated with the external world. On the other hand, surprise of sensory input indicates the unpredictability of the current input. In other words, this is a measure of prediction capability, and an upper bound of surprise is known as free energy. According to the free-energy principle (FEP), the brain continues to minimize free energy to perceive the external world. For animals to survive, prediction capability is considered more important than just memorizing information. In this study, the fact that free energy represents a gap between the amount of information stored in the brain and that available for prediction is established, where the latter will be referred to as predictive information as an analogy with Bialek's predictive information. This concept involves the FEP, the infomax principle, and the predictive information theory, and will be a useful measure to quantify the amount of information available for prediction.
Keywords
the free-energy principle; internal model hypothesis; unconscious inference; infomax principle; predictive information; independent component analysis; principal component analysis
Subject
Computer Science and Mathematics, Information Systems
Copyright: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Comments (0)
We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.
Leave a public commentSend a private comment to the author(s)
* All users must log in before leaving a comment