Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

Symmetries among Multivariate Information Measures Explored Using Möbius Operators

Version 1 : Received: 7 November 2018 / Approved: 9 November 2018 / Online: 9 November 2018 (03:53:27 CET)

A peer-reviewed article of this Preprint also exists.

Galas, D.J.; Sakhanenko, N.A. Symmetries among Multivariate Information Measures Explored Using Möbius Operators. Entropy 2019, 21, 88. Galas, D.J.; Sakhanenko, N.A. Symmetries among Multivariate Information Measures Explored Using Möbius Operators. Entropy 2019, 21, 88.

Journal reference: Entropy 2019, 21, 88
DOI: 10.3390/e21010088


Information-related measures are useful tools for multi-variable data analysis, as measures of dependence among variables, and as descriptions of order and disorder in biological and physical systems. Measures, like marginal entropies, mutual / interaction / multi -information, have long been used in a number of fields including descriptions of systems complexity and biological data analysis. The mathematical relationships among these measures are therefore of significant inherent interest. Relations between common information measures include the duality relations based on Möbius inversion on lattices. These are the direct consequence of the symmetries of the lattices of the sets of variables (subsets ordered by inclusion). While these relationships are of significant interest there has been, to our knowledge, no systematic examination of the full range of relationships of this diverse range of functions into a unifying formalism as we do here. In this paper we define operators on functions on these lattices based on the Möbius inversions that map functions into one another (Möbius operators). We show that these operators form a simple group isomorphic to the symmetric group S3. Relations among the set of functions on the lattice are transparently expressed in terms of the operator algebra, and, applied to the information measures, can be used to derive a wide range of relationships among diverse information measures. The Möbius operator algebra is naturally generalized which yields extensive new relationships. This formalism now provides a fundamental unification of information-related measures, and the isomorphism of all distributive lattices with the subset lattice implies an even broader application of these results.

Subject Areas

information; entropy; interaction-information; multi-information; Möbius inversion; lattices; multivariable dependence; symmetric group; MaxEnt; networks

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our diversity statement.

Leave a public comment
Send a private comment to the author(s)
Views 0
Downloads 0
Comments 0
Metrics 0

Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.