Experimental recordings of the collective activity of interacting spiking neurons exhibit random behavior and memory effects, thus the stochastic process modeling the spiking activity is expected to show some degree of time irreversibility. We use the thermodynamic formalism to build a framework, in the context of spike train statistics, to quantify the degree of irreversibility of any parametric maximum entropy measure under arbitrary constraints, and provide an explicit formula for the information entropy production of the inferred Markov maximum entropy process. We provide examples to illustrate our results and discuss the importance of time irreversibility for modeling the spike train statistics.

Although most biological processes are characterized by a strong temporal asymmetry, several popular mathematical models neglect this issue. Maximum entropy methods provide a principled way of addressing time irreversibility, which leverages powerful results and ideas from the3literature of non-equilibrium statistical mechanics. This article provides a comprehensive overview of these issues, with a focus in the case of spike train statistics. We provide a detailed account of the5mathematical foundations and work out examples to illustrate the key concepts and results from non-equilibrium statistical mechanics

Despite their obvious differences, biological systems at different scales tend to exhibit common organizational patterns. Unfortunately, these commonalities are usually obscured by the parcelled terminology employed by various scientific sub-disciplines. To explore these commonalities, this papers a comparative study of diverse applications of the maximum entropy principle, ranging from amino acids up to societies. By presenting these studies under a common language, this paper establishes a unified view over seemingly highly heterogeneous biological scenarios.