In this paper, we will revisit the derivation of Heisenberg's uncertainty principle. We will see how the Heisenberg principle collapses at the Planck scale by introducing a minor modification. The beauty of our suggested modification is that it does not change the main equations in quantum mechanics; it only gives them a Planck scale limit where uncertainty collapses. We suspect that Einstein could have been right after all, when he stated, ``God does not throw dice." His now-famous saying was an expression of his skepticism towards the concept that quantum randomness could be the ruling force, even at the deepest levels of reality. Here we will explore the quantum realm with a fresh perspective, by re-deriving the Heisenberg principle in relation to the Planck scale. We will show how this idea also leads to an upper boundary on uncertainty, in addition to the lower boundary. These upper and lower boundaries are identical for the Planck mass particle; in fact, they are zero, and this highlights the truly unique nature of the Planck mass particle. Further, there may be a close connection between light and the Planck mass particle: In our model, the standard relativistic energy momentum relation also seems to apply to light, while in modern physics light generally stands outside the standard relativistic momentum energy relation. We will also suggest a new way to look at elementary particles, where mass and time are closely related, consistent with some of the recent work in experimental physics. Our model leads to a new time operator that does not appear to be in conflict with the Pauli objection. This indicates that both mass and momentum come in quanta, which are perfectly correlated to an internal Compton `clock' frequency in elementary particles.

Modulation of the amplitude of high-frequency cortical field activity locked to changes in phase of a slower brain rhythm is known as phase-amplitude coupling (PAC). The study of this phenomenon has been gaining traction in neuroscience because of several reports on its appearance in normal and pathological brain processes in humans as well as across different mammalian species. This has led to the suggestion that PAC may be an intrinsic brain process that facilitates brain inter-area communication across different spatiotemporal scales. Several methods have been proposed to measure the PAC process, but few of these enable detailed study of its time course. It appears that no studies have reported details of PAC dynamics including its possible directional delay characteristics. Here, we study and characterize the use of a novel information theoretic measure that may address this limitation: local transfer entropy. We use both simulated and actual intracranial electroencephalographic data, and in both cases we observe initial indications that local transfer entropy can be used to detect the onset and offset of modulation process periods revealed by mutual information phase-amplitude coupling (MIPAC). We review our results in the context of current theories about PAC in brain electrical activity, and discuss technical issues that must be addressed to see local transfer entropy more widely applied to PAC analysis.

The relationship of the animal with its environment has been of longstanding interest in philosophy and science. Here I provide a brief introduction to concepts that place an emphasis on mutualism as the basis of organism - environment interaction, in contrast to the long standing view that the environment exerts an instrumental role in shaping the organism. Two influential theories have been von Uexküll’s theory of umwelt and Gibson’s theory of affordances. The former envisioned the animal as immersed in its surroundings (umwelt) to form a functional unit. In a similar manner, the latter theory describes a unity between 1) environmental information that provides the animal with opportunities for action (affordances) and 2) the ability of the animal to perceive and engage with those affordances. These views have influenced more recent ecological models of the organism as the functional unit of biology and have also influenced models of immune function. In ecological models, agency is seen as the ability of the organism to predict and control its engagement with the environment in order to maintain its integrity. The predominant contemporary model of neural function in which perception and action are understood to operate through Bayes-like active inference complements the concept of agency as proposed by the mutualism models. However, it is suggested that rather than a constant mutualism, encounters between organism and environment range over a dynamic spectrum from dualism to mutualism. It is also suggested that along this spectrum, agency emerges when the balance of instrumentality shifts from the environment to the organism, and that the balance of this relationship can further progress towards a felicitous mutualism. Meaning emerges between environmental information and an agent as opportunity for action. Implications for opportunities to foster agency in animals within our care is noted.

Predicting the outcome of a future game between two National Basketball Association (NBA) teams poses a challenging problem of interest to statistical scientists as well as the general public. In this article, we formalize the problem of predicting the game results as a classification problem and apply the principle of maximum entropy to construct NBA maximum entropy (NBAME) model that fits to discrete statistics for NBA games, and then predict the outcomes of NBA playoffs by the NBAME model. The best NBAME model is able to correctly predict the winning team 74.4 percent of the time as compared to some other machine learning algorithms which is correct 69.3 percent of the time.

We introduce the Symplectic Structure of Information Geometry based on Souriau’s Lie Group Thermodynamics model, with a covariant definition of Gibbs equilibrium via invariances through co-adjoint action of a group on its moment space, defining physical observables like energy, heat, and moment as pure geometrical objects. Using Geometric (Planck) Temperature of Souriau model and Symplectic cocycle notion, the Fisher metric is identified as a Souriau Geometric Heat Capacity. Souriau model is based on affine representation of Lie Group and Lie algebra that we compare with Koszul works on G/K homogeneous space and bijective correspondence between the set of G-invariant flat connections on G/K and the set of affine representations of the Lie algebra of G. In the framework of Lie Group Thermodynamics, an Euler-Poincaré equation is elaborated with respect to thermodynamic variables, and a new variational principal for thermodynamics is built through an invariant Poincaré-Cartan-Souriau integral. The Souriau-Fisher metric is linked to KKS (Kostant-Kirillov-Souriau) 2-form that associates a canonical homogeneous symplectic manifold to the co-adjoint orbits. We apply this model in the framework of Information Geometry for the action of an affine Group for exponentiel families, and provide some illustrations of use cases for multivariate Gaussian densities. Information Geometry is presented in the context of seminal work of Fréchet and his Clairaut-Legendre equation. Souriau model of Statistical Physics is validated as compatible with Balian gauge model of thermodynamics. We recall the precursor work of Casalis on affine group invariance for natural exponential families.

Urban sprawl propelled by rapid population growth leads to the shrinkage of productive agricultural lands and pristine forests in the suburban areas and, in turn, substantially alters ecosystem services. Hence, the quantification of urban sprawl is crucial for effective urban planning, and environmental and ecosystem management. Like many megacities in fast growing developing countries, Chennai, the capital of Tamilnadu and one of the business hubs in India, has experienced extensive urban sprawl triggered by the doubling of total population over the past three decades. We employed the Random Forest (RF) classification on Landsat imageries from 1991, 2003, and 2016, and computed spatial metrics to quantify the extent of urban sprawl within a 10km suburban buffer of Chennai. The rate of urban sprawl was quantified using Renyi’s entropy, and the urban extent was predicted for 2027 using land-use and land-cover change modeling. A 70.35% increase in urban areas was observed for the suburban periphery of Chennai between 1991 and 2016. The Renyi’s entropy value for year 2016 was ≥ 0.9, exhibiting a two-fold rate of urban sprawl. The spatial metrics values indicate that the existing urban areas of Chennai became denser and the suburban agricultural, forests and barren lands were transformed into fragmented urban settlements. The forecasted urban growth for 2027 predicts a conversion of 13670.33ha (16.57 % of the total landscape) of existing forests and agricultural lands into urban areas with an associated increase in the entropy value of 1.7. Our findings are relevant for urban planning and environmental management in Chennai and provide quantitative measures for addressing the social-ecological consequences of urban sprawl and the protection of ecosystem services.

The present work investigates primarily the morphology evolution of the body-centered-cubic (BCC)/B2 phases in AlxNiCoFeCr high-entropy alloys (HEAs) with increasing Al content, which has been neglected so far. There exist two types of microscopic morphologies of BCC and B2 phases in this HEA series: one is the weave-like morphology induced by the spinodal decomposition, and the other is the microstructure of a spherical disordered BCC precipitation on the ordered B2 matrix that appears in HEAs with a much higher Al content. The shape of coherent precipitates is found to be closely related to the lattice misfit between BCC and B2 phases, which is sensitive to Al. The mechanical properties, including the compressive yielding strength and microhardness of the AlxNiCoFeCr HEAs, are also discussed in light of the concept of the valence electron concentration (VEC).

The IoT Internet of Things being a promising technology of the future. It is expected to connect billions of devices. The increased communication number is expected to generate data mountain and the data security can be a threat. The devices in the architecture are fundamentally smaller in size and low powered. In general, classical encryption algorithms are computationally expensive and this due to their complexity and needs numerous rounds for encrypting, basically wasting the constrained energy of the gadgets. Less complex algorithm, though, may compromise the desired integrity. In this paper we apply a lightweight encryption algorithm named as Secure IoT (SIT) to a quantized speech image for Secure IoT. It is a 64-bit block cipher and requires 64-bit key to encrypt the data. This quantized speech image is constructed by first quantizing a speech signal and then splitting the quantized signal into frames. Then each of these frames is transposed for obtaining the different columns of this quantized speech image. Simulations result shows the algorithm provides substantial security in just five encryption rounds.

During the last years some new variants of Permutation entropy have been introduced and applied to EEG analysis, among them a conditional variant and variants using some additional metric information or being based on entropies different from the Shannon entropy. In some situations it is not completely clear what kind of information the new measures and their algorithmic implementations provide. We discuss the new developments and illustrate them for EEG data.

Supervised land-use/land-cover (LULC) classifications are typically conducted using class assignment rules derived from a set of multiclass training samples. Consequently, classification accuracy varies with the training data set and is thus associated with uncertainty. In this study, we propose a bootstrap resampling and reclassification approach that can be applied for assessing not only the uncertainty in classification results of the bootstrap-training data sets, but also the classification uncertainty of individual pixels in the study area. Two measures of pixel-specific classification uncertainty, namely the maximum class probability and Shannon entropy, were derived from the class probability vector of individual pixels and used for the identification of unclassified pixels. Unclassified pixels that are identified using the traditional chi-square threshold technique represent outliers of individual LULC classes, but they are not necessarily associated with higher classification uncertainty. By contrast, unclassified pixels identified using the equal-likelihood technique are associated with higher classification uncertainty and they mostly occur on or near the borders of different land-cover.

The philosophy of testing statistical hypothesis is a natural consequence and functional extension of mathematical analysis of Probability. Along with the concept of recurrence when applied to random sequences and functions, it leads to the analysis of a priori and posterior which implies testing statistical hypothesis. Testing statistical hypothesis also involves algebraic, functional and dimensional considerations, which are found in the works of Laplace. Aspects of mathematical analysis such as universality of solutions, Laws of Large Numbers, Entropy, Information, and various functional dependencies are the main factors explained in the five properties that lead to implication of testing statistical hypothesis. Various interesting examples with modern scientific significance from genetics, astrophysics, and other areas give methodological access to answers of different problems and phenomena which are involved in the logic of testing statistical hypothesis.

This paper proposes that intelligent processes can be completely explained by thermodynamic principles. They can equally be described by information-theoretic principles that, from the standpoint of the required optimizations, are functionally equivalent. The underlying theory arises from two axioms regarding distinguishability and causality. Their consequence is a theory of computation that applies to the only two kinds of physical processes possible—those that reconstruct the past and those that control the future. Dissipative physical processes fall into the first class, whereas intelligent ones comprise the second. The first kind of process is exothermic and the latter is endothermic. Similarly, the first process dumps entropy and energy to its environment, whereas the second reduces entropy while requiring energy to operate. It is shown that high intelligence efficiency and high energy efficiency are synonymous. The theory suggests the usefulness of developing a new computing paradigm called Thermodynamic Computing to engineer intelligent processes. The described engineering formalism for the design of thermodynamic computers is a hybrid combination of information theory and thermodynamics. Elements of the engineering formalism are introduced in the reverse-engineer of a cortical neuron. The cortical neuron provides perhaps the simplest and most insightful example of a thermodynamic computer possible. It can be seen as a basic building block for constructing more intelligent thermodynamic circuits.

The choice associated with words is a fundamental property of natural languages. It lies at the heart of quantitative linguistics, computational linguistics, and language sciences more generally. Information-theory gives us tools at hand to measure precisely the average amount of choice associated with words—the word entropy. Here we use three parallel corpora—encompassing ca. 450 million words in 1916 texts and 1259 languages—to tackle some of the major conceptual and practical problems of word entropy estimation: dependence on text size, register, style and estimation method, as well as non-independence of words in co-text. We present three main results: 1) a text size of 50K tokens is sufficient for word entropies to stabilize throughout the text, 2) across languages of the world, word entropies display a unimodal distribution that is skewed to the right. This suggests that there is a trade-off between the learnability and expressivity of words across languages of the world. 3) There is a strong linear relationship between unigram entropies and entropy rates, suggesting that they are inherently linked. We discuss the implications of these results for studying the diversity and evolution of languages from an information-theoretic point of view.

The universal Debye – Mayer – Kelly hybrid model was proposed for the description of the heat capacity from 0 K to the melting points of substance within the experimental uncertainty for the first time. To describe the heat capacity, the in-house software on the base of commercial one DELPHI-7 was used with a 95% confidence level. To demonstrate the perfect suitability of this model, a thermodynamic analysis of the heat capacities of the fourth group elements, and some compounds of the A^IIIB^V and A^IIB^VI phases was carried out. It produced good agreement within the experimental uncertainty. There is no a similar model description in literature.The Similarity Method is a convenient and effective tool for critical analysis of the heat capacities of isostructural phases, which was used as an example for diamond-like compounds. Phases with the same sum of the atomic numbers of elements (Z), such as diamond and B_0.5 N_{0.5 (cub)} (Z = 6); pure silicon (Si) and Al_0.5 P_0.5 (Z=14); pure germanium (Ge) and Ga_0.5 As_0.5 (Z = 32)); pure grey tin (alpha-Sn) and In_0.5 Sb_0.5, and Cd_0.5 Te_0.5 (Z = 50) have the same heat capacity experimental values in the solid state. The proposed models can be used to both different binary and multicomponent phases. It helps to standardize the physicochemical constants.

Different notions of entropy can be identified in different communities: (i) the thermodynamic sense, (ii) the information sense, (iii) the statistical sense, (iv) the disorder sense, and (v) the homogeneity sense. Especially the “disorder sense” and the “homogeneity sense” relate to and require the notion of space and time. One of the few prominent examples relating entropy to geometry and to space is the Bekenstein-Hawking entropy of a Black Hole. Although being developed for the description of a physics object—a black hole—having a mass, a momentum, a temperature, a charge etc. absolutely no information about these attributes of this object can eventually be found in the final formula. In contrast, the Bekenstein-Hawking entropy in its dimensionless form is a positive quantity only comprising geometric attributes like an area A—which is the area of the event horizon of the black hole-, a length L_P—which is the Planck length - and a factor ¼. A purely geometric approach towards this formula will be presented. The approach is based on a continuous 3D extension of the Heaviside function, with this extension drawing on the phase-field concept of diffuse interfaces. Entropy enters into the local, statistical description of contrast respectively gradient distributions in the transition region of the extended Heaviside function definition. The structure of the Bekenstein-Hawking formula eventually is derived for a geometric sphere based on mere geometric-statistic considerations.

We consider the thermodynamic and stability problem of Kerr black holes arising from the nonextensive/nonadditive nature of the Bekenstein-Hawking entropy formula. Nonadditive thermodynamics is often criticized by asserting that the zeroth law cannot be compatible with nonadditive composition rules, so in this work we follow the so-called formal logarithm method to derive an additive entropy function for Kerr black holes satisfying also the zeroth law's requirement. Starting from the most general, equilibrium compatible, nonadditive entropy composition rule of Abe, we consider the simplest, non-parametric approach that is generated by the explicit nonadditive form of the Bekenstein-Hawking formula. This analysis extends our previous results on the Schwarzschild case and shows that the zeroth law compatible temperature function in the model is independent of the mass-energy parameter of the black hole. By applying the Poincaré turning point method we also study the thermodynamic stability problem in the system.

Entropy is a concept derived from Physics that has been used to describe natural and social systems’ structure and behaviour. Applications of the concept in the social sciences so far have been largely limited to the disciplines of economics and sociology. In the current paper the concept of entropy is applied to organizational citizenship behaviour with implications for urban organizational sustainability. A heuristic is presented for analysing personal and organizational citizenship configurations and distributions within a given workforce that can lead to corporate entropy; and for allowing prescriptive remedial steps to be taken to manage the process should entropy from this source threaten its sustainability and survival.

In order to solve the problem of feature extraction of underwater acoustic signals in complex ocean environment, a new method for feature extraction from ship radiated noise is presented based on empirical mode decomposition theory and permutation entropy. It analyzes the separability for permutation entropies of the intrinsic mode functions of three types of ship radiated noise signals, and discusses the permutation entropy of the intrinsic mode function with the highest energy. In this study, ship radiated noise signals measured from three types of ships are decomposed into a set of intrinsic mode functions with empirical mode decomposition method. Then, the permutation entropies of all intrinsic mode functions are calculated with appropriate parameters. The permutation entropies are obviously different in the intrinsic mode functions with the highest energy, thus, the permutation entropy of the intrinsic mode function with the highest energy is regarded as a new characteristic parameter to extract the feature of ship radiated noise. After that, the characteristic parameters, namely, the energy difference between high and low frequency, permutation entropy, and multi-scale permutation entropy, are compared with the permutation entropy of the intrinsic mode function with the highest energy. It is discovered that the four characteristic parameters are at the same level for similar ships, however, there are differences in the parameters for different types of ships. The results demonstrate that the permutation entropy of the intrinsic mode function with the highest energy is better in separability as the characteristic parameter than the other three parameters by comparing their fluctuation ranges and the average values of the four characteristic parameters. Hence, the feature of ship radiated noise can be extracted efficiently with the method.

We investigate entropy generation in unsteady three-dimensional axisymmetric MHD nanofluid flow over a non-linearly stretching sheet. The flow is subject to thermal radiation and a chemical reaction. The conservation equations were solved using the spectral quasi-linearization method. The novelty of the work is in the study of entropy generation in three-dimensional axisymmetric MHD nanofluid and the choice of the spectral quasilinearization method as the solution method. The effects of Brownian motion and thermophoresis are also taken into account when the nanofluid particle volume fraction on the boundary in passively controlled. The results show that as the Hartman number increases, both the Nusselt number and the Sherwood number decrease whereas the skin friction increases. It is further shown that an increase in the thermal radiation parameter corresponds to a decrease in the Nusselt number. Moreover, entropy generation increases with the physical parameters.

Quantum Computers are provisioned as very high performance computers using quantum mechanical aspects for information processing. Quantum Information Theory and Quantum Computing topics are popular topics in academia aiming the construction of theoretical background of Quantum Computers. The information processing units for Quantum Computers are defined as qubits but for some problems three level (trinary) systems may be applied as well. We call these three level systems as qutrits. The scope of this work is the analysis of well-defined entanglement measures Negativity and Relative Entropy of Entanglement (REE) for two qutrit (3- level/trinary) quantum systems. In this manner, for randomly generated 1000 two qutrit and 1000 two qubit states the mentioned measures are calculated and these values are compared. These comparisons are analyzed and for quantum state ordering problem, some interesting results are reported.

Terms related to gradients of scalar fields are introduced as scalar products into the formulation of entropy. A Lagrange density is then formulated by adding constraints based on known conservation laws. Applying the Lagrange formalism to the resulting Lagrange density leads to the Poisson equation of gravitation and also includes terms being related to curvature of space. The formalism further leads to terms possibly explaining nonlinear extensions known from modified Newtonian dynamics approaches. The article concludes with a short discussion of the presented methodology and provides an outlook on other phenomena, which might be tackled using this new approach.

In a vacuum tube two identical and parallel Ag-O-Cs emitters A and B (work function 0.8eV) ceaselessly emit thermal electrons at room temperature. The thermal electrons are controlled by a static uniform magnetic field so that the number of electrons migrate from A to B exceeds the one from B to A (or vice versa). The net migration of thermal electrons from A to B quickly results in a charge distribution of A charged positively and B negatively, and a potential difference between A and B emerges, enabling a continuous output current and a stable power to an external load (e.g., a resistor). Thus, the tube cools down (slightly). The (slightly) cooled tube extracts heat from ambient air, and all the heat is converted into electric energy without other effect. We believe the experiment is in contradiction to the Kelvin statement of the second law.

For more than one hundred years, scientists dispute the correct interpretation of Lorentz transformations within the framework of the special theory of relativity of Albert Einstein. On the one hand, the changes in length, time and mass with increasing velocity are interpreted as apparent due to the observer dependence within special relativity. On the other hand, real changes are described corresponding to the experimental evidence of mass increase in particle accelerators or of clock delay. This ambiguity is accompanied by an ongoing controversy about valid Lorentz-transformed thermodynamic quantities such as entropy, pressure and temperature. In this paper is shown that the interpretation problem of the Lorentz transformations is genuinely anchored within the postulates of special relativity and can be solved on the basis of the thermodynamic approach of matter-energy equivalence, i.e. an energetic distinction between matter and mass. It is suggested that the velocity-dependent changes in state quantities are real in each case, in full agreement with the experimental evidence.

There are currently around 78 Nuclear Power Plants (NPP) in the world based on Boiling Water Reactors (BWR). The current parameter to assess BWR instability issues is the linear Decay Ratio (DR). However, it is well known that BWRs are complex non-linear dynamical systems that may even exhibit chaotic dynamics that normally preclude the use of the DR when the BWR is working at a specific operating point during instability. In this work a novel methodology based on an adaptive Shannon Entropy estimator and on Noise Assisted Empirical Mode Decomposition variants is presented. This methodology was developed for real-time implementation of a stability monitor. This methodology was applied to a set of signals stemming from several NPPs reactors (Ringhals-Sweden, Forsmark-Sweden and Laguna Verde-Mexico) under commercial operating conditions, that experienced instabilities events, each one of a different nature

The real systems are often complex, nonlinear, and noisy in various areas including mathematics, natural science, and social science. We present the symplectic entropy (SymEn) measure as well as an analysis method based on SymEn to estimate the nonlinearity of the complex system by analyzing the given time series. The SymEn estimation is a kind of entropy based on symplectic principal component analysis (SPCA) which represent organized but unpredictable behaviors of systems. The key to SPCA is to preserve the global submanifold geometrical properties of the systems through symplectic transform in the phase space, which is a kind of the measure-preserving transforms. The capability of preserving the global geometrical characteristics makes the SymEn a test statistic to detect the nonlinear characteristics in several typical chaotic time series and the stochastic characteristic in the Gaussian white noise. The results are in agreement with findings in the approximate entropy (ApEn), the sample entropy (SampEn) and the fuzzy entropy (FuzzyEn). Moreover, the SymEn method is also used to analyze the nonlinearities of the real signals (including the EEG signals for ASD and healthy subjects, and the sound and vibration signals for the mechanical systems). The results indicate that the SymEn estimation can be taken as a measure for describing the nonlinear characteristics in the data collected from the natural complex systems.

We generalize the point information gain (PIG) and derived quantities, i.e., point information gain entropy (PIE) and point information gain entropy density (PIED), for the case of the Rényi entropy and simulate the behavior of PIG for typical distributions. We also use these methods for the analysis of multidimensional datasets. We demonstrate the main properties of PIE/PIED spectra for the real data on the example of several images, and discuss further possible utilizations in other fields of data processing.

With the great development of intelligent transportation systems (ITS), travel time prediction has attracted the attentions of many researchers and a large number of prediction methods have been developed. However, as an unavoidable topic, the predictability of travel time series is the basic premise for travel time prediction has received less attention than the methodology. Based on the analysis of the complexity of travel time series, this paper defines travel time predictability to express the probability of correct travel time prediction and proposes an entropy-based method to measure the upper bound of travel time predictability. Multiscale entropy is employed to quantify the complexity of travel time series, and the relationships between entropy and the upper bound of travel time predictability are presented. Empirical studies are made with vehicle trajectory data in an express road section. The effectiveness of time scales, tolerance, and series length to entropy and travel time predictability are analysis, and some valuable suggestions about the accuracy of travel time predictability are discussed. Finally, the comparisons between travel time predictability and actual prediction results from two prediction models, ARIMA and BPNN, are conducted. Experimental results demonstrate the validity and reliability of the proposed travel time predictability.

The purpose of this study is to check out the involvement of entropy in Mpemba effect. Provided that preheating of the water the cooling duration is reduced, we theoretically show that water gains more entropy when warmed and re-cooled to the original temperature.

Today massive amounts of sequenced metagenomic and -transcriptomic data from different ecological niches and environmental locations are available. Scientific progress depends critically on methods that allow extracting useful information from the various types of sequence data. Here, we will first discuss types of information contained in the various flavours of biological sequence data, and how this information can be interpreted to increase our scientific knowledge and understanding. We argue that a mechanistic understanding is required to consistently interpret experimental observations, and that this understanding is greatly facilitated by the generation and analysis of dynamic mathematical models. We conclude that, in order to construct mathematical models and to test mechanistic hypotheses, time-series data is of critical importance. We review diverse techniques to analyse time-series data and discuss various approaches by which time-series of biological sequence data was successfully used to derive and test mechanistic hypotheses. Analysing the bottlenecks of current strategies in the extraction of knowledge and understanding from data, we conclude that combined experimental and theoretical efforts should be implemented as early as possible during the planning phase of individual experiments and scientific research projects.

Iterated games, in which the same economic interaction is repeatedly played between the same agents, are an important framework for understanding the effectiveness of strategic choices over time. To date very little work has applied information theory to the information sets used by agents in order to decide what action to take next in such strategic situations. This article looks at the mutual information between previous game states and an agent's next action by introducing two new classes of games: ’invertible games’ and ‘cyclical games'. By explicitly expanding out the mutual information between past states and the next action we show under what circumstances these expressions can be simplified. These information measures are then applied to the Traveler's Dilemma game and the Prisoner's Dilemma game, the Prisoner's Dilemma being invertible, to illustrate their use. In the Prisoner's Dilemma a novel connection is made between the computational principles of logic gates and both the structure of games and the agents' decision strategies. This approach is applied to the cyclical game Matching Pennies to analyse the foundations of a behavioural ambiguity between two well studied strategies: ‘Tit-for-Tat' and ’Win-Stay, Lose-Switch'.

The numerical simulation of entropy generation at mixed natural free and forced convection flow in a square lid-driven cavity filled with an eletrically conducting binary fluids saturated porous media in the presence of a magnetic field is performed in this investigation. Both the top and bottom horizontal walls of the cavity are kept at constant and different temperatures while the left and right vertical walls are adiabatic and insulated. The magnetic field is applied in normal direction to the cavity. The Darcy model, including Brinkman term relative to viscous effects and Forchheimer term due to inertial forces, is used for the momentum equations, and the SIMPLER algorithm, based on the control volume finite-element method approach is used to solve the pressure –velocity coupling. The flow pattern and the heat transfer characteristics inside the cavity are presented in the form of isotherms, streamlines and isentropic lines and average Nusselt number trend. The entropy generation rate is determined for various values of Darcy number (10^-3 ≤ Da ≤ 1) and for a range of Hartmann number (0 ≤ Ha ≤ 10²). This study is limited to Pr = 7 which corresponds to water. It is observed that entropy generation is very affected by the variations of dimensionless control parameters considered.

The calculation of the vapour pressure of organic molecules at 298.15K is presented using a commonly applicable computer algorithm based on the group-additivity method. The basic principle of this method rests on the complete breakdown of the molecules into their constituting atoms, further characterized by their immediate neighbour atoms. The group contributions are calculated by means of a fast Gauss-Seidel fitting algorithm using the experimental data of 2036 molecules from literature. A ten-fold cross-validation procedure has been carried out to test the applicability of this method, which confirmed excellent quality for the prediction of the vapour pressure, expressed in log(pa), with a cross-validated correlation coefficient Q2 of 0.9938 and a standard deviation  of 0.26. Based on these data, the molecules' standard Gibbs free energy G°vap has been calculated. Furthermore, using their enthalpies of vaporization, predicted by an analogous group-additivity approach published earlier, the standard entropy of vaporization S°vap has been determined and compared with experimental data of 1129 molecules, exhibiting excellent conformance with a correlation coefficient R2 of 0.9598, a standard error  of 8.14 J/mol/K and a medium absolute deviation of 4.68%.

Divergences have become a very useful tool for measuring similarity (or dissimilarity) between probability distributions. Depending on the field of application, a more appropriate measure may be necessary. In this paper we introduce a family of divergences called γ-Divergences. They are based on the convexity property of the functions that generate them. We demonstrate that these divergences verify all the usually required properties, and we extend them to weighted probability distribution. In addition, we define a generalised entropy closely related to the γ-Divergences. Finally, we apply our findings to the analysis of simulated and real time series.

We examined a series of real-world, pictorial photographs with varying characteristics, along with their modification by noise addition and unsharp masking. As response metrics we used three different versions of the aesthetic measure originally proposed by Birkhoff. The first aesthetic measure, which has been used in other studies, and which we used in our previous work as well, showed a preference for the least complex of the images. It provided no justification for noise addition, but did reveal enhancement on unsharp masking. Optimum level of unsharp masking varied with the image, but was predictable from the individual image’s GIF compressibility. We expect this result to be useful for guiding the processing of pictorial photographic imagery. The second aesthetic measure, that of informational aesthetics based on entropy alone failed to provide useful discrimination among the images or the conditions of their modification. A third measure, derived from the concepts of entropy maximization, as well as the hypothesized preference of observers for “simpler”, i.e., more compressible, images, yielded qualitatively the same results as the more traditional version of the measure. Differences among the photographs and the conditions of their modification were more clearly defined with this metric, however.

It is argued that if the non-unitary measurement transition, as codified by Von Neumann, is a real physical process, then the ‘probability assumption’ needed to derive the Second Law of Thermodynamics naturally enters at that point. The existence of a real, indeterministic physical process underlying the measurement transition would therefore provide an ontological basis for Boltzmann’s Stosszahlansatz and thereby explain the unidirectional increase of entropy against a backdrop of otherwise time-reversible laws. It is noted that the Transactional Interpretation (TI) of quantum mechanics provides such a physical account of the non-unitary measurement transition, and TI is brought to bear in finding a physically complete, non-ad hoc grounding for the Second Law.

Maximum entropy production principle (MEPP) has been formulated in the mid-twentieth century, and today it has acquired the status of an important principle of science, which is extremely effective in considering various non-equilibrium problems. In this study, for the first time, definition of life is based on an easily measurable physical quantity that is entropy production. Life and evolution are discussed from the point of view of MEPP and the Universe, but not a human

Natural time is a new time domain introduced in 2001. The analysis of time series associated with a complex system in natural time may provide useful information and may reveal properties that are usually hidden when studying the system in conventional time. In this new time domain, an entropy has been defined and complexity measures based on this entropy as well as its value under time-reversal have been introduced and found applications in various complex systems. Here, we review these applications in the electric signals that precede rupture, e.g., earthquakes, in the analysis of electrocardiograms, as well as in global atmospheric phenomena like the El Nino/La Nina Southern Oscillation.

In 2020, the pandemic caused by the Coronaviruses (CoV) that are a large family of viruses that cause illness ranging from the common cold to more severe diseases such as Middle East Respiratory Syndrome (MERS-CoV) and Severe Acute Respiratory Syndrome (SARS-CoV2). The Coronavirus disease (COVID-19) is a new strain that was discovered in 2019 and has not been previously identified in humans. It is the high time to investigate the quantitative and/or qualitative genomic informations of the virus SARS-CoV2 in order to strengthen the healthcare facility to fight against this viral disease. In this article, a through quantitative understanding of the purine and pyrimidine spatial distribution/organization of all 89 complete sequences of SARS-CoV (available as on date in the NCBI virus database, is made using different parameters such as fractal dimension, Hurst exponent, Shannon entropy and GC content of the nucleotide sequences of the genome of SARS-CoV2. Also a cluster among all the the SARS-CoV sequences of nucleotide have been made based on their phylogeny made through their closeness (Hamming distance) based on respective purine-pyrimidine distribution.

The violation of Bell's theorem is a very simple way to see that there is no underlying classical interpretation of quantum mechanics. The measurements made on the photons shows that light signal (information) could travel between them, hence completely eliminating any chance that the result was due to anything other than entanglement. Entanglement has been studied extensively for understanding the mysteries of non-classical correlations between quantum systems. It was found that violation of Bell's inequalities could be trivially calculated and for sets of nonmaximally entangled states of two qubits, comparing these entanglement measures may lead to different entanglement orderings of the states. On the other hand, although it is not an entanglement measure and not monotonic under local operations, due to its ability of detecting multipartite entanglement, quantum Fisher information (QFI) has recently received an intense attraction generally with entanglement in the focus. In this work, we visit violation of Bell's inequalities problem with a different approach. Generating a thousand random quantum states and performing an optimization based on local general rotations of each qubit, we calculate the maximal QFI for each state. We analyze the maximized QFI in comparison with violation in Bell's inequalities and we make similar comparison of this violation with commonly studied entanglement measures, negativity and relative entropy of entanglement. We show that there are interesting orderings for system states.

Computationally modelling a nuclear reactor startup core for a benchmark against the existing models is highly desirable for an independent assessment informing nuclear engineers and energy policymakers. This work presents a startup core model of the UK’s first Evolutionary Pressurised Water Reactor (EPR) based on Monte Carlo simulations of particle collisions using Serpent 2, a continuous-energy Monte Carlo reactor physics burnup code. Coupling between neutronics and thermal-hydraulic conditions with the fuel depletion is incorporated into the multi-dimensional branches, obtaining the thermal flux and fission rate (power) distributions radially and axially from the three dimensional (3D) single assembly level to a 3D full core. Shannon entropy is employed to characterise the convergence of the fission source distribution, with 3 billion neutron histories tracked by parallel computing. Source biasing is applied for the variance reduction. Benchmarking the proposed Monte Carlo 3D full-core model against the traditional deterministic transport computation suite used by the UK Office for Nuclear Regulation (ONR), a reasonably good agreement within statistics is demonstrated for the safety-related reactivity coefficients, which creates trust in the EPR safety report.

The General equilibrium theory tries to show how and why all free markets tend toward equilibrium in the long run. However, what is meant by equilibrium in this paper is more from a thermodynamical point of view. In order to understand the actual situation, it is necessary to study open systems which are complex. In physics, such a behavior in a complex system can be explain by using Non Equilibrium Thermodynamics. A system is able to self-organize and sustain itself away from equilibrium. Economic systems may fluctuate around a particular point. To sustain it far from the equilibrium state, it needs to degrade more energy and materials. In this study, the energy consumption patterns of Sri Lanka and USA are discussed. The pattern concerning Sri Lanka is close to the model proposed here, whereas the energy consumption pattern of USA is more complicated due to external factors.

This work is a generalization of the Lopez-Ruiz, Mancini and Calbet (LMC); and Shiner, Davison and Landsberg (SDL) complexity measures, considering that the state of a system or process is represented by a dynamical variable during a certain time interval. As the two complexity measures are based on the calculation of informational entropy, an equivalent information source is defined and, as time passes, the individual information associated to the measured parameter is the seed to calculate instantaneous LMC and SDL measures. To show how the methodology works, an example with economic data is presented.

We explored the dynamics of the two interacting information systems. We show that for the Markovian marginal systems the driving force for information dynamics is determined by both the information landscape and information flux. While the information landscape can be used to construct the driving force to describe the equilibrium time reversible information system dynamics, the information flux can be used to describe the nonequilibrium time-irreversible behaviours of the information system dynamics. The information flux explicitly breaks the detailed balance and is a direct measure of the degree of the nonequilibriumness or time irreversibility. We further demonstrate that the mutual information rate between the two subsystems can be decomposed into the equilibrium time-reversible and nonequilibrium time-irreversible parts respectively. This decomposition of the mutual information rate (MIR) corresponds to the information landscape-flux decomposition explicitly when the two subsystems behave as Markov chains. Finally, we uncover the intimate relationship between the nonequilibrium thermodynamics in terms of the entropy production rates and the time-irreversible part of the mutual information rate. We found that this relationship and MIR decomposition still hold for the more general stationary and ergodic cases. We demonstrate the above features with two examples of the bivariate Markov chains.

Terrestrial vegetation dynamics are closely influenced by a multitude of factors. This study investigated the relationships between vegetation patterns and their main influencing factors. The joint entropy method was employed to evaluate the dependence between normalized difference vegetation index (NDVI) and coupled variables in the middle reaches of Hei River basin. Based on the spatial distribution of mutual information, the whole study area was divided into five sub-regions. In each sub-region, nested statistical models were applied to model the NDVI on the grid and regional scales, respectively. Results showed that the annual average NDVI increased with a rate of 0.005/a in recent 11 years. In the desert regions, the NDVI increased significantly with an increase in precipitation and temperature, and high accuracy of retrieving NDVI model was obtained by coupling precipitation and temperature, especially in sub-region I. In the oasis regions, groundwater was also an important factor driving vegetation growth, and the rise of groundwater level contributed to the growth of vegetation. However, the relationship was weaker in artificial oasis regions (sub-region III and sub-region V) due to the influence of human activities, such as irrigation. The overall correlation coefficient between the observed NDVI and modeled NDVI was observed to be 0.97. Outcomes of this study are suitable for ecosystem monitoring, especially under the realm of climate change. Further studies are necessary and should consider more factors, such as runoff and irrigation.

This paper first discusses a fractional-order Liu system of order as low as 2.7 and shows its chaotic characteristics by carrying out numerical simulations such as Lyapunov exponents, bifurcation diagrams and phase portraits. Then, by using the topological horseshoe theory and computer-assisted proof, the existence of chaos in the system is verified theoretically. Finally, the fractional-order system is implemented on a Field Programmable Gate Array (FPGA) and the results obtained show that the fractional-order Liu system is indeed chaotic.

The anisotropy in the CMBR detected by the COBE satellite has sprouted the research and theories of the void that got created, after being washed away by a parallel universe after its collision. This details of the roadmap to the parallel universe, that are previously been entangled, but now, separated, with the concept of 2-time dimensions as a time curve of containing the closed curves embedded on the surface area, thereby time running backward in orientation in the parallel universe, along with the perspective of eternal inflation and divided subspaces giving birth to twin universes are provided here. This time curve being responsible for creating an exponentiality of time frames, growing in layers, giving us the perception of the confabulations being an indication of the previously connected worlds.

Flash flood is one of the most significant natural disasters in China, particularly in mountainous area, causing heavy economic damage and casualties of life. Accurate risk assessment is critical to an efficient flash flood management. There are more than 530,000 small watersheds in 2058 counties in China where flash flood should be prevented. In practice, with limited fund and different risk levels, the priorities of each small watershed for flash flood prevention and control are also needed for an efficient flash flood management. This paper, take Licheng county in China as an example, aims to give out these priorities for management. First, sensitive indexes are identified among index system, which includes 9 indexes based on underlying surface characteristics of small watershed in hilly region. Second, the range of each index and the rank division of each index for evaluation are determined. Based on the rank divisions for evaluation, the flash flood risk grade eigenvalue (H) is calculated by Variable Fuzzy Method (VFM ) using 1000 samplings generated by Latin hypercube sampling method. Third, the key sensitivity factors that affect flash flood risk grade eigenvalue (H) are assessed by two different global sensitivity analysis methods -- stepwise regression analysis and mutual entropy. Both results indicate that watershed slope (S) is the most sensitive factor; the second is antecedent precipitation index (CN); while other factors are slightly different sensitive in sequence. This study shows that stepwise regression analysis and mutual information analysis are appropriate for the sensitivity analysis of mountain flash flood risk. Finally, based on watershed slope (S), the priorities of flash flood prevention and control of 119 small watersheds in Licheng county are given out.

For planetary gear has the characteristics of small volume, light weight and large transmission ratio, it is widely used in high speed and high power mechanical system. Poor working conditions result in frequent failures of planetary gear. A method is proposed for diagnosing faults in planetary gear based on permutation entropy of Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) Adaptive Neuro-fuzzy Inference System (ANFIS) in this paper. The original signal is decomposed into 6 intrinsic mode functions (IMF) and residual components by CEEMDAN. Since the IMF contains the main characteristic information of planetary gear faults, time complexity of IMFs are reflected by permutation entropies to quantify the fault features. The permutation entropies of each IMF component are defined as the input of ANFIS, and its parameters and membership functions are adaptively adjusted according to training samples. Finally, the fuzzy inference rules are determined, and the optimal ANFIS is obtained. The overall recognition rate of the test sample used for ANFIS is 90.75%, and the recognition rate of gear with one missing tooth is relatively high. The recognition rates of different fault gears based on the method can also achieve better results. Therefore, the proposed method can be applied to planetary gear fault diagnosis effectively.

With the development of computer science and software engineering, software becomes more and more complex. Traditional software reliability assurance techniques including software testing and evaluation can't ensure software reliable execution after being deployed. Software failure prediction techniques based on failure indicators can predict software failures according to abnormal indicator values. The latter can be collected using runtime monitoring techniques. An essential part of this method is finding proper indicators which have strong correlation with software failures. We propose a novel type of indicators in this work named software runtime entropy, which takes both software module execution time and call times into consideration. Three common open source software, grep, flex and gzip are used as study cases for finding the relationships between the indicators and software failures. Firstly, a series of fault injection experiments are conducted on those three software respectively. The decision tree algorithm is used to train those data to build the correlation models between software runtime entropy and software failures. Several common measures in machine learning domains such as accuracy, recall rates, and F-measure are used to evaluate the models. The decision tree models can be used as failure mechanisms to assist the failure prediction work. One can examine the value of runtime entropy and make a warning report when it ranges from the normal interval to abnormal one.

The calculation of the standard enthalpies of vaporization, sublimation and solvation of organic molecules is presented using a common computer algorithm on the basis of a group-additivity method. The same algorithm is also shown to enable the calculation of their entropy of fusion as well as the total phase-change entropy of liquid crystals. The present method is based on the complete break-down of the molecules into their constituting atoms and their immediate neighbourhood; the respective calculations of the contribution of the atomic groups by means of the Gauss-Seidel fitting method is based on experimental data collected from literature. The feasibility of the calculations for each of the mentioned descriptors was verified by means of a 10-fold cross-validation procedure proving the good to high quality of the predicted values for the three mentioned enthalpies and for the entropy of fusion, whereas the predictive quality for the total phase-change entropy of liquid crystals was poor. The goodness of fit (Q²) and the standard deviation (σ) of the cross-validation calculations for the five descriptors was as follows: 0.9641 and 4.56 kJ/mol (N=3386 test molecules) for the enthalpy of vaporization, 0.8657 and 11.39 kJ/mol (N=1791) for the enthalpy of sublimation, 0.9546 and 4.34 kJ/mol (N=373) for the enthalpy of solvation, 0.8727 and 17.93 J/mol/K (N=2637) for the entropy of fusion and 0.5804 and 32.79 J/mol/K (N=2643) for the total phase-change entropy of liquid crystals. The large discrepancy between the results of the two closely related entropies is discussed in detail. Molecules, for which both the standard enthalpies of vaporization and sublimation were calculable, enabled the estimation of their standard enthalpy of fusion by simple subtraction of the former from the latter enthalpy. For 990 of them the experimental enthalpy-of-fusion values are also known, allowing their comparison with predictions, yielding a correlation coefficient R² of 0.6066.

The objective of the paper is to introduce new similarity measure for single valued neutrosophic sets based on logarithm function. We define logarithm similarity measure and their weighted similarity measure for single valued neutrosophic sets. Then we define hybrid logarithm similarity measure and weighted hybrid logarithm similarity measure for single valued neutrosophic sets. We prove the basic properties of the proposed measures. We then define an entropy function using logarithm function to determine unknown attribute weights. We develop a novel multi attribute group decision making strategy for single valued neutrosophic sets based on the weighted hybrid logarithm similarity measure. We address an illustrative example to demonstrate the effectiveness and aptness of the proposed strategies. We conduct a sensitivity analysis of the developed strategy. We also make a comparison between the obtained results from proposed strategies and different existing strategies in the literature.

Motivated by the importance of entanglement and correlation indicators in the analysis of quantum systems, we study the equilibrium and the residual entropy in a two-species Bose Hubbard dimer when the spatial phase separation of the two species takes place. We consider both the zero and non-zero-temperature regime. We present different kinds of residual entropies (each one associated to a different way of partitioning the system), and we show that they strictly depend on the specific quantum phase characterizing the two species (supermixed, mixed or demixed) even at finite temperature. To provide a deeper physical insight into the zero-temperature scenario, we apply the fully-analytical variational approach based on su(2) coherent states and provide a considerbly good approximation of the entanglement entropy. Finally, we show that the effectiveness of residual entropy as a critical indicator at non-zero temperature is unchanged when considering a restricted combination of energy eigenstates.

Experimental recordings of the collective activity of interacting spiking neurons exhibit random behavior and memory effects, thus the stochastic process modeling the spiking activity is expected to show some degree of time irreversibility. We use the thermodynamic formalism to build a framework, in the context of spike train statistics, to quantify the degree of irreversibility of any parametric maximum entropy measure under arbitrary constraints, and provide an explicit formula for the information entropy production of the inferred Markov maximum entropy process. We provide examples to illustrate our results and discuss the importance of time irreversibility for modeling the spike train statistics.

Combinatoric measures of entropy capture the complexity of a graph, but rely upon the calculation of its independent sets, or collections of non-adjacent vertices. This decomposition of the vertex set is a known NP-Complete problem and for most real world graphs is an inaccessible calculation. Recent work by Dehmer et al. and Tee et al. identified a number of alternative vertex level measures of entropy that do not suffer from this pathological computational complexity. It can be demonstrated that they are still effective at quantifying graph complexity. It is intriguing to consider whether there is a fundamental link between local and global entropy measures. In this paper, we investigate the existence of correlation between vertex level and global measures of entropy, for a narrow subset of random graphs. We use the greedy algorithm approximation for calculating the chromatic information and therefore Körner entropy. We are able to demonstrate close correlation for this subset of graphs and outline how this may arise theoretically.

The value of an NBA basketball player varies at each crucial point in time, depending on the player’s career and performance. This study constructs a player’s value assessment model. The model comprises two parts. First, from an objective perspective, entropy is employed to measure each player’s achievement in five categories—rebounds, assists, steals, blocked shots, and scores. The total entropy assessment value is calculated and then combined with the players’ scores to develop a player's value matrix to assess the relative value model among players of the same type.

Telemedicine is the use of Information and Communication Technology (ICT) for clinical health care from a distance. The exchange of radiographic images and electronic patient health information/records (ePHI/R) for diagnostic purposes has the risk of confidentiality, ownership identity, and authenticity. In this paper, a data hiding technique for ePHI/R is proposed. The color information in the cover image is used for key generation, and stego-images are produced with ideal case. As a result, the whole stego-system is perfectly secure. This method includes the features of watermarking and steganography techniques. The method is applied to radiographic images. For the radiographic images, this method resembles watermarking, which is an ePHI/R data system. Experiments show promising results for the application of this method to radiographic images in ePHI/R for both transmission and storage purpose.

We compared performance of a novel encoding Lempel-Ziv complexity (ELZC) with approximate entropy (ApEn), sample entropy (SmpEn) and permutation entropy (PerEn) as nonlinear metric to assess ECG quality. Firstly to compare performance of discerning randomness and inherent nonlinear properties within time series, this study calculated the aforementioned four nonlinear complexity values on several typical artificial time series i.e., Gauss noise, two kinds of noisy time series, two kinds of Logistic series and periodic series, respectively. Then for analyzing sensitivity of the aforementioned four complexity methods to content level of different types noise within ECG recordings, we investigated variation trend of ELZC, ApEn, SmpEn and PerEn in several synthetic ECG recordings containing different types noise (i.e., baseline wander, muscle artefacts, electrode motion, power line and mixed noise) and different signal noise ratios (i.e., 15, 10, 5, 0, −5 and −10 dB). Finally, the four complexity methods were employed to classify the quality of real ECG recordings from the PhysioNet/Computing in Cardiology Challenge 2011 (CINC 2011) of the MIT databases, then receiver operating characteristic curves (ROC) and their corresponding area under curve (AUC) were yielded. The results showed ELZC could not only distinguish randomness and chaotic within time series but also reflect content level of noise within time series, and the highest AUC of PerEn, ELZC, SmpEn and ApEn were 0.850, 0.695, 0.474 and 0.461, respectively. The results demonstrated PerEn and ELZC were more effectively than ApEn and SmpEn for assessing ECG quality.

Bipolar neutrosophic set is an important extension of bipolar fuzzy set. This set is a hybridization of bipolar fuzzy set and neutrosophic set. Every element of a bipolar neutrosophic set consists of three independent positive membership functions and three independent negative membership functions. In this paper, we develop cross entropy measures of bipolar neutrosophic sets and prove its properties. We also define cross entropy measures of interval bipolar neutrosophic sets and prove its properties. Thereafter, we develop two novel multi-attribute decision making methods based on the proposed cross entropy measures. In the decision making framework, we calculate the weighted cross entropy measures between each alternative and the ideal alternative to rank the alternatives and choose the best one. We solve two illustrative examples of multi-attribute decision making problems and compare the obtained result with the results of other existing methods to show the applicability and effectiveness of the developed method. In the end, the main conclusion and future scope of research are summarized.

Ultraviolet light incident on organic material can initiate its spontaneous dissipative structuring into chromophores which can catalyze their own replication. This may have been the case for one of the most ancient of all chromophores dissipating the Archean UVC photon flux, the nucleic acids. Oligos of nucleic acids with affinity to particular amino acids which foment UVC photon dissipation would have been selected through non-equilibrium thermodynamic imperatives which favor entropy production. Indeed, we show here that those amino acids with characteristics most relevant to fomenting UVC photon dissipation are precisely those with greatest chemical affinity to their codons or anticodons. Entropy production could thus provide an explanation for the accumulation of information in nucleic acids relevant to the dissipation of the externally imposed thermodynamic potentials. The accumulation of information in this manner provides a link between evolution and entropy production.

Neutrosophic cubic set (NCS) is one of the important family members of neutrosophic hybrid sets. Neutrosophic cubic set has more strength than other family members of neutrosophic hybrid sets to express incomplete information due to the presence of interval valued neutrosophic set (IVNS) and single valued neutrosophic set (SVNS) in its structure. Cross entropy measure is one of the best way to calculate the divergence of any variable from the priori one variable. In this paper we first define a new cross entropy measure under NCSs environment which we call NC- cross entropy measure. We investigate the basic properties of NC-cross entropy. We also propose weighted NC-cross entropy and investigate its basic properties. We develop a novel multi attribute decision making (MADM) strategy based on weighted NC-cross entropy. To show the feasibility and applicability, we solve a MADM problem using the proposed strategy.

Because only two variables are needed to characterize a simple thermodynamic system in equilibrium, any such system is constrained on a 2D manifold. Of particular interest are the exact 1-forms on the cotangent space of that manifold, since the integral of exact 1-forms is path-independent, a crucial property satisfied by state variables such as internal energy dE and entropy dS. Our prior work [1] shows that given an appropriate language of vector calculus, a machine can re-discover the Maxwell equations and the incompressible Navier-Stokes equations from data. In this paper, We enhance this language by including differential forms and show that machines can re-discover the equation for entropy dS given data. Since entropy appears in various fields of science in different guises, a potential extension of this work is to use the machinery developed in this paper to let machines discover the expressions for entropy from data in fields other than classical thermodynamics.

There are introduced two new steganalytic methods not depending on the statistics of the cover objects, namely side attacks stegosystems. The first one assumes that the plaintext, encrypted before embedding, is known by the attacker. In this case, the stegosystem’s detection is based on the calculation of mutual information between message and extracted encrypted data. For this calculation, a notion of the k-nearest neighbor distance is applied. The second method is applied to HUGO, one of the most efficient steganographic algorithms. In this case the stegosystem’s detection is based on a verification of the NIST tests to the extracted encrypted messages. Moreover, we show that the problem to find a submatrix of­ the embedding matrix determining a trellis code structure in the HUGO algorithm provides a search of the stegokey of the proposed stegosystem.

This paper is devoted to change-point detection using only the ordinal structure of a time series. A statistic based on the conditional entropy of ordinal patterns characterizing the local up and down in a time series is introduced and investigated. The statistic requires only minimal a priori information on given data and shows good performance in numerical experiments.

The Voronoi entropy is a mathematical tool for quantitative characterization of the orderliness of points distributed on a surface. The tool is useful to study various surface self-assembly processes. We provide the historical background, from Kepler and Descartes to our days, and discuss topological properties of the Voronoi tessellation, upon which the entropy concept is based, and its scaling properties, known as the Lewis and Aboav-Weaire laws. The Voronoi entropy has been successfully applied to recently discovered self-assembled structures, such as patterned micro-porous polymer surfaces obtained by the breath figure method and levitating ordered water micro-droplet clusters.

Single valued neutrosophic set has king power to express uncertainty characterized by indeterminacy, inconsistency and incompleteness. Most of the existing single valued neutrosophic cross entropy bears an asymmetrical behavior and produce an undefined phenomenon in some situations. In order to deal with these disadvantages, we propose a new cross entropy measure under single valued neutrosophic set (SVNS) environment namely SN- cross entropy and prove its basic properties. Also we define weighted SN-cross entropy measure and investigate its basic properties. We develop a new multi attribute group decision making (MAGDM) strategy for ranking of the alternatives based on the proposed weighted SN-cross entropy measure between each alternative and the ideal alternative. Finally, a numerical example of MAGDM problem of investment potential is solved to show the validity and efficiency of proposed decision making strategy. We also present comparative anslysis of the obtained result with the results obtained form the existing solution strategies in the solution.

Mereology stands for the philosophical concept of parthood and is based on a sound set of fundamental axioms and relations. One of these axioms relates to the existence of a universe as a thing having part all other things. The present article formulates this logical expression first as an algebraic inequality and eventually as an algebraic equation reading in words: The universe equals the sum of all things. “All things” here are quantified by a “number of things”. Eventually this algebraic equation is normalized leading to an expression The whole equals the sum of all fractions. This introduces “1” or “100%” as a quantitative – numerical - value describing the “whole”. The resulting “basic equation” can then be subjected to a number of algebraic operations. Especially squaring this equation leads to correlation terms between the things implying that the whole is more than just the sum of its parts. Multiplying the basic equation (or its square) by a scalar allows for the derivation of physics equations like the entropy equation, the ideal gas equation, an equation for the Lorentz-Factor, conservation laws for mass and energy, the energy-mass equivalence, the Boltzmann statistics, and the energy levels in a Hydrogen atom. It further allows deriving a “contrast equation” which may form the basis for the definition of a length and a time scale. Multiplying the basic equation with vectors, pseudovectors, pseudoscalars and eventually hypercomplex numbers opens up the realm of possibilities to generate many further equations.

In the clinical electrophysiologic practice, the reading and comparing electroencephalographic (EEG) recordings some times is insufficient and take to much time. That is why in the last years it has begun to introduce new methods of EEG analysis, that give a better and faster understanding of the EEG dynamics and allow a rapid intervention in the patient's treatment. Tools coming from the information theory or nonlinear system as an entropy and complexity have been shown to be a very good alternative to address this problem. In this work we introduce a novel method -the permutation Lempel-ziv complexity vs permutation entropy map. This method was applied to EEG of two patients with specific diagnosed pathologies during respective follow up processes of pharmacological changes in order to detect changes that are not evident with the usual inspection method. Our results show that the proposed method are useful for observing an evolutionary retrospective clinical effects of pharmacological interventions in both patients, and from these, to follow the clinical response to the proposed treatment.

Time irreversibility, i.e. the lack of invariance of the statistical properties of a system under time reversal, is a fundamental property of all systems operating out of equilibrium. Time reversal symmetry is associated with important statistical and physical properties and is related to the predictability of the system generating the time series. Over the past fifteen years, various methods to quantify time irreversibility in time series have been proposed, but these can be computationally expensive. Here we propose a new method, based on permutation entropy, which is essentially parameter-free, temporally local, yields straightforward statistical tests, and has fast convergence properties. We apply this method to the study of financial time series, showing that stocks and indices present a rich irreversibility dynamics. We illustrate the comparative methodological advantages of our method with respect to a recently proposed method based on visibility graphs, and discuss the implications of our results for financial data analysis and interpretation.

Monitoring the ratio of forested and deforested areas plays a key role in studying the dynamics of forest areas. Appropriate mapping of anthropogenic forest disturbances is particularly important in the context of sustainable forest management. It provides ecological, social and economic information which is crucial for forest policymakers. In the last two decades, the forest areas of the Moldo-Transylvanian Carpathians have been subject to a high rate of deforestation which at present state lacks proper quantification. We present a novel methodology for monitoring the forest disturbance dynamics in Moldo-Transylvanian Carpathians by use of fractal analysis including entropy, Fractal Fragmentation Index (FFI) and Tug-of-War lacunarity (Λ_(T-o-W)). This was necessary to quantify and identify the disorder (entropy), the fragmentation (FFI) and heterogeneity of the spatial distribution (Λ_(T-o-W)) patterns. Based on satellite images of the forest areas (annually 2000-2014), increased fragmentation was demonstrated by FFI increase, a measure of the degree of disorder (entropy) and heterogeneity (lacunarity). Our results revealed that textural and fractal analysis can be an effective tool for the extraction of quantitative information about the spatiotemporal dynamics of forest disturbance. The methods developed, and results obtained are a complementary approach to forest disturbance mapping (based on traditional image classification) for future development and adaptation of forestry management policies to ensure a sustainable management and exploitation of forest areas.

The world is now undergoing through a global emergency due to COVID-19 which needs immediate remedies in order to strengthen the healthcare facility to save the nations. Looking towards to the remedies, research on different aspects including the genomic and proteomic level characterizations of the SARS-CoV2 are necessarily important. In this present study, the spatial representation/composition of twenty amino acids across the primary protein sequences of SARS-CoV2 have been looked into through different parameters viz. Shannon entropy, Hurst exponent in order to fetch the autocorrelation and amount of information over the spatial representations. Also frequency distribution of each of the amino acids over the protein sequences have been chalked out.

This paper aims to provide an overall review of degradation, damage evolution and fatigue models in the literature of various engineering materials, mostly metals, and composites.

We find that the standard relative entropy and the Umegaki entropy are designed for the purpose of inferentially updating probability and density matrices respectively. From the same set of inferentially guided design criteria, both of the previously stated entropies are derived in parallel. This formulates a quantum maximum entropy method for the purpose of inferring density matrices in the absence of complete information.

An appearance model plays a crucial rule in multi-target tracking. In traditional approaches, the two steps of appearance modeling i.e visual representation and statistically similarity measure are modeled separately. Visual representation is achieved either through hand-crafted features or deep features and statically similarity is measure through a cross entropy loss function. A loss function based on cross-entropy (KL-divergence, mutual information) find closely related probability distribution for the targets. However, if the targets have similar visual representation, it ends up mixing the targets. To tackle this problem, we come up with a synergetic appearance model named Single Shot Appearance Model based on Siamese neural network. The network is trained with a contrastive loss function for finding the similarity between different targets in a single shot. The input to the network is two target patches and based on their similarity, a contrastive score is output by the network. The proposed model is evaluated on accumulative dissimilarity metric on three datasets. Quantitatively, promising results are achieved against three baseline methods.

The present days can be considered a crossroad in the history our word because the economic, social and ecological needs don't agree one another. The result is a continuous growth of poverty and an increase of the ecological degradation. This has generated the present difficult socio-economic state, and it seems very difficult to escape. A new viewpoint must be introduced, but it cannot based on the usual economic indicators. So, new indicators must be introduced. They must allow us to consider the technological level, the environmental impact and the socio-economic conditions. In this paper we suggest three indicators based on an engineering approach of irreversibility. Three applications are shown in order to highlight the possible interest from different scientists and researchers in engineering, economy, etc, in order to develop sustainable approaches and policies for decision makers.

Logical information theory is the quantitative version of the logic of partitions just as logical probability theory is the quantitative version of the dual Boolean logic of subsets. The resulting notion of information is about distinctions, differences, and distinguishability, and is formalized using the distinctions (`dits') of a partition (a pair of points distinguished by the partition). All the definitions of simple, joint, conditional, and mutual entropy of Shannon information theory are derived by a uniform transformation from the corresponding definitions at the logical level. The purpose of this paper is to give the direct generalization to quantum logical information theory that similarly focuses on the pairs of eigenstates distinguished by an observable, i.e., qudits of an observable. The fundamental theorem for quantum logical entropy and measurement establishes a direct quantitative connection between the increase in quantum logical entropy due to a projective measurement and the eigenstates (cohered together in the pure superposition state being measured) that are distinguished by the measurement (decohered in the post-measurement mixed state). Both the classical and quantum versions of logical entropy have simple interpretations as "two-draw" probabilities for distinctions. The conclusion is that quantum logical entropy is the simple and natural notion of information for quantum information theory focusing on the distinguishing of quantum states.

In this paper, the elemental construct of an I-shaped fin cooling a heat generating volume is studied through the entropy production perspective. Using the constructal design method framework with entropy production minimization as an objective leads to different optimal shape ratio, different from the ones obtained using the excess of temperature. Moreover, the optimal shape ratio evolution is not necessary the same for local entropy production minimization (excess of entropy production) and global entropy production (entropy produced in the whole area). Finally, an analysis on a possible dimensionless number is introduced for the study of constructal plates.

A precise understanding of the genes and associated genomes of SARS-CoV2 is important for various reasons such as discovering origin of the virus and virulence and so on. A thorough descriptive understanding of the SARS-CoV2 genomes and other coronavirus of the beta-coronavirus genus is primarily important. In this article, a set of ten genomes of four CoVs and their associated genes are considered for this present study. A spatial representations of nucleotide bases including purine-pyrimidine representations of the different genes of the corresponding genomes are quantified using Hurst exponent, Shannon entropy and density estimation of different nucleotides including GC content, in order to draw a comparison and contrast among the ten genomes of different types of CoVs which include MERS, SARS-CoV, HKU1 (Human Coronavirus) and associated their genes.

The role of energy and entropy in decomposition of turbulent velocity flow-fields is to be shown in the paper. The decomposition methods based on energy concept are taken into account, namely the Proper Orthogonal Decomposition (POD) and its extension Bi-Orthogonal Decomposition (BOD). Entropy motivated view on the decomposed modes could offer new possibilities in the modes physical interpretation and in Reduced Order Modelling (ROM) strategy efficiency evaluation.

Hierarchical honeycomb patterns were manufactured with the breath-figures self-assembly by drop-casting on the silicone-oil lubricated glass substrates. Silicone oil promoted spreading of the polymer solutions. The process was carried out with the industrial grade polystyrene and polystyrene with the molecular weight Mw=35.000. Both of polymers gave rise to the patterns, built from micro- and nano-scaled pores. Ordering of the pores was quantified with the Voronoi tessellations and calculating the Voronoi entropy. Measurement of the apparent contact angles evidenced the Cassie - Baxter wetting regime of the porous films.

This study is framed on the Information Theory as a constructive criterion to generate probabilistic distributions –through the elaboration of Bayesian Networks- and to reduce the uncertainty in the occurrence and relationship between two key psychological variables associated with the sports’ performance: Self-Determined Motivation and Competitive Anxiety. We analyzed 674 universitary students/athletes who competed in the 2017 Universitary Games (Universiade) in México, from 44 universities, with an average age of 21 years old (SD = 2.07), and with a sportive experience of 8.61 years of average (SD = 5.15). Methods: Regarding the data analysis, first of all a CHAID algorithm was carried out for to know the independence links among variables, and then two Bayesian networks (BN) were elaborated. The validation of the BN revealed AUC values ranging from 0.5 to 0.92. Subsequently, various instantations were carried out with hypothetical values applied to the “bottom” variables. Results showed two probability trees that have Extrinisic Motivation and Amotivation at the top, while the anxiety/activation due to the worry for performance was at the bottom of probabilities. The instantiations carried out support the existence of these probabilistic relationships, demonstrating the little influence on the competition anxiety generated by the intrinsic motivation. In conclusion, the reduction of the uncertainty made up by the restricted BN may aloe to re-introduce Information Theory principles in psychosocial studies, allowing authors to obtain useful probabilities values upon target psychological variables related with sportive performance.

The notion of enhancement of the image is to ameliorate the perceptibility of information contained in an image. In the present research, a novel technique for the enhancement of image quality is propounded using fuzzy logic technique with a cuckoo optimization algorithm. Generally, the image is transformed from RGB domain to HSV domain keeping the color information intact within the image. The image has been categorized into three regions: underexposed, overexposed and mixed region on the basis of two threshold values. For the fuzzification of under and overexposed area the degree of membership is defined by the Gaussian membership, while the mixed area is fuzzified by parametric sigmoid function. The key parameters like visual factors and fuzzy contrast provide the quantitative analysis of an image. An objective function is framed which involves entropy and visual factor has been optimized by a new evolutionary cuckoo optimization algorithm. The results procured after simulation by the cuckoo optimization algorithm are compared with Bacterial foraging algorithm and ant colony optimization based image enhancement and this approach is found to be improved.

We report the application of a recently proposed approach for modeling biological systems using a maximum entropy production rate principle in lieu of having in vivo rate constants. The method is applied in four steps: (1) a new ODE-based optimization approach based on Marcelin’s 1910 mass action equation is used to obtain the maximum entropy distribution, (2) the predicted metabolite concentrations are compared to those generally expected from experiment using a loss function from which post-translational regulation of enzymes is inferred, (3) the system is re-optimized with the inferred regulation from which rate constants are determined from the metabolite concentrations and reaction fluxes, and finally (4) a full ODE-based, mass action simulation with rate parameters and allosteric regulation is obtained. From the last step, the power characteristics and resistance of each reaction can be determined. The method is applied to the central metabolism of Neurospora crassa and the flow of material through the three competing pathways of upper glycolysis, the non-oxidative pentose phosphate pathway, and the oxidative pentose phosphate pathway are evaluated as a function of the NADP/NADPH ratio. It is predicted that regulation of phosphofructokinase (PFK) and flow through the pentose phosphate pathway are essential for preventing an extreme level of fructose 1, 6-bisphophate accumulation. Such an extreme level of fructose 1,6-bisphophate would otherwise result in a glassy cytoplasm with limited diffusion, dramatically decreasing the entropy and energy production rate and, consequently, biological competitiveness.

Polymers in highly confined geometries can display complex morphologies including ordered phases. A basic component of a theoretical analysis of their phase behavior in confined geometries is the knowledge of the number of possible single-chain conformations compatible with the geometrical restrictions and the established crystalline morphology. While the statistical properties of unrestricted self-avoiding random walks (SAWs) both on and off-lattice are very well known, the same is not true for SAWs in confined geometries. The purpose of this contribution is a) to enumerate the number of SAWs on the simple cubic (SC) and face-centered cubic (FCC) lattices under confinement for moderate SAW lengths, and b) to obtain an approximate expression for their behavior as a function of chain length, type of lattice, and degree of confinement. This information is an essential requirement for the understanding and prediction of entropy-driven phase transitions of model polymer chains under confinement. In addition, a simple geometric argument is presented that explains, to first order, the dependence of the number of restricted SAWs on the type of SAW origin.

In 1969, Jean-Marie Souriau introduced a “Lie Groups Thermodynamics” in Statistical Mechanics in the framework of Geometric Mechanics. This Souriau’s model considers the statistical mechanics of dynamic systems in their "space of evolution" associated to a homogeneous symplectic manifold by a Lagrange 2-form, and defines in case of non null cohomology (non equivariance of the coadjoint action on the moment map with appearance of an additional cocyle) a Gibbs density (of maximum entropy) that is covariant under the action of dynamic groups of physics (eg, Galileo's group in classical physics). Souriau Lie Group Thermodynamics was also addressed 30 years after Souriau by R. F. Streater in the framework of Quantum Physics by Information Geometry for some Lie algebras, but only in the case of null cohomology. Souriau method could then be applied on Lie Groups to define a covariant maximum entropy density by Kirillov representation theory. We will illustrate this method for homogeneous Siegel domains and more especially for Poincaré unit disk by considering SU(1,1) group coadjoint orbit and by using its Souriau’s moment map. For this case, the coadjoint action on moment map is equivariant. For non-null cohomology, we give the case of Lie group SE(2). Finally, we will propose a new geometric definition of Entropy that could be built as a generalized Casimir invariant function in coadjoint representation, and Massieu characteristic function, dual of Entropy by Legendre transform, as a generalized Casimir invariant function in adjoint representation, where Souriau cocycle is a measure of the lack of equivariance of the moment mapping.

In this paper, we revisit the q-states clock model for small systems. We present results for the thermodynamics of the q-states clock model from $q=2$ to $q=20$ for small square lattices $L \times L$, with L ranging from $L=3$ to $L=64$ with free-boundary conditions. Energy, specific heat, entropy and magnetization are measured. We found that the Berezinskii-Kosterlitz-Thouless (BKT)-like transition appears for $q>5$ regardless of lattice size, while the transition at $q=5$ is lost for $L<10$; for $q\leq 4$ the BKT transition is never present. We report the phase diagram in terms of $q$ showing the transition from the ferromagnetic (FM) to the paramagnetic (PM) phases at a critical temperature T$_1$ for small systems which turns into a transition from the FM to the BKT phase for larger systems, while a second phase transition between the BKT and the PM phases occurs at T$_2$. We also show that the magnetic phases are well characterized by the two dimensional (2D) distribution of the magnetization values. We make use of this opportunity to do an information theory analysis of the time series obtained from the Monte Carlo simulations. In particular, we calculate the phenomenological mutability and diversity functions. Diversity characterizes the phase transitions, but the phases are less detectable as $q$ increases. Free boundary conditions are used to better mimic the reality of small systems (far from any thermodynamic limit). The role of size is discussed.

To understand microbial growth with mathematical models has a long tradition that dates back to the pioneering work of Jacques Monod in the 1940s. Growth laws are simple mathematical expressions that aim at describing growth rates of microbes as functions of external parameters, in particular nutrient concentrations. These laws are now widely applied to construct, e.g., dynamic ecosystem models. However, to explain the growth laws from underlying (first) principles is extremely challenging. In the second half of the 20th century, numerous experimental approaches aimed at precisely measuring heat production during microbial growth to determine the entropy balance in a growing cell and to quantify the exported entropy. This has led to the development of thermodynamic theories of microbial growth, which have generated fundamental understanding and identified principle limitations of the growth process. Whereas these approaches considered a growing microbe as a black box, modern theories heavily rely on genomic resources to describe and model genome-scale networks to explain microbial growth. Interestingly, however, thermodynamic constraints are often included in modern modelling approaches only in a rather superficial fashion, and it appears that recent modelling approaches and classical theories are disconnected fields. In order to stimulate a closer interaction between these fields, we here review various theoretical approaches that aim at describing microbial growth based on thermodynamic principles. We start with classical black-box models of cellular growth, and continue with genome-scale modelling approaches that include thermodynamics, before we place these models in the context of fundamental considerations based on non-equilibrium statistical mechanics. We conclude by identifying conceptual overlaps between the fields and suggest how the various types of theories and models can be integrated. We outline how concepts from one approach may help to inform or constrain another, and we demonstrate how genome-scale models can be used to infer classical black-box parameters, which are experimentally accessible in growth experiments. Such integration will allow understanding to what extent microbes can be viewed as thermodynamic machines, and how close they operate to theoretical optima.

This paper presents a quantitative approach to poetry, based on the use of several statistical measures (entropy, informational energy, N-gram, etc.) applied to a few characteristic English writings. We found that English language changes its entropy as time passes, and that entropy depends on the language used and on the author. In order to compare two similar texts, we were able to introduce a statistical method to asses the information entropy between two texts. We also introduced a method of computing the average information conveyed by a group of letters about the next letter in the text. We found a formula for computing the Shannon language entropy and we introduced the concept of N-gram informational energy of a poetry. We also constructed a neural network, which is able to generate Byron-type poetry and to analyze the information proximity to the genuine Byron poetry.

A general framework for inference in dynamical systems is described, based on the language of Bayesian probability theory and making use of the maximum entropy principle. Taking as fundamental the concept of a path, the continuity equation and Cauchy's equation for fluid dynamics arise naturally, while the specific information about the system can be included using the Maximum Caliber (or maximum path entropy) principle.

Complex systems can be described as the network of interactions between their components. In directed networks, information, energy and matter flow in dominant directions. Undirected networks, on the other hand, cannot easily capture these asymmetries. The local flow of information depends on the node spin, which is a function of the number of incoming and outgoing links attached to it. And yet, how the heterogeneous association between in-degree and out-degree constraints global dynamics remains poorly understood. Here, we develop a new theoretical model to study the relationship between node directionality and global flow dynamics. Our computational analysis of random and scale-free directed networks indicates that structural diversity constrains the dimensionality of reachable dynamical space. These results suggest how local directionality might be an universal driver of global dynamics in many systems, from social networks, to technological systems to the connectome.

We survey the main results emerging in the rapidly developing field that considers the geometry of thermodynamics and statistical mechanics. Our ideas of stability depend on variational principles – Maximum Entropy together with Least Action (and the isomorphic Least Exertion) – and this stability (invariance in time) indicates the centrality of the geometries of the systems. We explore a variety of examples of the application of thermodynamics in both macro- and micro-systems, and propose that irreversibility is an intrinsic and fundamental property of the physical realm (instead of being merely emergent). Using the concept of complex time, we examine the underlying mathematical unity of quantum mechanics, statistical mechanics, and geometrical thermodynamics. We show how the Planck and Boltzmann constants provide the fundamental quantum units for the phenomenological characteristics of the two Noether-conserved quantities controlling overall thermodynamic behaviour: respectively, energy and entropy production. We discuss the far-reaching isomorphisms (between all of complex time, temperature and the system symmetry) that always exist for Maximum Entropy systems, even as they exhibit either irreversible (dissipative, yet still dynamically stable) or reversible (including stable and static geometries) behaviours.

Based on a measuring system to determine levels of spatial organization in 2D polygons (homogeneous or heterogeneous partition of defined areas) lying on principles of regularity, we propose the entropy term linked to the concept of “information”, from the “information theory field”, in order to obtain an information measurement regarding a quantity of or amount of information in the architecture of complex 2D biological organizations. The term “quantity” does not refer to the amount of data (size), but to the probability of a geometrical basic pattern within a set of possible statistical configurations regarding levels of homogeneity and heterogeneity. It is this notion of information that is important in information theory, and measures of information in units of bits, what we propose to use for measuring quantities of organization in the architecture of complex geometrical systems. Two complex systems are tested, biological and non biological in order to obtain experimental results, which are verified with the evaluation criteria “entropy”. Experimental results show that the lowest levels of information and entropy, in addition with low rates of heterogeneity and high rates of homogeneity are particular features of geometrical organizations in biological systems.

We introduce and investigate a simple and explicitly mechanical model of Maxwell's demon -- a device that interacts with a memory register (a stream of bits), a thermal reservoir (an ideal gas) and a work reservoir (a mass that can be lifted or lowered). Our device is similar to one that we have briefly described elsewhere [1], but it has the additional feature that it can be programmed to recognize a chosen reference sequence, for instance, the binary representation of $\pi$. If the bits in the memory register match those of the reference sequence, then the device extracts heat from the thermal reservoir and converts it into work to lift a small mass. Conversely, the device can operate as a generalized Landauer's eraser (or copier), harnessing the energy of a dropping mass to write the chosen reference sequence onto the memory register, replacing whatever information may previously have been stored there. Our model can be interpreted either as a machine that autonomously performs a conversion between information and energy, or else as a feedback-controlled device that is operated by an external agent. We derive generalized second laws of thermodynamics for both pictures. We illustrate our model with numerical simulations, as well as analytical calculations in a particular, exactly solvable limit.

Despite their obvious differences, biological systems at different scales tend to exhibit common organizational patterns. Unfortunately, these commonalities are usually obscured by the parcelled terminology employed by various scientific sub-disciplines. To explore these commonalities, this papers a comparative study of diverse applications of the maximum entropy principle, ranging from amino acids up to societies. By presenting these studies under a common language, this paper establishes a unified view over seemingly highly heterogeneous biological scenarios.

Synergy, emerges from synchronized reciprocal positive feedback loops between a network of diverse actors. For this process to proceed, compatible information from different sources synchronically coordinates the actions of the actors resulting in a nonlinear increase in the useful work or potential energy the system can manage. In contrast noise is produced when incompatible information is mixed. This synergy produced from the coordination of different agents achieves non-linear gains in free energy and in information (negentropy) that are greater than the sum of the parts. The final product of new synergies is an increase in individual autonomy of an organism that achieves increased emancipation from the environment with increases in productivity, efficiency, capacity for flexibility, self-regulation and self-control of behavior through a synchronized division of ever more specialized labor. Examples that provide quantitative data for this phenomenon are presented. Results show that increases in free energy density require decreases in entropy density. This is proposed as a law of thermodynamics.

A growing number of studies focus on methods to estimate and analyze the functional connectome of the human brain. Graph theoretical measures are commonly employed to interpret and synthesize complex network-related information. While resting state functional MRI (rsfMRI) is often employed in this context, is known to exhibit poor reproducibility, a key factor which is commonly neglected in typical cohort studies using connectomics-related measures as biomarkers. We aimed to fill this gap by analyzing and comparing inter- and intra- subject variability of connectivity matrices as well as graph-theoretical measures in a large (n=1003) database of young healthy subjects which underwent four consecutive rsfMRI sessions. We analyzed both directed (Granger Causality and Transfer Entropy) and undirected (Pearson Correlation and Partial Correlation) time-series association measures and related global and local graph-theoretical measures. While matrix weights exhibit a higher reproducibility in undirected as opposed to directed methods, this difference disappears when looking at global graph metrics and, in turn, exhibits strong regional dependence in local graphs metrics. Our results warrant caution in the interpretation of connectivity studies, and serve as a benchmark for future investigations by providing quantitative estimates for the inter- and intra- subject variabilities in both directed and undirected connectomic measures.

Meixner's historical remark in 1969 "... it can be shown that the concept of entropy in the absence of equilibrium is in fact not only questionable but that it cannot even be defined...." is investigated from today's insight. Several statements --such as the three laws of phenomenological thermodynamics, the embedding theorem and the adiabatical uniqueness-- are used to get rid of non-equilibrium entropy as a primitive concept. In this framework, Clausius inequality of open systems can be derived by use of the defining inequalities which establish the non-equilibrium quantities contact temperature and non-equilibrium molar entropy which allow to describe the interaction between the Schottky system and its controlling equilibrium environment.

This paper describes a proposed fractional filter-based multi-scale underwater and hazy image enhancement algorithm. The proposed system combines a modified global contrast operator with fractional order-based multi-scale filters used to generate several images, which are fused based on entropy and standard deviation. The multi-scale-global enhancement technique enables fully adaptive and controlled colour correction and contrast enhancement without over exposure of highlights when processing hazy and underwater images. This in addition to illumination/reflectance estimation coupled with global and local contrast enhancement. The proposed algorithm is also compared with the most recent available state-of-the-art multi-scale fusion de-hazing algorithm. Experimental comparisons indicate that the proposed approach yields better edge and contrast enhancement results without halo effect, colour degradation and is faster and more adaptive than all other algorithms from the literature.

The diffusion coefficient--a measure of dissipation, and the entropy--a measure of fluctuation are found to be intimately correlated in many physical systems. Unlike the fluctuation dissipation theorem in linear response theory, the correlation is often strongly non-linear. To understand this complex dependence, we consider the classical Brownian diffusion in this work. Under certain rational assumption, i.e. in the bi-component fluid mixture, the mass of the Brownian particle $M$ is far greater than that of the bath molecule $m$, we can adopt the weakly couple limit. Only considering the first-order approximation of the mass ratio $m/M$, we obtain a linear motion equation in the reference frame of the observer as a Brownian particle. Based on this equivalent equation, we get the Hamiltonian at equilibrium. Finally, using canonical ensemble method, we define a new entropy that is similar to the Kolmogorov-Sinai entropy. Further, we present an analytic expression of the relationship between the diffusion coefficient $D$ and the entropy $S$ in the thermal equilibrium, that is to say, $D =\frac{\hbar}{eM} \exp{[S/(k_Bd)]}$, where $d$ is the dimension of the space, $k_B$ the Boltzmann constant, $\hbar $ the reduced Planck constant and $e$ the Euler number. This kind of scaling relation has been well-known and well-tested since the similar one for single component is firstly derived by Rosenfeld with the expansion of volume ratio.

In this work we identify combinations of technological activities that signal the presence local capabilities in a country to successfully export a product. We use country-level patent and trade data to generate a multi-layer network, and we apply maximization of entropy to generate synthetic data to effectively divide signal from noise. We show that in several sectors the signal far exceed the noise. Our exercise provides robust evidence of the presence of synergies between technologies to explain trade performances in specific markets. This can be highly useful for policy makers, to inform industrial and innovation policies.

We consider the maximum entropy Markov chain inference approach to characterize the collective statistics of neuronal spike trains, focusing on the statistical properties of the inferred model. We review large deviations techniques useful in this context to describe properties of accuracy and convergence in terms of sampling size. We use these results to study the statistical fluctuation of correlations, distinguishability and irreversibility of maximum entropy Markov chains. We illustrate these applications using simple examples where the large deviation rate function is explicitly obtained for maximum entropy models of relevance in this field.