Here we investigate how the local properties of particles in a thermal bath may influence the thermodynamics of the bath, and consequently alter the statistical mechanics of subsystems that comprise the bath. We are guided by the theory of small-system thermodynamics, which is based on two primary postulates: that small systems can be treated self-consistently by coupling them to an ensemble of similarly small systems, and that a large ensemble of small systems forms its own thermodynamic bath. We adapt this “nanothermodynamics” to investigate how a large system may subdivide into an ensemble of smaller subsystems, causing internal heterogeneity across multiple size scales. For the semi-classical ideal gas, maximum entropy favors subdividing a large system of “atoms” into an ensemble of “regions” of variable size. The mechanism of region formation could come from quantum exchange symmetry that makes atoms in each region indistinguishable, while decoherence between regions allows atoms in separate regions to be distinguishable by their distinct locations. Combining regions reduces the total entropy, as expected when distinguishable particles become indistinguishable, and as required by a theorem in quantum mechanics for sub-additive entropy. Combining large volumes of small regions gives the usual entropy of mixing for a semi-classical ideal gas, resolving Gibbs paradox without invoking quantum symmetry for atoms that may be meters apart. Other models presented here are based on Ising-like spins, which are solved analytically in one dimension. Focusing on the bonds between the Ising-like spins we find similarity in the equilibrium properties of a two-state model in the nanocanonical ensemble and a three-state model in the canonical ensemble. Thus, emergent phenomena may alter the thermal behavior of microscopic models, and the correct ensemble is necessary for fully-accurate predictions. Another result using Ising-like spins involves simulations that include a nonlinear correction to Boltzmann’s factor, which mimics the statistics of indistinguishable states by imitating the dynamics of spin exchange on intermediate lengths. These simulations exhibit 1/f-like noise at low frequencies (f), and white noise at higher f, similar to equilibrium thermal fluctuations found in many materials.

The aim of this articles is to investigate the entropy optimization in unsteady MHD flow Darcy-Forchheimer nanofluids towards a stretchable sheet. The surface we tend to think about is porous and stretchy under acceleration. Flow occurs due to the stretching of the surface. Four distinct types of aqueous nanostructures are taken in this examination where copper oxide ( ), copper ( ), titanium dioxide ( ) and aluminum oxide ( ) are the nanoparticles. Irreversibility analysis are discussed through second law of thermodynamics. The expression of energy is mathematically designed and discussed according to heat generation / absorption, dissipation, thermal radiation, and joule heating. The nonlinear PDE (partial differential conditions) is first changed to ODE (normal differential conditions) through appropriate similarity variables. Here we used the numerically embedded solution technique to develop a numerical result for the obtained nonlinear flow expression. Influence of various flow parameter velocity temperature distribution and entropy generation are discussed. Reduction occurs in velocity profile for larger porosity and magnetic parameters. An enhancement in entropy generation and temperature distribution is seen for Brinkman number. An opposite effect is noticed in velocity and temperature through solid volume friction.

Despite their obvious differences, biological systems at different scales tend to exhibit common organizational patterns. Unfortunately, these commonalities are usually obscured by the parcelled terminology employed by various scientific sub-disciplines. To explore these commonalities, this papers a comparative study of diverse applications of the maximum entropy principle, ranging from amino acids up to societies. By presenting these studies under a common language, this paper establishes a unified view over seemingly highly heterogeneous biological scenarios.

Information-theoretically provable unique true random numbers, which cannot be correlated or controlled by an attacker, can be generated based on quantum measurement of vacuum state and universal-hashing randomness extraction. Quantum entropy in the measurements decides the quality and security of the random number generator (RNG). At the same time, it directly determines the extraction ratio of true randomness from the raw data, in other words, it obviously affects quantum random bits generating rate. In this work, we commit to enhancing quantum entropy content in the vacuum noise based quantum RNG. We have taken into account main factors in this proposal to establish the theoretical model of quantum entropy content, including the effects of classical noise, the optimum dynamical analog-digital convertor (ADC) range, the local gain and the electronic gain of the homodyne system. We demonstrate that by amplifying the vacuum quantum noise, abundant quantum entropy is extractable in the step of post-processing even classical noise excursion, which may be deliberately induced by an eavesdropper, is large. Based on the discussion and the fact that the bandwidth of quantum vacuum noise is infinite, we propose large dynamical range and moderate TIA gain to pursue higher local oscillator (LO) amplification of vacuum quadrature and broader detection bandwidth in homodyne system. High true randomness extraction ratio together with high sampling rate is attainable. Experimentally, an extraction ratio of true randomness of 85.3% is achieved by finite enhancement of the laser power of the LO when classical noise excursions of the raw data is obvious.

The Schelling model of segregation allows for a general description of residential movements in an environment modeled by a lattice. The key factor is that occupants change positions until they are surrounded by a designated minimum number of similarly labeled residents. An analogy to the Ising model has been made in previous research, primarily due the assumption of state changes being dependent upon the adjacent cell positions. This allows for concepts produced in statistical mechanics to be applied to the Schelling model. Here is presented a methodology to estimate the entropy of the model for different states of the simulation. A Monte Carlo estimate is obtained for the set of macrostates defined as the different aggregate homogeneity satisfaction values across all residents, which allows for the entropy value to be produced for each state. This produces a trace of the estimated entropy value for the states of the lattice configurations to be displayed with each iteration. The results show that the initial random placements of residents have larger entropy values than the final states of the simulation when the overall homogeneity of the residential locality is increased.

This paper describes a proposed fractional filter-based multi-scale underwater and hazy image enhancement algorithm. The proposed system combines a modified global contrast operator with fractional order-based multi-scale filters used to generate several images, which are fused based on entropy and standard deviation. The multi-scale-global enhancement technique enables fully adaptive and controlled colour correction and contrast enhancement without over exposure of highlights when processing hazy and underwater images. This in addition to illumination/reflectance estimation coupled with global and local contrast enhancement. The proposed algorithm is also compared with the most recent available state-of-the-art multi-scale fusion de-hazing algorithm. Experimental comparisons indicate that the proposed approach yields better edge and contrast enhancement results without halo effect, colour degradation and is faster and more adaptive than all other algorithms from the literature.

We consider the maximum entropy Markov chain inference approach to characterize the collective statistics of neuronal spike trains, focusing on the statistical properties of the inferred model. We review large deviations techniques useful in this context to describe properties of accuracy and convergence in terms of sampling size. We use these results to study the statistical fluctuation of correlations, distinguishability and irreversibility of maximum entropy Markov chains. We illustrate these applications using simple examples where the large deviation rate function is explicitly obtained for maximum entropy models of relevance in this field.

Single valued neutrosophic set has king power to express uncertainty characterized by indeterminacy, inconsistency and incompleteness. Most of the existing single valued neutrosophic cross entropy bears an asymmetrical behavior and produce an undefined phenomenon in some situations. In order to deal with these disadvantages, we propose a new cross entropy measure under single valued neutrosophic set (SVNS) environment namely SN- cross entropy and prove its basic properties. Also we define weighted SN-cross entropy measure and investigate its basic properties. We develop a new multi attribute group decision making (MAGDM) strategy for ranking of the alternatives based on the proposed weighted SN-cross entropy measure between each alternative and the ideal alternative. Finally, a numerical example of MAGDM problem of investment potential is solved to show the validity and efficiency of proposed decision making strategy. We also present comparative anslysis of the obtained result with the results obtained form the existing solution strategies in the solution.

We explored the dynamics of the two interacting information systems. We show that for the Markovian marginal systems the driving force for information dynamics is determined by both the information landscape and information flux. While the information landscape can be used to construct the driving force to describe the equilibrium time reversible information system dynamics, the information flux can be used to describe the nonequilibrium time-irreversible behaviours of the information system dynamics. The information flux explicitly breaks the detailed balance and is a direct measure of the degree of the nonequilibriumness or time irreversibility. We further demonstrate that the mutual information rate between the two subsystems can be decomposed into the equilibrium time-reversible and nonequilibrium time-irreversible parts respectively. This decomposition of the mutual information rate (MIR) corresponds to the information landscape-flux decomposition explicitly when the two subsystems behave as Markov chains. Finally, we uncover the intimate relationship between the nonequilibrium thermodynamics in terms of the entropy production rates and the time-irreversible part of the mutual information rate. We found that this relationship and MIR decomposition still hold for the more general stationary and ergodic cases. We demonstrate the above features with two examples of the bivariate Markov chains.

Predicting the outcome of a future game between two National Basketball Association (NBA) teams poses a challenging problem of interest to statistical scientists as well as the general public. In this article, we formalize the problem of predicting the game results as a classification problem and apply the principle of maximum entropy to construct NBA maximum entropy (NBAME) model that fits to discrete statistics for NBA games, and then predict the outcomes of NBA playoffs by the NBAME model. The best NBAME model is able to correctly predict the winning team 74.4 percent of the time as compared to some other machine learning algorithms which is correct 69.3 percent of the time.

Study background and aims: Laparoscopic cholecystectomy is one of the most frequently performed interventions in departments of general surgery. One of the most important aims in achieving perioperative stability of these patients is diminishing the impact of general anesthesia on the hemodynamic stability and the optimization of anesthetic drug doses based on the individual clinical profile of each patient. The objective of this study is the evaluation of the impact monitoring the depth of anesthesia through Entropy (state entropy – SE and response entropy -RE) has on the hemodynamic stability and on the doses of volatile anesthetic. Material and Methods: This is a prospective, observational, randomized, monocentric study carried out between January 2019 and December 2019 in the Clinic of Anesthesia and Intensive Care from the “Pius Brînzeu” Emergency County Hospital in Timișoara, Romania. The patients included in the study were divided in two study groups; patients in Group A (target group) received multimodal monitoring that included monitoring of standard parameters and of Entropy (SE and RE), while patients in Group B (control group) only received standard monitoring. Anesthetic dose in group A were optimized to achieve a target entropy of 40-60. Results: 68 patients met the inclusion criteria and were allocated to one of the two study groups, Group A (N=43) and Group B (N=25). There were no statistically significant differences identified between the two groups for both demographical and clinical data (p>0.05). Statistically significant differences have been identified for the number of hypotensive episodes (p = 0.011, 95% CI 0.1851 to 0.7042) and for the number of episodes of bradycardia (p < 0.0001, 95% CI 0.3296 to 0.7923). Moreover, there was a significant difference in the Sevoflurane consumption between the two study groups (p = 0.0498, 95% CI -0.3942 to 0.9047). Conclusions: The implementation of the multimodal monitoring protocol that includes the standard parameters and the measurement of Entropy for determining the depth of anesthesia (SE and RE) lead to a considerable improvement in perioperative hemodynamic stability. Optimizing the doses of anesthetic drugs based on the individual clinical profile of each patient leads to a considerable decrease in drug consumption as well as to a lower incidence of hemodynamic side-effects.

Random variations in microelectronic circuit structures represent the source of entropy for physical unclonable functions (PUFs). In this paper, we investigate delay variations that occur through the routing network and switch matrices of a field programmable gate array (FPGA). The delay variations are isolated from other components of the programmable logic, e.g., Look-up tables (LUTs), flip-flops (FFs), etc. using a feature of Xilinx FPGAs called dynamic partial reconfiguration (DPR). A set of partial designs are created that fix the placement of a time-to-digital converter (TDC) and supporting infrastructure to enable the path delays through the target interconnect and switch matrices to be extracted by subtracting out common-mode delay components. Delay variations are analyzed in the different levels of routing resources available within FPGAs, i.e., local routing and across chip routing. Data is collected from a set of Xilinx Zynq 7010 devices, and a statistical analysis of within-die variations in delay through a set of the randomly-generated and hand-crafted interconnects is presented.

The modern textbook analysis of the thermal state of photons inside a three-dimensional reflective cavity is based on the three quantum numbers that characterize photon’s energy eigenvalues coming out when the boundary conditions are imposed. The crucial passage from the quantum numbers to the continuous frequency is operated by introducing a three dimensional continuous version of the three discrete quantum numbers, that leads to the energy spectral density and to the entropy spectral density. This standard analysis obscures the role of the multiplicity of energy eigenvalues associated to the same eigenfrequency. In this paper we review the past derivations of Bose’s entropy spectral density and present a new analysis of energy spectral density and entropy spectral density based on the multiplicity of energy eigenvalues. Our analysis explicitly defines the eigenfrequency distribution of energy and entropy and uses it as a starting point for the passage from the discrete eigenfrequencies to the continuous frequency.

The paper analyzes the probability distribution of the occupancy numbers and the entropy of a system at the equilibrium composed by an arbitrary number of non-interacting bosons. The probability distribution is derived both by tracing out the environment from a bosonic eigenstate of the union of environment and system of interest (the empirical approach) and by tracing out the environment from the mixed state of the union of environment and system of interest (the Bayesian approach). In the thermodynamic limit, the two coincide and are equal to the multinomial distribution. Furthermore, the paper proposes to identify the physical entropy of the bosonic system with the Shannon entropy of the occupancy numbers, fixing certain contradictions that arise in the classical analysis of thermodynamic entropy. Finally, by leveraging an information-theoretic inequality between the entropy of the multinomial distribution and the entropy of the multivariate hypergeometric distribution, Bayesianism of information theory and empiricism of statistical mechanics are integrated into a common ''infomechanical'' framework.

In this paper, we investigate the cumulative historical entropy of the lifetime of an n-component coherent system under the assumption that all system components have failed at time t. Using the system signature, we can calculate the cumulative historical entropy of the system’s lifespan, which is an important aspect in determining a system’s predictability. This research produces a number of significant results, including expressions, bounds, and ordering aspects for this measure. In addition, we offer a method for finding a preferred system based on cumulative Kullback-Leibler discriminating information that is closely related to the parallel system. These findings provide important insights into the predictability and dependability of coherent systems, emphasizing the importance of this field.

Living beings are composite thermodynamic systems in non-equilibrium conditions. Within this context, there are a number of thermodynamic potential differences (forces) between them and the surroundings, as well as internally. These forces lead to flows, which, ultimately, are essential to life itself. Living beings are under the pressures of natural selection, thus are biological flows as well. At the same time, the maintenance of homeostatic conditions, the tenet of physiology, demands regulation of these flows by control of variables. However, due to the very nature of these systems, regulation of flows and control of variables become entangled in closed loops. Therefore, the search for adaptation in flows takes a different path than the search for adaptation in morphological traits. Being at the roots of transfer processes, thermodynamic criteria turn out to be as natural physical candidates. Likewise, being at the roots of physiology, control turns out to be as a natural biological candidate in that path. Here we show how to combine entropy generation, with respect to a generalized process, and control of parameters (in such a generalized process) in order to create a criterium of optimal ways to regulate changes in generalized flows.

We consider open non-twist Hamiltonian systems represented by an area-preserving two-dimensional map describing incompressible planar flows in the reference frame of a propagating wave, and possessing exits through which map orbits can escape. The corresponding escape basins have a fractal nature that can be revealed by the so-called basin entropy, a novel concept developed to quantify final-state uncertainty in dynamical systems. Since the map considered violates locally the twist condition, there is a shearless barrier that prevents global chaotic transport. In this paper we show that it is possible to determine the shearless barrier breakup by considering the variation of the escape basin entropy with a tunable parameter.

Starting with a particle in the cube system, we investigate the exotic possibility that the quantum numbers (n_x,n_y,n_z) satisfy the Markov equation. We find that the proposed particle in the Markov-cube system follows from a non-classical information entropic space by the quantum potential Q. We study the classical correspondents of the proposed particle in the Markov-cube system. According to our proposition, this particle identified by detailed measurements of the confinement particle-energy levels is an artifact or occurs in nature.

We derive some Quantum Central Limit Theorems for expectation values of macroscopically coarse-grained observables, which are functions of coarse-grained hermitean operators consisting of non-commuting variables. Thanks to the hermicity constraints, we obtain positive-definite dis- tribution for the expectation values of observables. These probability distributions open some pathway for an emergence of classical behaviours in the limit of in nitely large number of identical and non-interacting quantum constituents. This is in contradistinction to other mechanisms of classicality emergence due to environmental decoherence and consistent histories. The probabil- ity distributions so derived also enable us to evaluate the nontrivial time-dependence of certain differential entropies.

Controlled deposition of CoCrFeNiMo0.2 high entropy alloy (HEA) micro-particles was achieved using laser induced forward transfer (LIFT). Ultra-short laser pulses, 230 fs of 515 nm wavelength, were tightly focused into ∼ 2.4 μm focal spots on the ∼50 nm thick plasma-sputtered films of CoCrFeNiMo0.2. The HTA films were transferred onto glass substrates by magnetron sputtering in vacuum (10−8 atm) from the thermal spray coated substrates. The absorption coefficient of CoCrFeNiMo0.2 α ≈ 6 × 105 cm−1 was determined at 600 nm wavelength. The real and imaginary parts of refractive index (n + iκ) of HEA were determined from reflectance and transmittance using nano-films.

The high entropy alloy (HEA) of equiatomic composition CrNiFeCoMn and with FCC crystal structure was additively manufactured with a selective laser melting (SLM) process starting from mechanically alloyed powders. The as produced alloy shows finenitride and  phase pre-cipitates, which are Cr-rich and stable up to about 900 K. The precipitates increase in number and dimensions after long-period annealing at 900-1300 K, with a change in the HEA mechanical properties. Higher aging temperatures in furnace, above 1300 K, turn the alloy in a single FCC structure, with disappearance of the nitrate and  phase precipitates inside the grains and at the grain boundaries, but with still a presence of a finer Cr-rich nitride precipitation phase. These re-sults suggest that the as-produced HEA is a supersatured solid solution at low and intermediate temperature with nitrides and  nanostructures.

The service conditions of underground coal mine equipment are poor, and it is difficult to accurately extract the fault characteristics of rolling bearings. In order to better improve the accuracy of fault identification of rolling bearings, a fault detection method based on multiscale permutation entropy and SOA-SVM is proposed. First, the whale optimization algorithm is used to select the modal analysis number K and the penalty factor α of the variational mode decomposition algorithm. Then, the vibration signal of rolling bearings is dissolved according to the optimized variational mode decomposition algorithm, and the multi-scale permutation entropy of the main intrinsic mode function is calculated. Finally, the feature values of the matrix are entered into the SVM algorithm optimized by the seagull optimization algorithm to obtain the classification result. The experimental results based on the published rolling bearing datasets of Western Reserve University show that the identification success rate of the proposed method can reach 98.75%. The fault detection of the rolling bearings can be completed accurately and efficiently.

Synergy, emerges from synchronized reciprocal positive feedback loops between a network of diverse actors. For this process to proceed, compatible information from different sources synchronically coordinates the actions of the actors resulting in a nonlinear increase in the useful work or potential energy the system can manage. In contrast noise is produced when incompatible information is mixed. This synergy produced from the coordination of different agents achieves non-linear gains in free energy and in information (negentropy) that are greater than the sum of the parts. The final product of new synergies is an increase in individual autonomy of an organism that achieves increased emancipation from the environment with increases in productivity, efficiency, capacity for flexibility, self-regulation and self-control of behavior through a synchronized division of ever more specialized labor. Examples that provide quantitative data for this phenomenon are presented. Results show that increases in free energy density require decreases in entropy density. This is proposed as a law of thermodynamics.

The entropy models have been recently adopted in many studies to evaluate the distribution of the shear stress in circular channels. However, the uncertainty in their predictions and their reliability remains an open question. We present a novel method to evaluate the uncertainty of four popular entropy models, including Shannon, Shannon-Power Low (PL), Tsallis, and Renyi, in shear stress estimation in circular channels. The Bayesian Monte-Carlo (BMC) uncertainty method is simplified considering a 95% Confidence Bound (CB). We developed a new statistic index called as FREE_opt-based OCB (FOCB) using the statistical indices Forecasting Range of Error Estimation (FREE) and the percentage of observed data in the CB (N_in), which integrates their combined effect. The Shannon and Shannon PL entropies had close values of the FOCB equal to 8.781 and 9.808, respectively, had the highest certainty in the calculation of shear stress values in circular channels followed by traditional uniform flow shear stress and Tsallis models with close values of 14.491 and 14.895, respectively. However, Renyi entropy with much higher values of FOCB equal to 57.726 has less certainty in the estimation of shear stress than other models. Using the presented results in this study, the amount of confidence in entropy methods in the calculation of shear stress to design and implement different types of open channels and their stability is determined.

Ultraviolet light incident on organic material can initiate its spontaneous dissipative structuring into chromophores which can catalyze their own replication. This may have been the case for one of the most ancient of all chromophores dissipating the Archean UVC photon flux, the nucleic acids. Oligos of nucleic acids with affinity to particular amino acids which foment UVC photon dissipation would have been selected through non-equilibrium thermodynamic imperatives which favor entropy production. Indeed, we show here that those amino acids with characteristics most relevant to fomenting UVC photon dissipation are precisely those with greatest chemical affinity to their codons or anticodons. Entropy production could thus provide an explanation for the accumulation of information in nucleic acids relevant to the dissipation of the externally imposed thermodynamic potentials. The accumulation of information in this manner provides a link between evolution and entropy production.

The Maximum Entropy Theory of Ecology, or METE, is a theoretical framework of macroecology that makes a variety of realistic ecological predictions about how species richness, abundance of species, metabolic rate distributions, and spatial aggregation of species interrelate in a given region. In the METE framework, "ecological state variables" (representing total area, total species richness, total abundance, and total metabolic energy) describe macroecological properties of an ecosystem. METE incorporates these state variables into constraints on underlying probability distributions. The method of Lagrange multipliers and maximization of information entropy (MaxEnt) lead to predicted functional forms of distributions of interest. We demonstrate how information entropy is maximized for the general case of a distribution, which has empirical information that provides constraints on the overall predictions. We then show how METE’s two core functions are derived. These functions, called the "Spatial Structure Function" and the "Ecosystem Structure Function" are the core pieces of the theory, from which all the predictions of METE follow (including the Species Area Distribution, the Species Abundance Distribution, and various metabolic distributions). Primarily, we consider the discrete distributions predicted by METE.We also explore the parameter space defined by the METE’s state variables and Lagrange multipliers. We aim to provide a comprehensive resource for ecologists who want to understand the derivations and assumptions of basic mathematical structure of METE.

In this article, the quality of water in the reservoirs of Lake Arpi, Lake Yerevan, Akhuryan, Azat, Aparan and Kechut was estimated with usage of the Armenian Water Quality Index. It was established that in the waters of reservoirs the the maximum permissible concentration of copper, vanadium, aluminum, chromium, manganese, iron, NH4+ and NO2- regularly increases. The following computational algorithm was used for determination of the Armenian Water Quality Index values: to determine the number of cases of MPC excess of i-substance or indicator of water –n; to estimate the total amount of cases of the maximum permissible concentration (N) – N = ∑n; to computes log2N, nlog2n and ∑nlog2n; to determine geoecological syntropy (I) and entropy (H): I = ∑ nlog2n/N and H = log2N – I. Then, Geo-Ecological Evolving Organized index index was determined: G = H/I. Further, the total amount multiplicity of MAC exceedances was estimated: (M) - M=∑m and log2M was computed. Finally, Armenian Water Quality Index was obtained: AWQI = G + 0.1log2M. It was established that the Armenian Water Qquality Index showed a linear dependence on the Water Contamination Index, the Specific Combinatory Water Quality Index, the Geo-Ecological Evolving Organized index and an inverse dependence on the Canadian Water Quality Index.

Confidence interval of is an interval corresponding to a specified confidence and including the true value. It can be used to describe the precision of a statistical quantity and quantify its uncertainty. Although the principle of maximum entropy (POME) has been used for a variety of applications in hydrology, the confidence intervals of the POME quantile estimators have not been available. In this study, the calculation formulas of asymptotic variances and confidence intervals of quantiles based on POME for Gamma, Pearson type 3 (P3) and Extreme value type 1 (EV1) distributions were derived. Monte Carlo Simulation experiments were performed to evaluate the performance of derived formulas for finite samples. Using four data sets for annual precipitation at the Weihe River basin in China, the derived formulas were applied for calculating the variances and confidence intervals of precipitation quantiles for different return periods and the results were compared with those of the methods of moments (MOM) and of maximum likelihood (ML) method. It is shown that POME yields the smallest standard errors and the narrowest confidence intervals of quantile estimators among the three methods, and can reduce the uncertainty of quantile estimators

In this paper, we revisit the q-states clock model for small systems. We present results for the thermodynamics of the q-states clock model from $q=2$ to $q=20$ for small square lattices $L \times L$, with L ranging from $L=3$ to $L=64$ with free-boundary conditions. Energy, specific heat, entropy and magnetization are measured. We found that the Berezinskii-Kosterlitz-Thouless (BKT)-like transition appears for $q>5$ regardless of lattice size, while the transition at $q=5$ is lost for $L<10$; for $q\leq 4$ the BKT transition is never present. We report the phase diagram in terms of $q$ showing the transition from the ferromagnetic (FM) to the paramagnetic (PM) phases at a critical temperature T$_1$ for small systems which turns into a transition from the FM to the BKT phase for larger systems, while a second phase transition between the BKT and the PM phases occurs at T$_2$. We also show that the magnetic phases are well characterized by the two dimensional (2D) distribution of the magnetization values. We make use of this opportunity to do an information theory analysis of the time series obtained from the Monte Carlo simulations. In particular, we calculate the phenomenological mutability and diversity functions. Diversity characterizes the phase transitions, but the phases are less detectable as $q$ increases. Free boundary conditions are used to better mimic the reality of small systems (far from any thermodynamic limit). The role of size is discussed.

The entropy of Boltzmann-Gibbs, as proved by Shannon and Khinchin, is based on four axioms, where the fourth one concerns additivity. The group theoretic entropies make use of formal group theory to replace this axiom with a more general composability axiom. As has been pointed out before, generalized entropies crucially depend on the number of allowed number degrees of freedom $N$. The functional form of group entropies is restricted (though not uniquely determined) by assuming extensivity on the equal probability ensemble, which leads to classes of functionals corresponding to sub-exponential, exponential or super-exponential dependence of the phase space volume $W$ on $N$. We review the ensuing entropies, discuss the composability axiom, relate to the Gibbs' paradox discussion and explain why group entropies may be particularly relevant from an information theoretic perspective.

Meixner's historical remark in 1969 "... it can be shown that the concept of entropy in the absence of equilibrium is in fact not only questionable but that it cannot even be defined...." is investigated from today's insight. Several statements --such as the three laws of phenomenological thermodynamics, the embedding theorem and the adiabatical uniqueness-- are used to get rid of non-equilibrium entropy as a primitive concept. In this framework, Clausius inequality of open systems can be derived by use of the defining inequalities which establish the non-equilibrium quantities contact temperature and non-equilibrium molar entropy which allow to describe the interaction between the Schottky system and its controlling equilibrium environment.

The choice associated with words is a fundamental property of natural languages. It lies at the heart of quantitative linguistics, computational linguistics, and language sciences more generally. Information-theory gives us tools at hand to measure precisely the average amount of choice associated with words—the word entropy. Here we use three parallel corpora—encompassing ca. 450 million words in 1916 texts and 1259 languages—to tackle some of the major conceptual and practical problems of word entropy estimation: dependence on text size, register, style and estimation method, as well as non-independence of words in co-text. We present three main results: 1) a text size of 50K tokens is sufficient for word entropies to stabilize throughout the text, 2) across languages of the world, word entropies display a unimodal distribution that is skewed to the right. This suggests that there is a trade-off between the learnability and expressivity of words across languages of the world. 3) There is a strong linear relationship between unigram entropies and entropy rates, suggesting that they are inherently linked. We discuss the implications of these results for studying the diversity and evolution of languages from an information-theoretic point of view.

This study introduces a method for quantitatively assessing the complexity and predictability of fish behavior in closed systems through the application of information entropy, offering a novel lens to understand how fish adapt to environmental changes. Utilizing simulations rooted in a random walk model for fish movement, we delve into entropy fluctuations under varying environmental conditions, including responses to feeding and external stimuli. Our findings underscore the utility of information entropy in capturing the intricacies of fish behavior, particularly highlighting the synchrony in collective actions and adaptations to environmental shifts. This research not only broadens our comprehension of fish behavior but also paves the way for its application in fields like aquaculture and resource management. Through our analysis, we discovered that smaller grid sizes in simulations capture detailed local fluctuations, while larger grids elucidate general trends, pinpointing a 2.5m grid as optimal for our study. Moreover, changes in swimming speeds and behavioral adaptations during feeding were quantitatively analyzed, with results illustrating significant behavior modifications. Additionally, employing a Gaussian Mixture Model helped to clarify the nuanced changes in fish behavior in response to altered light conditions, demonstrating the layered complexity of fish responses to environmental stimuli. This investigation confirms the efficacy of information entropy as a robust metric for evaluating fish shoal behavior, offering a fresh methodology for ecological and environmental studies, with promising implications for sustainable management practices.

Over the past decade and a half, dynamic functional imaging has revolutionized the neuroimaging field. Since 2009, it has revealed low dimensional brain connectivity measures, has identified potential common human spatial connectivity states, has tracked the transition patterns of these states, and has demonstrated meaningful alterations in these transition and spatial patterns in neurological disorders, psychiatric disorders, and over the course of development. Recently, researchers have begun to analyze this data from the perspective of dynamic system and information theory in the hopes of understanding how these dynamics support less easily quantified processes, such as information processing, cortical hierarchy, and consciousness. Consciousness, in particular, appears to be strongly linked to entropy production in the brain. Little attention has been paid to the effects of psychiatric disease on entropy production in the human brain, however. Even disorders characterized by substantial changes in conscious experience have not been widely analyzed from this perspective. We begin to rectify this by examining the complexity of subject trajectories in state space through the lens of information theory. Specifically, we identify a basis for the dynamic functional connectivity state space and track subject trajectories through this space over the course of the scan. The dynamic complexity of these trajectories is assessed along each dimension of the proposed basis space. Using these estimates, we demonstrate that schizophrenia patients display substantially simpler trajectories than demographically matched healthy controls, and that this drop in complexity concentrates along specific dimensions. We also demonstrate that entropy generation in at least one of these dimensions is linked to cognitive performance. Overall, results suggest great value in applying dynamic systems theory to problems of neuroimaging and reveal a substantial drop in the complexity of schizophrenia patients’ brain function.

The fitting and modeling of skewed, complex, symmetric, and asymmetric datasets is an exciting research topic in many fields of applied sciences, notably lifetime, medical, and financial sciences. The Heavy tailed Nadarajah Haghighi model is introduced by compounding the heavy tailed family and Nadarajah Haghighi distribution in this paper. The so obtained model has three parameters accounting for the scale and shape of the distribution. The proposed distribution's fundamental characteristics such as probability density, cumulative distribution, hazard rate, and survival functions are provided, and several key statistical properties are established, and several entropy information measures are proposed. The estimation of model parameter is performed via the ML procedure. Further, different simulation experiments are conducted to demonstrate the performance of proposed estimator’s using some measure, like the average estimate, the average bias, and associated mean square error. Finally, we are applied our proposed model to analyze three different real datasets. In our illustration, we are compared the practicality of the recommended model with several well-known competing models.

Sentiment analysis plays a crucial role in understanding customer feedback, guiding product development, and informing business decisions. This paper introduces term sentiment entropy (TSE), a novel weighting method that leverages the distribution of sentiment labels associated with words to enhance text classification accuracy. TSE complements traditional TF-IDF techniques by capturing the nuances of sentiment variation across different contexts. Experiments across diverse public datasets demonstrate TSE's potential to improve sentiment analysis performance, especially in capturing subtle sentiment shifts and adapting to specific domains. While computational cost and label quality pose challenges, TSE offers a promising avenue for refining sentiment analysis and opening new research frontiers.

In this work, satellite data from the Clouds and Earth’s Radiant Energy System (CERES) and Moderate Resolution Imaging Spectroradiometer (MODIS) instruments is analyzed to determine how the global absorbed sunlight and global entropy generation rate have changed during the time period from 2002 to 2023. The data is used to test hypotheses derived from the Maximum Power Principle (MPP) and Maximum Entropy Production Principle (MEP) about the evolution of earth’s surface and atmosphere. The results indicate that the amount of absorbed sunlight has increased over the last 20 years but rising surface temperatures have caused the entropy generation rate to remain approximately constant despite that decrease in albedo. The results are simpler to explain using the MPP but do not completely rule out the MEP. Given the acceptance of the MPP or MEP, some extensions and nuances are discussed.

Sustainable development of our society demands recycling of metallic wastes which may contain a variety of metallic impurities. Thus, it is desirable to develop a ‘universal’ structure, such as an amorphous alloy tolerating high concentrations of metallic pollutants. We performed ab initio molecular dynamics simulations to manufacture a novel multicomponent amorphous alloy of twenty elements (20e-HEAA). Analysis reveals both topological and chemical compositional short-range ordering in the obtained 20e-HEAA and formation of B-B clusters. Electronic structure calculations reveal the metallic nature of the amorphous alloy with its Fermi level falling in a valley in the density of states. Moreover, the Zn 3d and Cd 4d electrons exhibit a localized nature and thus, should be excluded from the valence electron concentration (VEC) analysis in the study of high-entropy alloys. The information obtained here is helpful to get insight into multicomponent high entropy materials, especially multicomponent high-entropy amorphous alloys as potential circular metals.

This study concerns calculation and comparison of Fe, Co, Ni and Cu deposition rates in tungsten codeposition process based on electrodeposition of numerous tungsten alloys. 8 different tungsten alloys containing from 2 to 5 metals were electrodeposited in constant conditions in order to compare exact reduction rates. Calculated rates enabled control of the alloy composition precise enough to obtain a high-entropy WFeCoNiCu alloy with well-balanced composition. Introduction of copper to form the quinternary alloy was found to catalyze the whole process, increasing deposition rates of all components of the high-entropy alloy.

We review our theory of interdependence applied to autonomous human-machine teams, with which we have made several generalizations based on theory that have led to new discoveries, compared to social science which is struggling to break free of its validation crisis, but also has no generalizations to new discoveries with human teams, let alone to human-machine teams. In this invited article, based around the stability of a team, of our discoveries, we review the uncertainty between a team's structure and its performance, our first finding. We generalize that finding to deception, vulnerability, innovation and fittedness. From there, our next generalization is to the quantum likeness of interdependence and quantum mechanics; we move on to Shannon holes, knowledge, and conclude with the value of debate and the need for boundaries to contain debate, to reduce interference, and to protect states of interdependence. After the introduction, we extend our model in Section 2 to energy and time, and we close with a brief review of innovation and future plans.

In this paper, we propose a method for assessing the effectiveness of entropy features using several chaotic mappings. We anlyze fuzzy entropy (FuzzyEn) and neural network entropy (NNetEn) on four discrete mappings: the logistic map, the sine map, the Planck map, and the two-memristor-based map, with a base length time series of 300 elements. FuzzyEn is shown to have improved global efficiency (GEFMCC) in the classification task compared to NNetEn. At the same time, there are local areas of the time series dynamics in which the classification efficiency NNetEn is higher than FuzzyEn. The results of using horizontal visibility graphs (HVG) instead of the raw time series are also shown. GEFMCC decreases after HVG time series transformation, but there are local areas of the time series dynamics in which the classification efficiency increases after including the HVG. The scientific community can use the results to explore the efficiency of entropy-based classification of time series.

The main issue in this work is to study limit functions necessary for the reliability assessment of the structural steel with the use of the relative entropy apparatus. This would be done using a few different mathematical theories relevant to this relative entropy, namely those proposed by Bhattacharyya, Kullback-Leibler, Jeffreys, and Hellinger. Probabilistic analysis in the presence of uncertainty in material characteristics would be delivered using three different numerical strategies – Monte-Carlo simulation, stochastic perturbation method as well as the semi-analytical approach. All these methods are based on the Weighted Least Squares Method approximations of the structural response functions versus the given uncertainty source and they would allow efficient determination of the first two probabilistic moments of the structural responses including stresses, displacements, and strains. The entire computational implementation would be delivered using the Finite Element Method system ABAQUS and computer algebra program MAPLE, where relative entropies, as well as polynomial response functions, would be determined. This study would demonstrate that the relative entropies may be efficiently used in reliability assessment close to the widely engaged First Order Reliability Method (FORM).

A new utilization of entropy in the context of buckling is presented. The novel concept connecting strain energy and entropy for a pin-ended strut is derived. This concept rationalizes the ranking of buckling modes based on strain energy under the assumption of given entropy. By assigning identical entropy to all buckling modes, they can be ranked according to their deformation energy. Conversely, with identical strain energy assigned to all modes, ranking according to entropy is possible. Decreasing entropy was found to represent the scaling factors of buckling modes that coincide with the measurement of initial out-of-straightness imperfections in IPE160 beams. Applied to steel plane frames, scaled buckling modes can be used to model initial imperfections. It is demonstrated that the entropy (scale factor) for given energy roughly decreases with the inverse square of the mode index. For practical engineering, the study presents the possibility of using scaled buckling modes of steel plane frames to model initial geometric imperfections. Entropy proves to be a valuable complement to strain energy in structural mechanics.

This paper proposes a non-extensive entropy econometric technique to predict energy efficiency at province (NUT-2) level based on imperfect knowledge of the national overall efficiency in the sectors of industry, transport, households and services. The model is applied to the polish case. As acknowledged in recent literature, non-extensive entropy model should remain a valuable device for econometric modelling even in the case of low frequency series since outputs provided by the Gibbs-Shannon entropy approach correspond to the Tsallis entropy limiting case of the Gaussian law when the Tsallis q-parameter converges to unity. Therefore, we set up a q-Tsallis-Kullback-Leibler entropy criterion function with a priori consistency moment and model data constraints, including province energy intensity (known with uncertainty), regional climate differentiation and regular conditions. The model outputs continue to conform to empirical expectations. In spite of the close to unity q-Tsallis parameter, this Tsallis related approach reflects higher stability for parameter computation in comparison with the Shannon-Gibbs entropy econometrics technique. The proposed technique can be applied in different EU countries and elsewhere for example in the context of experimental official statistics.

For a system that turns out to be inactive in time t, the past entropy is considered as an uncertainty measure for the past lifetime distribution. In this study, we consider a coherent system that includes n components and has the property that all the components of the system have failed at time t. To assess the predictability of the coherent system’s lifetime, we use the system’s signature to determine the Rényi entropy of its past lifetime. We study several analytical results, including expressions, bounds, and order properties for this measure.

Models with age as a variable but actual dynamics invariant under age structure allow use of MaxEnt to predict uniform age structure. Interpretations include a major role for accepting randomness as a causal principle in ecology (in the face of ignorance, in a further interpretative stance).

We exploit the properties of complex time to obtain an analytical relationship based on considerations of causality between the two conserved quantities of a system’s Hamiltonian and its Entropy Production. In natural units, when complexified, the one is simply the Wick-rotated complex-conjugate of the other. A Hilbert transform relation is constructed in the formalism of Quantitative Geometrical Thermodynamics which enables system irreversibility to be handled analytically within a framework that unifies both the microscopic and macroscopic scales, and which also unifies the treatment of both reversibility and irreversibility as complementary parts of a single physical description. In particular the thermodynamics of two unitary entities are considered: the alpha particle which is absolutely stable (that is, trivially reversible with zero entropy production), and a black hole whose absolute disequilibrium (unconditional irreversibility) is characterized by a non-zero entropy production for which we show an alternate derivation confirming our previous one (Universe 7, 2021, 325). The thermodynamics of a canonical decaying harmonic oscillator are also considered. In this treatment the complexification of time also enables a meaningful physical interpretation of both “imaginary time” and “imaginary energy”.

The article is devoted to solving the problem of searching for universal explainable features that can remain explainable for a wide class of objects and phenomena and become an integral part of Explainable AI (XAI). The study is implemented on the example of an applied problem of early diagnostics of plant stress, using Thermal IR (TIR) and HSI, presented by 8 vegetation indices/channels. Each such index was presented by 5 statistical values. A Single-Layer-Perceptron classifier was used as the main instrument. TIR turned out to be the best of the indices in terms of efficiency in the field and sufficient to detect all 7 key days with 100% accuracy. Our study shows also that there are a number of indices, inluding NDVI, and usual color channels Red, Green, Blue, which are close to TIR possibilities in early plant stress detection with 100% accurasy or near, and can be used for wide class of plants and in different conditions their treatment. The stability of the stress classification in our study was maintained when the training set was reduced up to 10% of the dataset volume. The entropy-like feature of (max-min) for any indices/channels have determined as a leadersheep universal high-level explainable feature for the plant stress detection, which used in interaction with some of other statistical features.

Properties of the Voronoi tessellations arising from the random 2D distribution points are reported. We applied the procedure of dividing the sides of Voronoi cells into equal or random parts to Voronoi diagrams generated by a set of randomly placed on the plane points. The dividing points were then used to construct the following Voronoi diagram. Repeating this procedure led to a surprising effect of positional ordering of Voronoi cells, reminiscent of the formation of lamellae and spherulites in linear semi-crystalline polymers and metallic glasses. Thus, we can conclude, that by applying even a simple set of rules to a random set of seeds we introduce order into an initially disordered system. At the same time, the Voronoi entropy showed a tendency to values typical for completely random patterns and did not distinguish the short-range ordering. The Voronoi entropy and the continuous measure of symmetry of the patterns demonstrated the distinct asymptotic behavior, while approaching the close saturation values with the increase of the number of the iteration steps. Voronoi entropy grew, with the number of iterations, whereas the continuous measure of symmetry of the same patterns demonstrated the opposite asymptotic behavior. The Voronoi entropy is not an unambiguous measure of order in the 2D patterns. The more symmetrical patterns may demonstrate the higher values of the Voronoi entropy.

We define degree of dependence of two events A and B in a probability space by using Boltzmann-Shannon entropy function of an appropriate probability distribution produced by these events and depending on one parameter (the probability of intersection of A and B) varying within a closed interval I. The entropy function attains its global maximum when the events A and B are independent. The important particular case of discrete uniform probability space motivates this definition in the following way. The entropy function has a minimum at the left endpoint of I exactly when one of the events and the complement of the other are connected with the relation of inclusion (maximal negative dependence). It has a minimum at the right endpoint of I exactly when one of these events is included in the other (maximal positive dependence). Moreover, the deviation of the entropy from its maximum is equal to average information that carries one of the binary trials defined by A and B with respect to the other. As a consequence, the degree of dependence of A and B can be expressed in terms of information theory and is invariant with respect to the choice of unit of information. Using this formalism, we describe completely the screening tests and their reliability, measure efficacy of a vaccination, the impact of some events from the financial markets to other events, etc. A link is available for downloading an Excel program which calculates the degree of dependence of two events in a sample space with equally likely outcomes.

Despite the remarkable success of Carnot’s heat engine cycle in founding the discipline of thermodynamics two centuries ago, false viewpoints of his use of the caloric theory in the cycle still linger, limiting his legacy. An action revision of the Carnot cycle can correct this, showing that the heat flow powering external mechanical work is compensated internally with configurational changes in the thermodynamic or Gibbs potential of the working fluid, differing in each stage of the cycle quantified by Carnot as caloric. Action (@) is a property of state having the same physical dimensions as angular momentum (mrv=mr2ω). However, this property is scalar rather than vectorial, including a dimensionless phase angle (@=mr2ωδφ). We have recently confirmed with atmospheric gases that their entropy is a logarithmic function of the relative vibrational, rotational and translational action ratios with Planck’s quantum of action ħ. The Carnot principle shows that the maximum rate of work (puissance motrice) possible from the reversible cycle is controlled by the difference in temperature of the hot source and the cold sink, the colder the better. This temperature difference between the source and the sink also controls the isothermal variations of the Gibbs potential of the working fluid, that Carnot identified as reversible temperature-dependent but unequal exchanges in caloric. Importantly, the engine’s inertia ensures that heat from work performed adiabatically in the expansion phase is all restored to the working fluid during the adiabatic recompression, less the net work performed. This allows both the energy and the thermodynamic potential to return to the same values at the beginning of each cycle, a point strongly emphasized by Carnot. Our action revision equates Carnot’s calorique, or the non-sensible heat later described by Clausius as ‘work-heat’ exclusively to negative Gibbs energy (-G) or quantum field energy. This action field complements the sensible energy or vis-viva heat as molecular kinetic motion and its recognition should have significance for designing more efficient heat engines or better understanding of the heat engine powering the Earth’s climates.

In this paper, a novel biocompatible alloy defined as FeMoTaTiZr was obtained and functionalized by hydroxyapatite-based coatings (HAP) in order to increase their biocompatibility, bioactivity, and resistance to corrosion for to be used as bone implants. To obtain the surface with antibacterial properties, the HAP coatings were doped with small amount of Zn. The alloy was prepared using the VAR (Vacuum Arc Remelting) equipment, while the coatings by RF magnetron sputtering method. The EDS analysis confirmed the presence of Ca and P in the case of all developed coatings, having Ca/P or Ca/(P+Zn) ratio of about 1.70 and 1.66, respectively. The XRD and ATR-FTIR investigations confirmed the presence of calcium phosphate phases. The roughness of uncoated substrates increased after coating with HAP, and it was considerably increased by the Zn addition. The electrochemical tests showed that the un-doped HAP exhibited good corrosion behavior, while Zn doped HAP coatings have a high dissolution rate in fetal bovine serum, being more proper as a biodegradable material.

In recent years, the individualized demand of customers brings small batches and diversification of orders towards enterprises. The application of enabling technologies in factory, such as the Industrial Internet of Things (IIoT) and Cloud Manufacturing (CMfg), enhances the ability of customer requirement automatic elicitation and the manufacturing process control. The job shop scheduling problem with random job arrival time dramatically increases the difficulty in process management. Thus, how to collaboratively schedule the production and logistics resources in the shop floor is very challenging, and it has a fundamental and practical significance of achieving the competitiveness for an enterprise. To address this issue, the real-time model of production and logistics resources is built firstly. Then, the task entropy model is built based on the task information. Finally, the real-time self-adaption collaboration of production and logistics resources is realized. The proposed algorithm is carried out based on a practical case to evaluate its effectiveness. Experimental results show that our proposed algorithm outperforms three existing algorithms.

We present a general process for the halting problem, valid regardless of the time and space computational complexity of the decision problem. It can be interpreted as the maximization of entropy for the utility function of a given Shannon-Kolmogorov-Bernoulli process. Applications to non-polynomials problems are given. The new interpretation of information rate proposed in this work is a method that models the solution space boundaries of any decision problem (and non polynomial problems in general) as a communication channel by means of Information Theory. We described a sort method that order objects using the intrinsic information content distribution for the elements of a constrained solution space - modeled as messages transmitted through any communication systems. The limits of the search space are defined by the Kolmogorov-Chaitin complexity of the sequences encoded as Shannon-Bernoulli strings. We conclude with a discussion about the implications for general decision problems in Turing machines.

With the development of computer science and software engineering, software becomes more and more complex. Traditional software reliability assurance techniques including software testing and evaluation can't ensure software reliable execution after being deployed. Software failure prediction techniques based on failure indicators can predict software failures according to abnormal indicator values. The latter can be collected using runtime monitoring techniques. An essential part of this method is finding proper indicators which have strong correlation with software failures. We propose a novel type of indicators in this work named software runtime entropy, which takes both software module execution time and call times into consideration. Three common open source software, grep, flex and gzip are used as study cases for finding the relationships between the indicators and software failures. Firstly, a series of fault injection experiments are conducted on those three software respectively. The decision tree algorithm is used to train those data to build the correlation models between software runtime entropy and software failures. Several common measures in machine learning domains such as accuracy, recall rates, and F-measure are used to evaluate the models. The decision tree models can be used as failure mechanisms to assist the failure prediction work. One can examine the value of runtime entropy and make a warning report when it ranges from the normal interval to abnormal one.

Although most biological processes are characterized by a strong temporal asymmetry, several popular mathematical models neglect this issue. Maximum entropy methods provide a principled way of addressing time irreversibility, which leverages powerful results and ideas from the3literature of non-equilibrium statistical mechanics. This article provides a comprehensive overview of these issues, with a focus in the case of spike train statistics. We provide a detailed account of the5mathematical foundations and work out examples to illustrate the key concepts and results from non-equilibrium statistical mechanics

Quantum chaos is presented as a paradigm of information processing by dynamical systems at the bottom of the range of phase-space scales. Starting with a brief review of classical chaos as entropy flow from micro- to macro-scales, I argue that quantum chaos came as an indispensable rectification, removing inconsistencies related to entropy in classical chaos: Bottom-up information currents require an inexhaustible entropy production and a diverging information density in phase space, reminiscent of Gibbs' paradox in Statistical Mechanics. It is shown how a mere discretization of the state space of classical models already entails phenomena similar to hallmarks of quantum chaos, and how the unitary time evolution in a closed system directly implies the “quantum death” of classical chaos. As complementary evidence, I discuss quantum chaos under continuous measurement. Here, the two-way exchange of information with a macroscopic apparatus opens an inexhaustible source of entropy and lifts the limitations implied by unitary quantum dynamics in closed systems. The infiltration of fresh entropy restores permanent chaotic dynamics in observed quantum systems. Could other instances of stochasticity in quantum mechanics be interpreted in a similar guise? Where observed quantum systems generate randomness, that is, produce entropy without discernible source, could it have infiltrated from the macroscopic meter? This speculation is worked out for the case of spin measurement.

Uncertainty is the main source of risk of geological hazards in tunnel engineering. Uncertainty information not only affects the accuracy of evaluation results, but also affects the reliability of decision-making schemes. Therefore, it is necessary to evaluate and control the impact of uncertainty on risk. In this study, the problems in existing entropy-hazard model such as inefficient decision-making and failure of decision-making are analysed, and an improved uncertainty evaluation and control process are proposed. Then the tolerance cost, the key factor in the decision-making model, is also discussed. It is considered that the amount of change in risk value (R1) can better reflect the psychological behaviour of decision-makers. Thirdly, common attribute decision models, such as the expected utility-entropy model, are analysed, and then the viewpoint of different types of decision-making issues that require different decision methods is proposed. The well-known Allais paradox is explained by the proposed methods. Finally, the engineering application results show that the uncertainty control idea proposed here is accurate and effective. This research indicates a direction for further research into uncertainty, and risk control, issues affecting underground engineering works.

The existing segmentation-based scene text detection methods mostly need complicated post-processing, and the post-processing operation is separated from the training process, which greatly reduces the detection performance. The previous method, DBNet successfully simplified post-processing and integrated the post-processing into a segmentation network. However, the training process of the model took a long time for 1200 epochs and the sensitivity to texts of various scales was lacking, leading to some text instances being missed. Considering the above two problems, we design the text detection Network with Binarization of Hyperbolic Tangent(HTBNet). First of all, we propose Binarization of Hyperbolic Tangent (HTB), optimized along with which, the segmentation network can expedite the initial convergent speed by reducing the amount of epochs from 1200 to 600. Because features of different channels in the same scale feature map focus on the information of different regions in the image, to better represent the important features of all objects in the image, we devise the Multi-Scale Channel Attention(MSCA). Meanwhile considering that multi-scale objects in the image cannot be simultaneously detected, we propose a novel module named Fused Module with Channel and Spatial(FMCS), which can fuse the multi-scale feature maps from channel and spatial dimension. Finally we adopt cross entropy as the loss function, which measures the difference between predicted values and ground truths. The experimental results show that HTBNet compared with lightweight models has achieved competitive performance and speed on Total-Text(F-measure:86.0%, FPS:30) and MSRA-TD500 (F-measure:87.5%, FPS:30).

The fractal dimension of is identified in this paper. More importantly, the undertaken research has shown how affects the Koch snowflake . The study has demonstrated the existence of negative values of (Koch snowflake), which connects to a considerable number of extremely intriguing mathematical and physical research areas. The information-theoretic impact on the Sierpiniski Gasket dimension , which corresponds to , was treated in a more fundamental way. Notably, the credibility of this current study adds to the existing kThe fractal dimension of is identified in this paper. More importantly, the undertaken research has shown how affects the Koch snowflake . The study has demonstrated the existence of negative values of (Koch snowflake), which connects to a considerable number of extremely intriguing mathematical and physical research areas. The information-theoretic impact on the Sierpiniski Gasket dimension , which corresponds to , was treated in a more fundamental way. Notably, the credibility of this current study adds to the existing knowledge for the information- theoretic fractal dimensions. On another applicative note, this paper offers some potential applications of fractal dimension to smart cities. The investigation of the threshold theorems for and in terms of the triad is part of the next study phase. Additionally, investigating the newly obtained 's corresponding arbitrary Sierpinski Gasket for the first time.applicative note, this paper offers some potential applications of fractal dimension to smart cities. The investigation of the threshold theorems for and in terms of the triad is part of the next study phase. Additionally, investigating the newly obtained 's corresponding arbitrary Sierpinski Gasket for the first time.

Entropy as a mathematical concept is the first of its own kind, and second to none. Barely one or two papers in literature have investigated fractal dimensions of very basic entropies, such as Shannon, Tsallis, and Rényi entropic expressions. This was a thoughtful inspiration to delve into a step forward towards a unified information- theoretic fractal theory. The storytelling of this current paper starts by introducing my third entropy formula, namely Ismail’s entropy, , as a novel generalization to Shannonian entropy with a visionary link to both long- and short-range interactions, (LRIs), (SRIs) respectively. Clearly, this would generate a fourfold unification with statistical mechanics as well as contemporary physics. Hence, this adds more credibility and weight for this study. The fractal dimension of , is identified in this paper. As an essential part of this work, it was influential to spotlight the importance of fractal geometry to space industry as well as education, which is crucial to develop our societies. Thus, some potential fractal applications to CubeSat Technologies and Education are highlighted. So, will the deep search for more ground-breaking research has come to an end. Certainly, not. This was another inspiration to propose new open problems to widen research gates to the scientific community for more research pathways. Consequently, the paper ends with closing remarks combined with some challenging open problems and the next phase of research.

One of the most prevalent brain diseases, epilepsy is characterized by recurring seizures that happen quite frequently. During seizures, a patient suffers uncontrollable muscle contractions that cause loss of motion and balance, which could lead to harm or even death. Establishing an automatic method for warning patients about impending seizures requires extensive research. It is possible to anticipate seizures by analyzing the Electroencephalogram (EEG) signal from the scalp region of the human brain. Time domain-based features such as Hurst exponent (Hur), Tsallis Entropy (TsEn), improved permutation entropy (impe), and amplitude-aware permutation entropy (AAPE) were extracted from EEG signals. In order to diagnose epileptic seizure children from normal children automatically, this study conducted two sessions, in the first session, the extracted features from the EEG dataset were classified using three machine learning (ML)-based models including support vector machine (SVM), K nearest neighbor (KNN), or decision tree (DT), while in the second session, the dataset was classified using three deep learning (DL)-based recurrent neural network (RNN) classifiers including a gated recurrent unit (GRU), long short-term memory (LSTM), and bidirectional (BiLSTM). The EEG dataset obtained from the Neurology Clinic at the Ibn-Rushd Training Hospital. In this regard, detailed explanations and research from the time domain and entropy characteristics show that using GRU, LSTM, and BiLSTM RNN deep learning classifiers on the All−time−entropy fusion feature improves the final classification results.

The SARS-CoV-2 virus, causative agent of COVID-19, is known for its genetic diversity. Virus variants of concern (VOCs) as well as variants of interest (VOIs) are classified by the World Health Organization (WHO) according to their potential risk to global health. This study seeks to enhance the identification and classification of such variants by developing a novel bioinformatics criterion centered on the virus's spike protein (SP1), a key player in host cell entry, immune response, and a mutational hotspot. To achieve this, we pioneered a unique phylogenetic algorithm which calculates EIIP-entropy as a distance measure based on the distribution of the Electron-Ion Interaction Potential (EIIP) of amino acids in SP1. This method offers a comprehensive, scalable, and rapid approach to analyze large genomic data sets and predict the impact of specific mutations. This innovative approach provides a robust tool for classifying emergent SARS-CoV-2 variants into potential VOCs or VOIs. It could significantly augment surveillance efforts and understanding of variant characteristics, while also offering potential applicability to the analysis and classification of other emerging viral pathogens and enhancing global readiness against emerging and re-emerging viral pathogens.

A numerical method using combined detached-eddy simulation (DES) and cavitation model considering the rotation effect is used for unsteady cavitation flow field of the centrifugal pump. Closed type pump test system was established to obtain the pump performance and pressure pulsation characteristics under different flow rates and cavitation condition, which provide boundary conditions and verification of calculations. Based on the calculation results of the unsteady flow field of the centrifugal pump cavitation, the entropy generation analysis of the flow field and the pressure fluctuation characteristics were carried out. Then the relationship between cavitation and the deterioration of the centrifugal pump performance and the generation of the unstable operation excitation force was tried to reveal. The internal energy loss is mainly concentrated in the impeller, volute, and pump cavity area, which accounts for more than 85% of the total entropy generation. The characteristic frequency of about 0.333 Strouhal Number appears at the volute tongue due to the cavitation flow spread downstream.

The efficient generation of high-quality random numbers is essential in the operation of cryptographic modules. The quality of a random number generator is evaluated by the min-entropy of its entropy source. Typical method used to achieve high min-entropy of the output sequence is an entropy accumulation based on a hash function. This is grounded in the famous Leftover Hash Lemma which guarantees a lower bound on the min-entropy of the output sequence. However, the hash function based entropy accumulation has slow speed in general. For a practical perspective we need a new efficient entropy accumulation with the theoretical background for the min-entropy of the output sequence. In this work, we obtain the theoretical bound for the min-entropy of the output random sequence through the very efficient entropy accumulation using only bitwise XOR operations, where the input sequences from the entropy source are independent. Moreover we examine our theoretical results by applying to the quantum random number generator that uses dark noise arising from image sensor pixels as its entropy source.

The fundamental objective is to study the application of multivariate sets of data in Gaussian distribution. This paper examines broad measurements of structure for both Gaussian and non-Gaussian distributions, which shows that they can be described in terms of the infor-mation-theoretic between the given covariance matrix and correlated random variables (in terms of relative entropy). In order to develop the multivariate Gaussian distribution with entropy and mutual information, several significant methodologies are presented through the discussion supported by illustrations, both technically and statistically. The content obtained allows readers to better perceive concepts, comprehend techniques, and properly execute software programs for future study on the topic's science and implementations. It also helps readers grasp the themes' fundamental concepts. Involving the relative entropy and mutual information as well as the potential correlated covariance analysis based on differential equations, a wide range of information is addressed, including basic to application concerns.

We investigate some of the fundamental features of the interaction of mixed kaleidoscope states, namely, particular statistical mixtures of coherent states, with two-level atoms in the Jaynes-Cummings model framework. We begin our analysis by calculating the von Neumann entropy of the field which is determined with help of the virtual atom method. Oscillations appear in this entropy that indicate a state of purity greater than the initial state, {it i.e.}, a purification of the initial state is achieved. In this oscillatory region, we obtain the field Wigner function that resembles Schrodinger's cats.

Modulation of the amplitude of high-frequency cortical field activity locked to changes in phase of a slower brain rhythm is known as phase-amplitude coupling (PAC). The study of this phenomenon has been gaining traction in neuroscience because of several reports on its appearance in normal and pathological brain processes in humans as well as across different mammalian species. This has led to the suggestion that PAC may be an intrinsic brain process that facilitates brain inter-area communication across different spatiotemporal scales. Several methods have been proposed to measure the PAC process, but few of these enable detailed study of its time course. It appears that no studies have reported details of PAC dynamics including its possible directional delay characteristics. Here, we study and characterize the use of a novel information theoretic measure that may address this limitation: local transfer entropy. We use both simulated and actual intracranial electroencephalographic data, and in both cases we observe initial indications that local transfer entropy can be used to detect the onset and offset of modulation process periods revealed by mutual information phase-amplitude coupling (MIPAC). We review our results in the context of current theories about PAC in brain electrical activity, and discuss technical issues that must be addressed to see local transfer entropy more widely applied to PAC analysis.

Boolean functions and networks are commonly used in the modeling and analysis of complex biological systems, and this paradigm is highly relevant in other important areas in data science and decision making, such as in the medical field and in the finance industry. In a Boolean model, the truth state of a variable is either 0 or 1 at a given time. Despite its apparent simplicity, Boolean networks are surprisingly relevant in many areas of application such as in bioinformatics to model gene expressions and interactions. In the latter case, a gene is either ``on" or ``off" depending on its expression level. Despite the promising utility of Boolean modeling, in most practical applications the Boolean network is not known. Automated learning of a Boolean network and Boolean functions, from data, is a challenging task due in part to the large number of unknowns (including both the structure of the network and the functions) to be estimated, for which a brute force approach would be exponentially complex. In this paper we develop a new information theoretic methodology that we show to be significantly more efficient than previous approaches. Building on the recently developed optimal causation entropy principle (oCSE), that we proved can correctly infer networks distinguishing between direct versus indirect connections, we develop here an efficient algorithm that furthermore infers a Boolean network (including both its structure and function) based on data observed from the evolving states at nodes. We call this new inference method, Boolean optimal causation entropy (BoCSE), which we will show that our method is both computationally efficient and also resilient to noise. Furthermore, it allows for selection of a set of features that best explains the process, a statement that can be described as a networked Boolean function reduced order model. We highlight our method to the feature selection in several real-world examples: (1) diagnosis of urinary diseases, (2) Cardiac SPECT diagnosis, (3) informative positions in the game Tic-Tac-Toe, and (4) risk causality analysis of loans in default status. Our proposed method is effective and efficient in all examples.

In this work, we present a model of the atom that is based on a nonclassical logic called paraconsistent logic (PL), which has the main property of accepting the contradiction in logical interpretations without the conclusions being annulled. The proposed model is constructed with an extension of PL called paraconsistent annotated logic with annotation of two values (PAL2v), which is associated with an interlaced bilattice of four vertices. We use the logarithmic function of the Shannon entropy H_(s) to construct the paraconsistent equations and thus adapt a probabilistic model for representations in quantum physics. Through analyses of the interlaced bilattice, comparative values are obtained for some of the phenomena and effects of quantum mechanics, such as superposition of states, quantum entanglement, wave functions, and equations that determine the energy levels of the layers of an atom. At the end of this article, we use the hydrogen atom as a basis of the representation of the PAL2v model, where the values of the energy levels in six orbital layers are obtained. As an example, we present a possible method of applying the PAL2v model to the use of Raman spectroscopy signals in the detection of lubricating mineral oil quality.

Primary energy consumption is one of the key drivers of global CO₂ emissions that, in turn, heavily depend on the efficiency of involved technologies. Either the improvement in technology efficiency or the expansion of non-fossil fuel consumption require large investments. The planning and financing of such investments, by policy makers or global energy firms, require, in turn, reliable measures of associated global spreads and their evolution in time. In this paper, our main contribution is the introduction of index measures for accessing global spreads (that is, measures of inequality or inhomogeneity in the statistical distribution of a related quantity of interest) of technology efficiency and CO₂ emission in primary energy consumption. These indexes are based on the Gini index, as used in economical sciences, and generalised entropy measures. Regarding primary energy sources, we consider petroleum, coal, natural gas and non-fossil fuels. Between our findings, we attest some stable relations in the evolution of global spreads of technology efficiency and CO₂ emission, and a positive relation between changes in global spreads of technology efficiency and use of non-fossil fuel.

Conceiving vacuum energy as gravitational particles subject to Heisenberg’s energy-time uncertainty, modelled as dipoles in a fluidal space at thermodynamic equilibrium, and interpreting the Bekenstein-Hawking entropy as the effective amount of spins of those dipoles enclosed within the event horizon of the universe, allows the calculation of Milgrom’s acceleration constant. The result is a quantum mechanical interpretation of gravity, and dark matter in particular.

The out-of-equilibrium dynamics of many body systems has recently received a burst of interest, also due to experimental implementations. The dynamics of both observables, such as magnetization and susceptibilities, and quantum information related quantities, such as concurrence and entanglement entropy, have been investigated under different protocols bringing the system out of equilibrium. In this paper we focus on the entanglement entropy dynamics under a sinusoidal drive of the tranverse magnetic field in the 1D quantum Ising model. We find that the area and the volume law of the entanglement entropy coexist under periodic drive for an initial non-critical ground state. Furthermore, starting from a critical ground state, the entanglement entropy exhibits finite size scaling even under such a periodic drive. This critical-like behaviour of the out-of-equilibrium driven state can persist for arbitrarily long time, provided that the entanglement entropy is evaluated on increasingly subsytem sizes, whereas for smaller sizes a volume law holds. Finally, we give an interpretation of the simultaneous occurrence of critical and non-critical behaviour in terms of the propagation of Floquet quasi-particles.

We describe cosmic expansion from the standpoint of an observer’s comoving horizon. When the Universe is small, the observer detects a large amount of the total cosmic bits, which number is fixed. Indeed, information, such as energy, cannot be created or destroyed in our Universe, i.e., the total number of cosmic bits must be kept constant, despite the black hole paradox. When the Universe expands, the information gets ergodically “diluted” in our isotopic and homogeneous Cosmos. This means that the observer can perceive just a lower number of the total bits, due the decreased density of information in the cosmic volume (or its surrounding surface, according to the holographic principle) in which she is trapped by speed light’s constraints. Here we ask: how does the second law of thermodynamics enter in this framework? Could it be correlated with cosmic expansion? The correlation is at least partially feasible, because the decrease in the information detected by a local observer in an expanding Universe leads to an increase in detected cosmic thermodynamic entropy, via the Bekenstein bound and the Laudauer principle. Reversing the classical scheme from thermodynamic entropy to information entropy, we suggest that the quantum vacuum’s cosmological constant, that causes cosmic expansion, could be one of the sources of the increases in thermodynamic entropy detected by local observers.

For planetary gear has the characteristics of small volume, light weight and large transmission ratio, it is widely used in high speed and high power mechanical system. Poor working conditions result in frequent failures of planetary gear. A method is proposed for diagnosing faults in planetary gear based on permutation entropy of Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) Adaptive Neuro-fuzzy Inference System (ANFIS) in this paper. The original signal is decomposed into 6 intrinsic mode functions (IMF) and residual components by CEEMDAN. Since the IMF contains the main characteristic information of planetary gear faults, time complexity of IMFs are reflected by permutation entropies to quantify the fault features. The permutation entropies of each IMF component are defined as the input of ANFIS, and its parameters and membership functions are adaptively adjusted according to training samples. Finally, the fuzzy inference rules are determined, and the optimal ANFIS is obtained. The overall recognition rate of the test sample used for ANFIS is 90.75%, and the recognition rate of gear with one missing tooth is relatively high. The recognition rates of different fault gears based on the method can also achieve better results. Therefore, the proposed method can be applied to planetary gear fault diagnosis effectively.

Motivated by the importance of entanglement and correlation indicators in the analysis of quantum systems, we study the equilibrium and the residual entropy in a two-species Bose Hubbard dimer when the spatial phase separation of the two species takes place. We consider both the zero and non-zero-temperature regime. We present different kinds of residual entropies (each one associated to a different way of partitioning the system), and we show that they strictly depend on the specific quantum phase characterizing the two species (supermixed, mixed or demixed) even at finite temperature. To provide a deeper physical insight into the zero-temperature scenario, we apply the fully-analytical variational approach based on su(2) coherent states and provide a considerbly good approximation of the entanglement entropy. Finally, we show that the effectiveness of residual entropy as a critical indicator at non-zero temperature is unchanged when considering a restricted combination of energy eigenstates.

With the great development of intelligent transportation systems (ITS), travel time prediction has attracted the attentions of many researchers and a large number of prediction methods have been developed. However, as an unavoidable topic, the predictability of travel time series is the basic premise for travel time prediction has received less attention than the methodology. Based on the analysis of the complexity of travel time series, this paper defines travel time predictability to express the probability of correct travel time prediction and proposes an entropy-based method to measure the upper bound of travel time predictability. Multiscale entropy is employed to quantify the complexity of travel time series, and the relationships between entropy and the upper bound of travel time predictability are presented. Empirical studies are made with vehicle trajectory data in an express road section. The effectiveness of time scales, tolerance, and series length to entropy and travel time predictability are analysis, and some valuable suggestions about the accuracy of travel time predictability are discussed. Finally, the comparisons between travel time predictability and actual prediction results from two prediction models, ARIMA and BPNN, are conducted. Experimental results demonstrate the validity and reliability of the proposed travel time predictability.

My innovative entropy measure, Ismail entropy, namely, (IE) is an ultimate generalization to numerous generalized entropies within the literature. The fractal dimension of IE is identified in this paper. On another applicative note, this paper offers some potential applications of fractal dimension to smart cities. The paper ends with closing remarks combined with some challenging open problems and the next phase of research.

Background: Early detection of atrial fibrillation (AF) is essential to prevent stroke and other cardiac and embolic complications. We compared the diagnostic properties for AF detection of the percentage of successive RR interval differences greater than or equal to 30 ms or 3.25% of the previous RR interval (pRR30 and pRR3.25%, respectively), and asymmetric entropy descriptors of RR intervals. Previously, both pRR30 and pRR3.25% outperformed many other heart rate variability (HRV) parameters in distinguishing AF from sinus rhythm (SR) in 60-second electrocardiograms (ECGs). Methods: The 60-s segments with RR intervals were extracted from the publicly available Physionet Long-Term Atrial Fibrillation Database (84 recording, 24-hour Holter ECG). There were 31753 60-s segments of AF and 32073 60-s segments of SR. The diagnostic properties of all parameters were analysed with the receiver operator curve analysis, confusion matrix and logistic regression. The best model with pRR30, pRR3.25% and total entropic features (H) had the largest area under the curve (AUC) – 0.98 compared to 0.959 for pRR30 - and 0.972 for pRR3.25%. However, the differences in AUC between pRR30, pRR3.25% alone and the combined model were negligible from a practical point of view. Moreover, combining pRR30, pRR3.25% with H significantly increased the number of false-negative cases by more than threefold. Conclusions: Asymmetric entropy has some potential in differentiating AF from SR in the 60-s RR interval time series, but the addition of these parameters does not seem to make a relevant difference compared to pRR30 and especially pRR3.25%.

Experimental methodologies for fatigue lifetime prediction are time-intensive and susceptible to environmental variables. While the cohesive zone model is popular for predicting adhesive fatigue lifetime, entropy-based methods have also shown promise. This study aims to provide an understanding of the durability characteristics of CFRP adhesive joints by incorporating an entropy damage model within the context of the finite element method (FEM), examined the effects of different adhesive layer thicknesses on SLS models. As the adhesive layer increased in thickness, DAMAGE VARIABLES initially rose and then declined, peaking at 0.3mm. This finding provides crucial understanding into the stress behavior at the resin-CFRP interface and the resin's fatigue mechanisms.

Recently, there has been growing interest in alternative measures of uncertainty, including cumulative residual entropy. In this paper, we consider a mixed system consisting of n components, assuming that all components are operational at time t. We use the system signature to calculate the cumulative residual entropy of the mixed system’s remaining lifetime. This measure is a useful criterion for assessing the predictability of a system’s lifetime. We study several results related to the cumulative residual entropy of mixed systems, including expressions, limits, and order properties. These results shed light on the behavior of the measure and provide insights into the predictability of mixed systems. In addition, we propose a criterion for selecting a preferred system based on the relative residual cumulative entropy. This criterion is closely related to the parallel system and provides a practical way to choose the best system configuration. Overall, the present study of cumulative residual entropy and the proposed selection criterion provide valuable insights into the predictability of mixed systems and can be applied in various fields.

Currently, skin cancer is the most commonly diagnosed form of cancer in humans and is one of the leading causes of death in patients with cancer. Biopsy methods are an invasive research method and are not always available for primary diagnosis. Imaging methods have low accuracy and depend on the experience of the dermatologist. Artificial intelligence technologies can match and surpass visual analysis methods in accuracy, but they have the risk of a false negative response when a malignant pigmented lesion can be recognized as benign. One possible way to improve accuracy and reduce the risk of false negatives is to analyze heterogeneous data, combine different preprocessing methods, and use modified loss functions to eliminate the negative impact of unbalanced dermatological data. The paper proposes a multimodal neural network system with a modified cross-entropy loss function that is sensitive to unbalanced heterogeneous dermatological data. The accuracy of recognition in 10 diagnostically significant categories for the proposed system was 85.19%. The novelty of the proposed system lies in the use of cross-entropy loss when training the modified function with the help of weight coefficients. The introduction of weighting factors has reduced the number of false negative forecasts, as well as improved accuracy by 1.02-4.03 percentage points compared to the original multimodal systems. The introduction of the proposed multimodal system as an auxiliary diagnostic tool can reduce the consumption of financial and labor resources involved in the medical industry, as well as increase the chance of early detection of skin cancer.

Bayesian Maximum Entropy (BME) is increasingly used in predicting and mapping spatio-temporal data. However, studies that have fully evaluated its robustness empirically are rare. Therefore, this research examined empirically the effect of skewness, sample size and spatial dependency level using simulated data. We considered symmetric data, data positively skewed by 1, 3, 6 and 9, data with weak, moderate, and strong spatial dependency levels, and sample sizes from 100 to 500 at the interval length of 50. The results showed that the variation of sample sizes and spatial dependency levels do not affect the Mean Square Error (MSE) and bias of BME prediction. However, skewness affects the MSE of prediction but does not affect the bias. This result indicates that BME is robust to sample size and is unbiased. Despite the significant difference due to skewness, a graphical plot showed values of MSE close to zero, suggesting that BME can be considered robust to skewness.

Abstract: The second part of the paper develops the approach, suggested in the Entropy 2020, 22(1), 11; https://doi.org/10.3390/e22010011 , which relates ordering in physical systems to their symmetrizing. Entropy is frequently interpreted as a quantitative measure of “chaos” or “disorder”. However, the notions of “chaos” and “disorder” are vague and subjective to a much extent. This leads to numerous misinterpretations of entropy. We propose to see the disorder as an absence of symmetry and to identify “ordering” with symmetrizing of a physical system; in other words, introducing the elements of symmetry into an initially disordered physical system. We explore the initially disordered system of elementary magnets exerted to the external magnetic field H ⃗. Imposing symmetry restrictions diminishes the entropy of the system and decreases its temperature. The general case of the system of elementary magnets demonstrating the j-fold symmetry is treated. The interrelation T_j=T/j takes place, where T and T_j are the temperatures of non-symmetrized and j-fold-symmetrized systems of the magnets correspondingly.

A convenient practical model for accurately estimating the total entropy (ΣSi) of atmospheric gases based on physical action is proposed. This realistic approach is fully consistent with statistical mechanics, but reinterprets its partition functions as measures of translational, rotational and vibrational action or quantum states, to estimate the entropy. With all kinds of molecular action expressed as logarithmic functions, the total heat required for warming a chemical system from 0o K (ΣSiT) to a given temperature and pressure can be computed, yielding results identical with published experimental third law values of entropy. All thermodynamic properties of gases including entropy, enthalpy, Gibbs energy and Helmholtz energy are directly estimated using simple algorithms based on simple molecular and physical properties, without resource to tables of standard values; both free energies are measures of quantum field states and of minimal statistical degeneracy, decreasing with temperature and declining density. We propose that this more realistic approach has heuristic value for thermodynamic computation of atmospheric profiles, based on steady state heat flows equilibrating with gravity. Potentially, this application of an action principle can provide better understanding of emergent properties of many natural or evolving complex systems, including modelling of predictions for global warming.

We consider the conjecture of the relationship between the entanglement entropy of spacetime, matter and the action in Einstein's general relativity. Our analysis suggests the possibility of regarding the entanglement entropy of spacetime and matter as the dimensionless action in general relativity by using Planck units. In this case, the action principle originates from the maximization of the entanglement entropy. We also show that the fundamental property of entanglement entropy leads to attractive characteristic of gravitational force for classical particles.

Quantum Computers are provisioned as very high performance computers using quantum mechanical aspects for information processing. Quantum Information Theory and Quantum Computing topics are popular topics in academia aiming the construction of theoretical background of Quantum Computers. The information processing units for Quantum Computers are defined as qubits but for some problems three level (trinary) systems may be applied as well. We call these three level systems as qutrits. The scope of this work is the analysis of well-defined entanglement measures Negativity and Relative Entropy of Entanglement (REE) for two qutrit (3- level/trinary) quantum systems. In this manner, for randomly generated 1000 two qutrit and 1000 two qubit states the mentioned measures are calculated and these values are compared. These comparisons are analyzed and for quantum state ordering problem, some interesting results are reported.

We investigate entropy generation in unsteady three-dimensional axisymmetric MHD nanofluid flow over a non-linearly stretching sheet. The flow is subject to thermal radiation and a chemical reaction. The conservation equations were solved using the spectral quasi-linearization method. The novelty of the work is in the study of entropy generation in three-dimensional axisymmetric MHD nanofluid and the choice of the spectral quasilinearization method as the solution method. The effects of Brownian motion and thermophoresis are also taken into account when the nanofluid particle volume fraction on the boundary in passively controlled. The results show that as the Hartman number increases, both the Nusselt number and the Sherwood number decrease whereas the skin friction increases. It is further shown that an increase in the thermal radiation parameter corresponds to a decrease in the Nusselt number. Moreover, entropy generation increases with the physical parameters.

Ransomware attacks have rapidly proliferated, inflicting severe financial damages on businesses and individuals. Machine learning approaches to automate ransomware detection have shown promise but grapple with challenges like limited training data. This study introduces a novel deep learning model for few-shot ransomware classification. The model employs entropy features derived directly from malware binaries coupled with a twin neural network architecture utilizing transfer learning. Tests on over 1000 samples across 11 families demonstrate a weighted F1-score of 85.8\%, surpassing existing methods. The approach mitigates biases in limited training data and preserves intricacies lost in image-based features. It exhibits precise classification capabilities even with sparse samples of new ransomware variants. The research highlights the potential of entropy-driven deep learning to equip defenses against emerging zero-day ransomware strains.

In a recent article, the author derived a new generalized Langevin equation and its associated Fokker-Planck equation of a Brownian particle in a parabolic potential where the thermal bath, consisting of $N$ harmonic oscillators, interacts bilinearly with the external field. The time needed for the system to reach a steady state is longer than that for the classical version where such an interaction is off. We find that there is a marked effect of the field-bath interaction on the average heat and entropy production of the bath represented through strong oscillations in such properties. The new theory applied to the system should improve the physical description of previous works done with the classical approach.

Key thermophysical properties necessary for the successful design and use of CoCrFeNi alloy in thermophysical applications have been measured experimentally, and the results have been compared with literature values and results previously obtained for commercial Ni-Cr alloys and equiatomic CoCrFeNi alloy. In particular, the thermal diffusivity, coefficient of thermal expansion (CTE), and specific heat capacity were measured for the as-cast and homogenized equiatomic CoCrFeNi alloy over a temperature range allowing the thermal conductivity to be calculated up to 1173 K. The thermal conductivity and thermal diffusivity of the equiatomic CoCrFeNi alloy were found to deviate from monotonic behavior in the temperature range from 773 to 1100 K. Such a deviation was previously observed in the behavior of the temperature dependence of CTE and specific heat capacity of the equiatomic CoCrFeNi alloy. The non-linear behavior is primarily the result of order/disorder phenomena for the as-cast and homogenized sample, as well as additionally for the as-cast sample, non-equilibrium solidification under arc melting conditions. The measured data of thermophysical properties are provided for thermally differently treated samples, and it is shown that there is a difference in the behavior of the temperature dependences of CTE, thermal diffusivity, and heat capacity.

The performance of bearings plays a pivotal role in determining the dependability and security of rotating machinery. In intricate systems demanding exceptional reliability and safety, the ability to accurately forecast fault occurrences during operation holds profound significance. Such predictions serve as invaluable guides for crafting well-considered reliability strategies and executing maintenance practices aimed at enhancing reliability. In order to ensure the reliability of bearing operation, this article investigates the application of three advanced techniques—Maximum Correlation Kurtosis Deconvolution (MCKD), Multi-Scale Permutation Entropy (MPE), and Long Short-Term Memory (LSTM) recurrent neural networks—for the prediction of the remaining useful life (RUL) of rolling bearings. Each technique's principles, methodologies, and applications are comprehensively reviewed, offering insights into their respective strengths and limitations. Case studies and experimental evaluations are presented to assess their performance in RUL prediction. Findings reveal that MCKD enhances fault signatures, MPE captures complexity, and LSTM excels in modeling temporal patterns. The root mean square error of the prediction results is 0.007. The fusion of these techniques offers a comprehensive approach to RUL prediction, leveraging their unique attributes for more accurate and reliable predictions.

Managing sidelobe levels (SLLs) in metasurface-driven beam-steering antennas poses a significant challenge due to intrinsic factors leading to grating lobes. Our proposed method employs an equivalent model to optimize large periodic metasurfaces efficiently. This model predicts complete metasurface performance, accounting for mutual coupling between patches. We introduce an evolutionary optimization algorithm based on the Cross Entropy (CE) method to enhance PGM-based beam-steering antennas and suppress sidelobes. Two strategies were employed: first is to optimize the patch dimensions for a sidelobe-free pattern and the second is to maintain the PGM dimensions while optimizing feed array amplitudes. Both strategies effectively suppressed sidelobes, offering insights into the CE method's applicability and effectiveness for CPU-intensive electromagnetic optimization challenges. The proposed CE method variant retains its simplicity while improving monitoring capabilities, addressing this limitation. Smaller generations yield better improvements per evaluation

Ultra-high temperature oxidation-resistant alloys (UTORAs) have received a lot of attention due to the increased research demand for deep space exploration around the world. But UTORAs have the disadvantages of easy oxidation and chalking. So, in this study, a UTORA was prepared by hot-press sintering on VZrHfNbTa (HEA) substrate coated with hafnium. The bonding mechanism, resistance to high-temperature oxidation, and hardness of the sample tests were carried out. The results show that zirconium in the matrix will diffuse into the hafnium coating during the high-temperature sintering process and form the HfZr alloy transition layer, the coating thickness of the composite is about 120 μm, and the diffusion distance of zirconium in the hafnium coating is about 60 μm, this transition layer chemically combines the hafnium coating and the HEA substrate into a monolithic alloy composite. The results of high-temperature oxidation experiments show that the oxidation degree of the hafnium-coated VZrHfNbTa composite material was significantly lower than that of the VZrHfNbTa HEA after oxidation in air at 1600 °C for 5 h. The weight gain of the coated sample after oxidation is 56.56 mg/cm2, which was only 57.7 % compared to the weight gain of the uncoated sample (98.09 mg/cm2 for uncoated), and the surface of the uncoated HEA showed obvious dents, oxidation, and pulverization occurred on the surface and interior of the sample. In contrast, the coated composite alloy sample mainly underwent surface oxidation sintering to form a dense HfO2 protective layer, and the internal oxidation of the hafnium-coated VZrHfNbTa composite alloy was significantly lower than that of the uncoated VZrHfNbTa HEA.

Background: With the trend of intelligent display, the interface design of in-vehicle HUD is an expanding research field; Methods: To solve the subjectivity and uncertainty in the optimization of HUD interface design schemes, this paper proposed a hybrid scheme evaluation and optimization method based on entropy weight and VIKOR. The entropy weight method was used to reduce the subjectivity the decision-maker's weighting and obtain the objective weight of each indicator; The VIKOR method was used to obtain the best ranking of alternative schemes, and then the optimal interface design scheme was selected; Results: The evaluation of in-vehicle HUD interface design schemes were taken as an example for verification and calculation. The results showed that this method considers the subjectivity and uncertainty of the decision-making process in the optimization of design scheme, which can effectively improve the objectivity and accuracy of the evaluation results, and provide a reference for designers to optimize interface design schemes.

Modularity and organizational hierarchy are important concepts in understanding the structure and evolution of interactions in complex biological systems. In this work, we introduce and use a spectral characterization measure (Spectral Entropy) to quantify modularity in protein-to-protein interaction (PPI) networks in species across the tree of life. We evaluated the relation between the size of a PPI network and its (Spectral Entropy-based) modularity, and found a sigmoidal response between the two. We also found significant differences in the distribution of Spectral Entropy values among the three domains of life (Bacteria, Archaea, Eukaryotes). To explore further correlations with biological traits, we focused solely on bacterial PPI networks, which are the most numerous among the three domains and had associated trait metadata, and investigated how modularity impacts or is impacted by growth, aerobicity, selection and location on the tree of life. We found no relation between maximal growth rate and Spectral Entropy, but a strong dependence between G-C content (a proxy for selection) and Spectral Entropy. We also discovered that Spectral Entropy is negatively affected by phylogenetic placement (evolutionary distance from the last universal common ancestor). The general nature of the Spectral Entropy measure of hierarchical modularity in networks suggests that it will be useful in other settings where structural properties of real-world networks are being compared.

The logarithmic correction to Bekenshtein$-$Hawking entropy in the framework of 4D Einstein - Gauss - Bonnet gravity coupled with nonlinear electrodynamics is obtained. We explore the black hole solution with the spherically symmetric metric. The logarithmic term in the entropy has a structure similar to the entropy correction in the semi-classical Einstein equations which mimics the quantum correction to the area low. The energy emission rate of black holes and energy conditions are studied. The quasinormal modes of a test scalar field are investigated. The gravitational lensing of light around BHs was studied. We calculated the deflection angle for some model parameters.

According to the current European and Italian scenario related to urban re-generation, cultural and landscape heritage, valorisation is being also enhanced by the activation of innovative processes. These involve the development of methodologies and tools that are able to address decision-making processes among low entropy economy, complex values and creative practices. In this perspective, the research aims to investigate the possibilities of developing a Cultural Heritage Low Entropy Enhancement (CHLEE) approach by considering how the complex values of cultural heritage can vary not only through a physical transformation of spaces but also through a program of uses and activities able to produce new values, where the human experience is essential. This type of model modifies the objectives that characterise the valorisation of cultural heritage and landscape, recognising that the fruition is no longer “consumerist” but “experiential”. A crucial role is represented by the heterogeneity of creative practices that contribute to the identificationidentifying and implementation ofimplementing innovative management and governance models. The present paper explores the components of creative regenerative processes, based upon the ex-post evaluation of some Italian experiments, across the PROMETHEE-GAIA multi-criteria method, to understand how creative experiences are building innovation ecosystem thanks to low entropy economy and improve the ex-ante evaluation for new strategies and policies.

Two well-known drawbacks in fuzzy clustering are the requirement of assign in advance the number of clusters and random initialization of cluster centers.; the quality of the final fuzzy clusters depends heavily on the initial choice of the number of clusters and the initialization of the clusters, then it is necessary to apply a validity index to measure the compactness and the separability of the final clusters and run the clustering algorithm several times. We propose a new fuzzy C-means algorithm in which a validity index based on the concepts of maximum fuzzy energy and minimum fuzzy entropy is applied to initialize the cluster centers and to find the optimal number of clusters and initial cluster centers in order to obtain a good clustering quality, without increasing time consumption. We test our algorithm on UCI machine learning classification datasets comparing the results with the ones obtained by using well-known validity indices and variations of FCM using optimization algorithms in the initialization phase. The comparison results show that our algorithm represents an optimal trade-off between the quality of clustering and the time consumption.

The diffusion coefficient--a measure of dissipation, and the entropy--a measure of fluctuation are found to be intimately correlated in many physical systems. Unlike the fluctuation dissipation theorem in linear response theory, the correlation is often strongly non-linear. To understand this complex dependence, we consider the classical Brownian diffusion in this work. Under certain rational assumption, i.e. in the bi-component fluid mixture, the mass of the Brownian particle $M$ is far greater than that of the bath molecule $m$, we can adopt the weakly couple limit. Only considering the first-order approximation of the mass ratio $m/M$, we obtain a linear motion equation in the reference frame of the observer as a Brownian particle. Based on this equivalent equation, we get the Hamiltonian at equilibrium. Finally, using canonical ensemble method, we define a new entropy that is similar to the Kolmogorov-Sinai entropy. Further, we present an analytic expression of the relationship between the diffusion coefficient $D$ and the entropy $S$ in the thermal equilibrium, that is to say, $D =\frac{\hbar}{eM} \exp{[S/(k_Bd)]}$, where $d$ is the dimension of the space, $k_B$ the Boltzmann constant, $\hbar $ the reduced Planck constant and $e$ the Euler number. This kind of scaling relation has been well-known and well-tested since the similar one for single component is firstly derived by Rosenfeld with the expansion of volume ratio.