We report the application of a recently proposed approach for modeling biological systems using a maximum entropy production rate principle in lieu of having in vivo rate constants. The method is applied in four steps: (1) a new ODE-based optimization approach based on Marcelin’s 1910 mass action equation is used to obtain the maximum entropy distribution, (2) the predicted metabolite concentrations are compared to those generally expected from experiment using a loss function from which post-translational regulation of enzymes is inferred, (3) the system is re-optimized with the inferred regulation from which rate constants are determined from the metabolite concentrations and reaction fluxes, and finally (4) a full ODE-based, mass action simulation with rate parameters and allosteric regulation is obtained. From the last step, the power characteristics and resistance of each reaction can be determined. The method is applied to the central metabolism of Neurospora crassa and the flow of material through the three competing pathways of upper glycolysis, the non-oxidative pentose phosphate pathway, and the oxidative pentose phosphate pathway are evaluated as a function of the NADP/NADPH ratio. It is predicted that regulation of phosphofructokinase (PFK) and flow through the pentose phosphate pathway are essential for preventing an extreme level of fructose 1, 6-bisphophate accumulation. Such an extreme level of fructose 1,6-bisphophate would otherwise result in a glassy cytoplasm with limited diffusion, dramatically decreasing the entropy and energy production rate and, consequently, biological competitiveness.

Polymers in highly confined geometries can display complex morphologies including ordered phases. A basic component of a theoretical analysis of their phase behavior in confined geometries is the knowledge of the number of possible single-chain conformations compatible with the geometrical restrictions and the established crystalline morphology. While the statistical properties of unrestricted self-avoiding random walks (SAWs) both on and off-lattice are very well known, the same is not true for SAWs in confined geometries. The purpose of this contribution is a) to enumerate the number of SAWs on the simple cubic (SC) and face-centered cubic (FCC) lattices under confinement for moderate SAW lengths, and b) to obtain an approximate expression for their behavior as a function of chain length, type of lattice, and degree of confinement. This information is an essential requirement for the understanding and prediction of entropy-driven phase transitions of model polymer chains under confinement. In addition, a simple geometric argument is presented that explains, to first order, the dependence of the number of restricted SAWs on the type of SAW origin.

Creating self-learning algorithms, developing deep neural networks and improving other methods that "learn" for various areas of human activity is the main goal of the theory of machine learning. It helps to replace the human with a machine, aiming to increase the quality of production. The theory of artificial neural networks, which already have replaced the humans in problems of detection of moving objects, recognition of images or sounds, time series prediction, big data analysis and numerical methods remains the most dispersed branch of the theory of machine learning. Certainly, for each area of human activity it is necessary to select appropriate neural network architectures, methods of data processing and some novel tools from applied mathematics. But the universal problem for all these neural networks with specific data is the achieving the highest accuracy in short time. Such problem can be resolved by increasing sizes of architectures and improving data preprocessing, where the accuracy rises with the training time. But there is a possibility to increase the accuracy without time growing, applying optimization methods. In this survey we demonstrate existing optimization algorithms of all types, which can be used in neural networks. There are presented modifications of basic optimization algorithms, such as stochastic gradient descent, adaptive moment estimation, Newton and quasi-Newton optimization methods. But the most recent optimization algorithms are related to information geometry, for Fisher-Rao and Bregman metrics. This approach in optimization extended the theory of classic neural networks to quantum and complex-valued neural networks, due to geometric and probabilistic tools. There are provided applications of all introduced optimization algorithms, what delighted many kinds of neural networks, which can be improved by including any advanced approaches in minimization of the loss function. Afterwards, we demonstrated ways of developing optimization algorithms in further researches, engaging neural networks with progressive architectures. Classical gradient based optimizers can be replaced by fractional order, bilevel and, even, gradient free optimization methods. There is a possibility to add such analogues in graph, spiking, complex-valued, quantum and wavelet neural networks. Besides the usual problems of image recognition, time series prediction, object detection, there are many are other tasks for modern theory of machine learning, such as solving problem of quantum computations, partial differential and integro-differential equations, stochastic processes and Brownian motion, making decisions and computer algebra.

In 1969, Jean-Marie Souriau introduced a “Lie Groups Thermodynamics” in Statistical Mechanics in the framework of Geometric Mechanics. This Souriau’s model considers the statistical mechanics of dynamic systems in their "space of evolution" associated to a homogeneous symplectic manifold by a Lagrange 2-form, and defines in case of non null cohomology (non equivariance of the coadjoint action on the moment map with appearance of an additional cocyle) a Gibbs density (of maximum entropy) that is covariant under the action of dynamic groups of physics (eg, Galileo's group in classical physics). Souriau Lie Group Thermodynamics was also addressed 30 years after Souriau by R. F. Streater in the framework of Quantum Physics by Information Geometry for some Lie algebras, but only in the case of null cohomology. Souriau method could then be applied on Lie Groups to define a covariant maximum entropy density by Kirillov representation theory. We will illustrate this method for homogeneous Siegel domains and more especially for Poincaré unit disk by considering SU(1,1) group coadjoint orbit and by using its Souriau’s moment map. For this case, the coadjoint action on moment map is equivariant. For non-null cohomology, we give the case of Lie group SE(2). Finally, we will propose a new geometric definition of Entropy that could be built as a generalized Casimir invariant function in coadjoint representation, and Massieu characteristic function, dual of Entropy by Legendre transform, as a generalized Casimir invariant function in adjoint representation, where Souriau cocycle is a measure of the lack of equivariance of the moment mapping.

In this paper, we revisit the q-states clock model for small systems. We present results for the thermodynamics of the q-states clock model from $q=2$ to $q=20$ for small square lattices $L \times L$, with L ranging from $L=3$ to $L=64$ with free-boundary conditions. Energy, specific heat, entropy and magnetization are measured. We found that the Berezinskii-Kosterlitz-Thouless (BKT)-like transition appears for $q>5$ regardless of lattice size, while the transition at $q=5$ is lost for $L<10$; for $q\leq 4$ the BKT transition is never present. We report the phase diagram in terms of $q$ showing the transition from the ferromagnetic (FM) to the paramagnetic (PM) phases at a critical temperature T$_1$ for small systems which turns into a transition from the FM to the BKT phase for larger systems, while a second phase transition between the BKT and the PM phases occurs at T$_2$. We also show that the magnetic phases are well characterized by the two dimensional (2D) distribution of the magnetization values. We make use of this opportunity to do an information theory analysis of the time series obtained from the Monte Carlo simulations. In particular, we calculate the phenomenological mutability and diversity functions. Diversity characterizes the phase transitions, but the phases are less detectable as $q$ increases. Free boundary conditions are used to better mimic the reality of small systems (far from any thermodynamic limit). The role of size is discussed.

To understand microbial growth with mathematical models has a long tradition that dates back to the pioneering work of Jacques Monod in the 1940s. Growth laws are simple mathematical expressions that aim at describing growth rates of microbes as functions of external parameters, in particular nutrient concentrations. These laws are now widely applied to construct, e.g., dynamic ecosystem models. However, to explain the growth laws from underlying (first) principles is extremely challenging. In the second half of the 20th century, numerous experimental approaches aimed at precisely measuring heat production during microbial growth to determine the entropy balance in a growing cell and to quantify the exported entropy. This has led to the development of thermodynamic theories of microbial growth, which have generated fundamental understanding and identified principle limitations of the growth process. Whereas these approaches considered a growing microbe as a black box, modern theories heavily rely on genomic resources to describe and model genome-scale networks to explain microbial growth. Interestingly, however, thermodynamic constraints are often included in modern modelling approaches only in a rather superficial fashion, and it appears that recent modelling approaches and classical theories are disconnected fields. In order to stimulate a closer interaction between these fields, we here review various theoretical approaches that aim at describing microbial growth based on thermodynamic principles. We start with classical black-box models of cellular growth, and continue with genome-scale modelling approaches that include thermodynamics, before we place these models in the context of fundamental considerations based on non-equilibrium statistical mechanics. We conclude by identifying conceptual overlaps between the fields and suggest how the various types of theories and models can be integrated. We outline how concepts from one approach may help to inform or constrain another, and we demonstrate how genome-scale models can be used to infer classical black-box parameters, which are experimentally accessible in growth experiments. Such integration will allow understanding to what extent microbes can be viewed as thermodynamic machines, and how close they operate to theoretical optima.

This paper presents a quantitative approach to poetry, based on the use of several statistical measures (entropy, informational energy, N-gram, etc.) applied to a few characteristic English writings. We found that English language changes its entropy as time passes, and that entropy depends on the language used and on the author. In order to compare two similar texts, we were able to introduce a statistical method to asses the information entropy between two texts. We also introduced a method of computing the average information conveyed by a group of letters about the next letter in the text. We found a formula for computing the Shannon language entropy and we introduced the concept of N-gram informational energy of a poetry. We also constructed a neural network, which is able to generate Byron-type poetry and to analyze the information proximity to the genuine Byron poetry.

A general framework for inference in dynamical systems is described, based on the language of Bayesian probability theory and making use of the maximum entropy principle. Taking as fundamental the concept of a path, the continuity equation and Cauchy's equation for fluid dynamics arise naturally, while the specific information about the system can be included using the Maximum Caliber (or maximum path entropy) principle.

Complex systems can be described as the network of interactions between their components. In directed networks, information, energy and matter flow in dominant directions. Undirected networks, on the other hand, cannot easily capture these asymmetries. The local flow of information depends on the node spin, which is a function of the number of incoming and outgoing links attached to it. And yet, how the heterogeneous association between in-degree and out-degree constraints global dynamics remains poorly understood. Here, we develop a new theoretical model to study the relationship between node directionality and global flow dynamics. Our computational analysis of random and scale-free directed networks indicates that structural diversity constrains the dimensionality of reachable dynamical space. These results suggest how local directionality might be an universal driver of global dynamics in many systems, from social networks, to technological systems to the connectome.

Extracellular vesicles (EVs) are cell-derived membranous particles secreted by all cell types into the extracellular milieu. EVs carry, protect, and transport a wide array of bioactive cargoes to recipient/target cells. EVs regulate physiological and pathophysiological processes in recipient cells and are important in therapeutics/drug delivery. Despite these great attributes of EVs, an efficient protocol for EV separation from biofluids is lacking. Numerous techniques have been adapted for the separation of EVs with size exclusion chromatography (SEC)-based methods being the most promising. Here, we review the SEC protocols used for EV separation, and discuss opportunities for significant improvements, such as the development of novel particle purification liquid chromatography (PPLC) system capable of tandem purification and characterization of biological and synthetic particles with near-single vesicle resolution. Finally, we identify future perspectives and current issues to make PPLC a tool capable of providing a unified, automated, adaptable, yet simple and affordable particle separation resource.

We survey the main results emerging in the rapidly developing field that considers the geometry of thermodynamics and statistical mechanics. Our ideas of stability depend on variational principles – Maximum Entropy together with Least Action (and the isomorphic Least Exertion) – and this stability (invariance in time) indicates the centrality of the geometries of the systems. We explore a variety of examples of the application of thermodynamics in both macro- and micro-systems, and propose that irreversibility is an intrinsic and fundamental property of the physical realm (instead of being merely emergent). Using the concept of complex time, we examine the underlying mathematical unity of quantum mechanics, statistical mechanics, and geometrical thermodynamics. We show how the Planck and Boltzmann constants provide the fundamental quantum units for the phenomenological characteristics of the two Noether-conserved quantities controlling overall thermodynamic behaviour: respectively, energy and entropy production. We discuss the far-reaching isomorphisms (between all of complex time, temperature and the system symmetry) that always exist for Maximum Entropy systems, even as they exhibit either irreversible (dissipative, yet still dynamically stable) or reversible (including stable and static geometries) behaviours.

Based on a measuring system to determine levels of spatial organization in 2D polygons (homogeneous or heterogeneous partition of defined areas) lying on principles of regularity, we propose the entropy term linked to the concept of “information”, from the “information theory field”, in order to obtain an information measurement regarding a quantity of or amount of information in the architecture of complex 2D biological organizations. The term “quantity” does not refer to the amount of data (size), but to the probability of a geometrical basic pattern within a set of possible statistical configurations regarding levels of homogeneity and heterogeneity. It is this notion of information that is important in information theory, and measures of information in units of bits, what we propose to use for measuring quantities of organization in the architecture of complex geometrical systems. Two complex systems are tested, biological and non biological in order to obtain experimental results, which are verified with the evaluation criteria “entropy”. Experimental results show that the lowest levels of information and entropy, in addition with low rates of heterogeneity and high rates of homogeneity are particular features of geometrical organizations in biological systems.

We introduce and investigate a simple and explicitly mechanical model of Maxwell's demon -- a device that interacts with a memory register (a stream of bits), a thermal reservoir (an ideal gas) and a work reservoir (a mass that can be lifted or lowered). Our device is similar to one that we have briefly described elsewhere [1], but it has the additional feature that it can be programmed to recognize a chosen reference sequence, for instance, the binary representation of $\pi$. If the bits in the memory register match those of the reference sequence, then the device extracts heat from the thermal reservoir and converts it into work to lift a small mass. Conversely, the device can operate as a generalized Landauer's eraser (or copier), harnessing the energy of a dropping mass to write the chosen reference sequence onto the memory register, replacing whatever information may previously have been stored there. Our model can be interpreted either as a machine that autonomously performs a conversion between information and energy, or else as a feedback-controlled device that is operated by an external agent. We derive generalized second laws of thermodynamics for both pictures. We illustrate our model with numerical simulations, as well as analytical calculations in a particular, exactly solvable limit.

Despite their obvious differences, biological systems at different scales tend to exhibit common organizational patterns. Unfortunately, these commonalities are usually obscured by the parcelled terminology employed by various scientific sub-disciplines. To explore these commonalities, this papers a comparative study of diverse applications of the maximum entropy principle, ranging from amino acids up to societies. By presenting these studies under a common language, this paper establishes a unified view over seemingly highly heterogeneous biological scenarios.

Synergy, emerges from synchronized reciprocal positive feedback loops between a network of diverse actors. For this process to proceed, compatible information from different sources synchronically coordinates the actions of the actors resulting in a nonlinear increase in the useful work or potential energy the system can manage. In contrast noise is produced when incompatible information is mixed. This synergy produced from the coordination of different agents achieves non-linear gains in free energy and in information (negentropy) that are greater than the sum of the parts. The final product of new synergies is an increase in individual autonomy of an organism that achieves increased emancipation from the environment with increases in productivity, efficiency, capacity for flexibility, self-regulation and self-control of behavior through a synchronized division of ever more specialized labor. Examples that provide quantitative data for this phenomenon are presented. Results show that increases in free energy density require decreases in entropy density. This is proposed as a law of thermodynamics.

Cloth wearing seems so natural that everyone is self-deemed knowledgeable and has some expert opinions about it. However to clearly explain the physics involved, and hence to make predictions for clothing design or selection, turns out as demonstrated below to be quite challenging even for experts. Cloth is a multiphased, porous and anisotropic material system and usually in multilayers. Unlike ordinary engineering heat transfer problems, the human body acts as an internal heat source in a clothing situation, thus forming a temperature gradient between body and ambient, and the sign of this gradient often changes as the ambient temperature varies. Our body also perspires and the sweat evaporates, an effective body cooling process via phase change. To bring all the variables into analysis quickly escalates into a formidable task. This work attempts to unravel the problem from a physics perspective, focusing on several rarely noticed yet critically important mechanisms involved so as to offer a clear and accurate depiction of the principles in clothing thermal comfort.

A growing number of studies focus on methods to estimate and analyze the functional connectome of the human brain. Graph theoretical measures are commonly employed to interpret and synthesize complex network-related information. While resting state functional MRI (rsfMRI) is often employed in this context, is known to exhibit poor reproducibility, a key factor which is commonly neglected in typical cohort studies using connectomics-related measures as biomarkers. We aimed to fill this gap by analyzing and comparing inter- and intra- subject variability of connectivity matrices as well as graph-theoretical measures in a large (n=1003) database of young healthy subjects which underwent four consecutive rsfMRI sessions. We analyzed both directed (Granger Causality and Transfer Entropy) and undirected (Pearson Correlation and Partial Correlation) time-series association measures and related global and local graph-theoretical measures. While matrix weights exhibit a higher reproducibility in undirected as opposed to directed methods, this difference disappears when looking at global graph metrics and, in turn, exhibits strong regional dependence in local graphs metrics. Our results warrant caution in the interpretation of connectivity studies, and serve as a benchmark for future investigations by providing quantitative estimates for the inter- and intra- subject variabilities in both directed and undirected connectomic measures.

Meixner's historical remark in 1969 "... it can be shown that the concept of entropy in the absence of equilibrium is in fact not only questionable but that it cannot even be defined...." is investigated from today's insight. Several statements --such as the three laws of phenomenological thermodynamics, the embedding theorem and the adiabatical uniqueness-- are used to get rid of non-equilibrium entropy as a primitive concept. In this framework, Clausius inequality of open systems can be derived by use of the defining inequalities which establish the non-equilibrium quantities contact temperature and non-equilibrium molar entropy which allow to describe the interaction between the Schottky system and its controlling equilibrium environment.

This paper describes a proposed fractional filter-based multi-scale underwater and hazy image enhancement algorithm. The proposed system combines a modified global contrast operator with fractional order-based multi-scale filters used to generate several images, which are fused based on entropy and standard deviation. The multi-scale-global enhancement technique enables fully adaptive and controlled colour correction and contrast enhancement without over exposure of highlights when processing hazy and underwater images. This in addition to illumination/reflectance estimation coupled with global and local contrast enhancement. The proposed algorithm is also compared with the most recent available state-of-the-art multi-scale fusion de-hazing algorithm. Experimental comparisons indicate that the proposed approach yields better edge and contrast enhancement results without halo effect, colour degradation and is faster and more adaptive than all other algorithms from the literature.

The diffusion coefficient--a measure of dissipation, and the entropy--a measure of fluctuation are found to be intimately correlated in many physical systems. Unlike the fluctuation dissipation theorem in linear response theory, the correlation is often strongly non-linear. To understand this complex dependence, we consider the classical Brownian diffusion in this work. Under certain rational assumption, i.e. in the bi-component fluid mixture, the mass of the Brownian particle $M$ is far greater than that of the bath molecule $m$, we can adopt the weakly couple limit. Only considering the first-order approximation of the mass ratio $m/M$, we obtain a linear motion equation in the reference frame of the observer as a Brownian particle. Based on this equivalent equation, we get the Hamiltonian at equilibrium. Finally, using canonical ensemble method, we define a new entropy that is similar to the Kolmogorov-Sinai entropy. Further, we present an analytic expression of the relationship between the diffusion coefficient $D$ and the entropy $S$ in the thermal equilibrium, that is to say, $D =\frac{\hbar}{eM} \exp{[S/(k_Bd)]}$, where $d$ is the dimension of the space, $k_B$ the Boltzmann constant, $\hbar $ the reduced Planck constant and $e$ the Euler number. This kind of scaling relation has been well-known and well-tested since the similar one for single component is firstly derived by Rosenfeld with the expansion of volume ratio.

In this work we identify combinations of technological activities that signal the presence local capabilities in a country to successfully export a product. We use country-level patent and trade data to generate a multi-layer network, and we apply maximization of entropy to generate synthetic data to effectively divide signal from noise. We show that in several sectors the signal far exceed the noise. Our exercise provides robust evidence of the presence of synergies between technologies to explain trade performances in specific markets. This can be highly useful for policy makers, to inform industrial and innovation policies.

We consider the maximum entropy Markov chain inference approach to characterize the collective statistics of neuronal spike trains, focusing on the statistical properties of the inferred model. We review large deviations techniques useful in this context to describe properties of accuracy and convergence in terms of sampling size. We use these results to study the statistical fluctuation of correlations, distinguishability and irreversibility of maximum entropy Markov chains. We illustrate these applications using simple examples where the large deviation rate function is explicitly obtained for maximum entropy models of relevance in this field.

While laminar flow heat transfer and mixing in microfluidic geometries has been investigated experimentally, as has the effect of geometry-induced turbulence in microfluidic flow (it is well documented that turbulence increases convective heat transfer in macrofluidic flow), little literature exists investigating the effect of electrokinetically-induced turbulence on heat transfer at the micro scale. Using recently observed experimental data, this work employed computational fluid dynamics coupled with electromagnetic simulations to determine if electrokinetically-forced, low-Reynolds number turbulence could be observed in a rectangular microchannel with using Newtonian fluids. Analysis of the results was done via comparison to the experimental criteria defined for turbulent flow. This work shows that, even with a simplified simulation setup, computational fluid dynamics (CFD) software can produce results comparable to experimental observations of low-Reynolds turbulence in microchannels using Newtonian fluids. In addition to comparing simulated velocities and turbulent energies to experimental data this work also presents initial data on the effects of electrokinetic forcing on microfluidic flow based on entropy generation rates.

We discuss the role of the opposing principles of order and disorder in physical and biological systems in determining stability, growth and evolution and bring forth the potential role of a cosmic ordering agency. We analyze its role in decreasing entropy by coarse-graining and hence in determining the initial low entropy state of the big bang universe. Since all physical and biological systems have either cycles of order and disorder alternating, or may have chaotic evolution with non-linear laws, the same is expected of the dynamics of the whole universe as well. The entropy of the initial state of the universe could be low because of the reduction of degrees of freedom (DoF) as one moves from physical encoding to neural encoding and then on to psychic encoding of information in a nested manner by coarse-graining. It is by such encoding that this cosmic agency enables the universe to pass through the big crunch phase and then rolls it out as the big bang universe from the initial state of low entropy.

Entropy is usually understood as the quantitative measure of “chaos” or “disorder”. However, the notions of “chaos” and “disorder” are definitely obscure. This leads to numerous misinterpretations of entropy. We propose to see the disorder as an absence of symmetry and to identify “ordering” with symmetrizing of a physical system; in other words, introducing the elements of symmetry into initially disordered physical system. We demonstrate with the binary system of elementary magnets that introducing elements of symmetry necessarily diminishes its entropy. This is true for 1D and 2D systems of elementary magnets. Imposing symmetry does not influence the Landauer Principle valid for the addressed systems. Imposing the symmetry restrictions onto the system built of particles contained within the chamber divided by the permeable partition also diminishes its entropy.

Confidence interval of is an interval corresponding to a specified confidence and including the true value. It can be used to describe the precision of a statistical quantity and quantify its uncertainty. Although the principle of maximum entropy (POME) has been used for a variety of applications in hydrology, the confidence intervals of the POME quantile estimators have not been available. In this study, the calculation formulas of asymptotic variances and confidence intervals of quantiles based on POME for Gamma, Pearson type 3 (P3) and Extreme value type 1 (EV1) distributions were derived. Monte Carlo Simulation experiments were performed to evaluate the performance of derived formulas for finite samples. Using four data sets for annual precipitation at the Weihe River basin in China, the derived formulas were applied for calculating the variances and confidence intervals of precipitation quantiles for different return periods and the results were compared with those of the methods of moments (MOM) and of maximum likelihood (ML) method. It is shown that POME yields the smallest standard errors and the narrowest confidence intervals of quantile estimators among the three methods, and can reduce the uncertainty of quantile estimators

In the same manner that there are several statements of the second law of thermodynamics but all of them are equivalent, it is possible that most of the entropic methods applied to the nervous system and brain in particular share a similar outcome, or essence, that helps understand some aspects of the fundamentals of basic neurodynamics. In this short review focused on certain aspects of the entropic metrics some results are examined that indicate the fundamental importance of the natural tendency towards a maximal energy distribution for healthy brain activity and thus cognition to emerge.

We present a new method for assessing the strength of fuzzy rules with respect to a dataset, based on the measures of the greatest energy and smallest entropy of a fuzzy relation. Considering a fuzzy automaton (relation) in which A is the input fuzzy set and B the output fuzzy set, the fuzzy relation R1 with greatest energy provides information about the greatest strength of the input-output and the fuzzy relation R2 with the smallest entropy provides information about uncertainty of the relationship input-output. We consider a new index of the fuzziness of the input-output based over R1 and R2. In our method this index is calculated for each pair of input and output fuzzy sets in a fuzzy rule. A threshold value is set for choosing the most relevant fuzzy rules with respect to the data.

A new approach is presented to defining the amount of information, in which information is understood as the data about a finite set as a whole, whereas the average length of an integrative code of elements serves as a measure of information. We obtain a formula for the syntropy of reflection, that is, the information that two intersecting finite sets reflect about each other. The specificities of reflection of discrete systems through the combination of their parts are considered, and it is shown that the additive syntropy and entropy of reflection are measures of structural order and chaos. Three information laws have been established: the law of conservation of the sum of chaos and order; information law of reflection; the law of conservation and transformation of information. An assessment of the structural organization and the level of development of discrete systems is presented. It is shown that various measures of information are structural characteristics of integrative codes of elements of discrete systems. The conclusion is made that, from the informational-genetic positions, the synergetic theory of information is primary in relation to the Hartley-Shannon information theory. In the appendix we consider the asymmetry of the mutual reflection of finite sets and the proportionality of arbitrary quantities.

The recently proposed and logically developed paradigm of deep genetical affinity of scientific terms "energy-entropy-information" harmonizes classical and quantum physics with general and special theories of relativity. For the first time in engineering practice, a complex vector-tensor-matrix description of gravitational, thermal and electromagnetic fields in ideal solid, liquid and gaseous media was performed analytically and without preliminary measurements. The basic set of fundamental quantum constants of the standard physical model has been computed with an extreme precision of 1/10^64, which is a natural limit arising due to elementary recursive arithmetic and elementary functional analysis in digital notation.

Here we investigate how the local properties of particles in a thermal bath may influence the thermodynamics of the bath, and consequently alter the statistical mechanics of subsystems that comprise the bath. We are guided by the theory of small-system thermodynamics, which is based on two primary postulates: that small systems can be treated self-consistently by coupling them to an ensemble of similarly small systems, and that a large ensemble of small systems forms its own thermodynamic bath. We adapt this “nanothermodynamics” to investigate how a large system may subdivide into an ensemble of smaller subsystems, causing internal heterogeneity across multiple size scales. For the semi-classical ideal gas, maximum entropy favors subdividing a large system of “atoms” into an ensemble of “regions” of variable size. The mechanism of region formation could come from quantum exchange symmetry that makes atoms in each region indistinguishable, while decoherence between regions allows atoms in separate regions to be distinguishable by their distinct locations. Combining regions reduces the total entropy, as expected when distinguishable particles become indistinguishable, and as required by a theorem in quantum mechanics for sub-additive entropy. Combining large volumes of small regions gives the usual entropy of mixing for a semi-classical ideal gas, resolving Gibbs paradox without invoking quantum symmetry for atoms that may be meters apart. Other models presented here are based on Ising-like spins, which are solved analytically in one dimension. Focusing on the bonds between the Ising-like spins we find similarity in the equilibrium properties of a two-state model in the nanocanonical ensemble and a three-state model in the canonical ensemble. Thus, emergent phenomena may alter the thermal behavior of microscopic models, and the correct ensemble is necessary for fully-accurate predictions. Another result using Ising-like spins involves simulations that include a nonlinear correction to Boltzmann’s factor, which mimics the statistics of indistinguishable states by imitating the dynamics of spin exchange on intermediate lengths. These simulations exhibit 1/f-like noise at low frequencies (f), and white noise at higher f, similar to equilibrium thermal fluctuations found in many materials.

The spatial resolution measurement limitation of the position-momentum uncertainty principle is shown to mathematically originate from the Bekenstein entropy bound and the associated second law of thermodynamics, as a special case in which a statistical thermodynamic distribution of energies is specialized to a fixed, definite probe energy equal to the average energy of that distribution. This is used in combination with the Wein displacement law to predict an ultraviolet cutoff for Planck blackbody radiation at about ⅛ of the Wein peak. A new UV photon counting experiment is proposed to test for this. A physical understanding of these results may be provided by a UV-complete, intelligible theory of general relativistic quantum mechanics in which the observation of a blackbody spectrum is simply a remote observation of Hawking radiation emitted from black hole fluctuations in the gravitational vacuum.

Fatigue in any material is a result of continuous irreversible degradation process. Traditionally, fatigue life is predicted by extrapolating experimentally curve fitted empirical models. In the current study, unified mechanics theory is used to predict fatigue life of Ti-6Al-4V under monotonic tensile, compressive and cyclic load conditions. The unified mechanics theory is used to derive constitutive model for fatigue life prediction using a three-dimensional computational model. The proposed analytical and computational models have been used to predict the low cycle fatigue life of Ti-6Al-4V alloys. It is shown that the unified mechanics theory can be used to predict fatigue life of Ti-6Al-4V alloys by using simple predictive models that are based on fundamental equation of the material, which is based on thermodynamics associated with degradation of materials.

We consider the conjecture of the relationship between the entanglement entropy of spacetime, matter and the action in Einstein's general relativity. Our analysis suggests the possibility of regarding the entanglement entropy of spacetime and matter as the dimensionless action in general relativity by using Planck units. In this case, the action principle originates from the maximization of the entanglement entropy. We also show that the fundamental property of entanglement entropy leads to attractive characteristic of gravitational force for classical particles.

Within an Internet of Multimedia Things, the risk of disclosing streamed video content, such as arising from video surveillance, is of heightened concern. This leads to the encryption of that content. To reduce the overhead and lack of flexibility arising from full encryption of the content, a good number of selective-encryption algorithms have been proposed in the last decade. Some of them have limitations, in terms of significant delay due to computational cost, or excess memory utilization, or, despite being energy efficient, do not provide a satisfactory level of confidentiality, due to their simplicity. To address such issues, this paper presents a lightweight selective encryption scheme, in which encoder syntax elements are encrypted with the innovative EXPer (EXtended Permutation with exclusive OR). The selected syntax elements are taken from the final stage of video encoding that is during entropy coding. As a diagnostic tool, the Encryption Space Ratio measures encoding complexity of the video relative to the level of encryption so as to judge the success of the encryption process, according to entropy coder. A detailed comparative analysis of EXPer with state-of-the-art algorithms confirms that the EXPer provides significant confidentiality with a small computational cost and negligible encryption bitrate overhead. Thus, the results demonstrate that the proposed security scheme is a suitable choice for constrained devices in an Internet of Multimedia Things environment.

Uncertainty is the main source of risk of geological hazards in tunnel engineering. Uncertainty information not only affects the accuracy of evaluation results, but also affects the reliability of decision-making schemes. Therefore, it is necessary to evaluate and control the impact of uncertainty on risk. In this study, the problems in existing entropy-hazard model such as inefficient decision-making and failure of decision-making are analysed, and an improved uncertainty evaluation and control process are proposed. Then the tolerance cost, the key factor in the decision-making model, is also discussed. It is considered that the amount of change in risk value (R1) can better reflect the psychological behaviour of decision-makers. Thirdly, common attribute decision models, such as the expected utility-entropy model, are analysed, and then the viewpoint of different types of decision-making issues that require different decision methods is proposed. The well-known Allais paradox is explained by the proposed methods. Finally, the engineering application results show that the uncertainty control idea proposed here is accurate and effective. This research indicates a direction for further research into uncertainty, and risk control, issues affecting underground engineering works.

The fact that individuals are spatially close to each other in the urban environment increases the potential number of encounters between them. Thus, theoretically speaking, the probability of interaction and social intercourse among people increases as they get closer to each other spatially. This reduction in spatial distance and propensity for larger networks can offer advantages in lower communication and transaction costs. However, there is also the possibility of entropy in a single (organizational) urban subsystem, characterized by reduced spatial distances between individuals that can lead to more toxic outcomes and the possibility of generalized deconstruction in an urban system as a whole. The current paper considers, through a theoretical model and secondary data analysis, how reductions in spatial distance between individuals in urban business organizations can lead to withdrawals of energy through toxic forms of entropic citizenship behavior, and lead to the development of toxic organizations. Such toxic organizations can ‘infect’ the urban system and lead to systematic entropic urban deconstruction. Practical, implications for management of the theoretical explanatory heuristic of toxic forms of organizational entropy and toxic organizations are briefly discussed in the paper.

Computational Fluid Dynamics (CFD) is utilized to study entropy generation for the rarefied steady state laminar 2-D flow of air-Al2O3 nanofluid in square cavity equipped with two solid fins at the hot wall. Such flows are of great importance in industrial applications, such cooling of the electronic equipment’s and nuclear reactors. In the current study, effects of Knudsen number (Kn), Rayleigh number (Ra) and the nano solid particles volume fraction (ϕ) on the entropy generation are investigated. The values of parameters considered in this work are as follows: 0≤Kn≤0.1, 〖10〗^3≤Ra≤〖10〗^6,0≤ϕ≤0.2. Length of the fins (LF) is considered to be fixed and equals to 0.5 m, whereas the location of the fins with respect to the lower wall (HF) is set to 0.25 and 0.75 m. Simulations demonstrate that there is an inverse direct effect of Kn on the entropy generation. Moreover, it is found that when Ra is less than 104, the entropy generation, due to the flow, increases as ϕ increases. In addition, the entropy generation due to the flow will decrease at Ra greater than 104 as ϕ increases. Moreover, the entropy generation due to heat will increase as both the ϕ and Ra increase. In addition, a correlation model of the total entropy generation as a function of all of the investigated parameters in this study is proposed. Finally, an optimization technique is adapted to find out the conditions at which the total entropy generation is minimized

A convolutional neural network (CNN) is sometimes understood as a black box in the sense that while it can approximate any function, studying its structure will not give us any insights into the nature of the function being approximated. In other terms, the discriminative ability does not reveal much about the latent representation of a network. This research aims to establish a framework for interpreting the CNNs by profiling them in terms of interpretable visual concepts and verifying them by means of Integrated Gradient. We also ask the question, "Do different input classes have a relationship or are they unrelated?" For instance, could there be an overlapping set of highly active neurons to identify different classes? Could there be a set of neurons that are useful for one input class whereas misleading for a different one? Intuition answers these questions positively, implying the existence of a structured set of neurons inclined to a particular class. Knowing this structure has significant values; it provides a principled way for identifying redundancies across the classes. Here the interpretability profiling has been done by evaluating the correspondence between individual hidden neurons and a set of human-understandable visual semantic concepts. We also propose an integrated gradient-based class-specific relevance mapping approach that takes the spatial position of the region of interest in the input image. Our relevance score verifies the interpretability scores in terms of neurons tuned to a particular concept/class. Further, we perform network ablation and measure the performance of the network based on our approach.

Fluctuation theorems are a class of equalities each of which links a thermodynamic path functional such as heat and work to a state function such as entropy and free energy. Jinwoo and Tanaka [L. Jinwoo and H. Tanaka, Sci. Rep. 5, 7832 (2015)] have shown that each microstate of a fluctuating system can be regarded as an ensemble (or a 'macrostate') if we consider trajectories that reach each microstate. They have revealed that local forms of entropy and free energy are true thermodynamic potentials of each microstate, encoding heat, and work, respectively, within an ensemble of paths that reach each state. Here we show that information that is characterized by the local form of mutual information between two subsystems in a heat bath is also a true thermodynamic potential of each coupled state and encodes the entropy production of the subsystems and heat bath during a coupling process. To this end, we extend the fluctuation theorem of information exchange [T. Sagawa and M. Ueda, Phys. Rev. Lett. 109, 180602 (2012)] by showing that the fluctuation theorem holds even within an ensemble of paths that reach a coupled state during dynamic co-evolution of two subsystems.

In this study, our primary objective was to analyze the tradeoff between accuracy and complexity in machine learning models, with a specific focus on the impact of reducing complexity and entropy on the production of landslide susceptibility maps. We aimed to investigate how simplifying the model and reducing entropy can affect the capture of complex patterns in the susceptibility maps. To achieve this, we conducted a comprehensive evaluation of various machine-learning algorithms for classification tasks. We compared the performance of these algorithms in terms of accuracy and complexity, considering both "before" and "after" scenarios of dimensionality reduction using Principal Component Analysis (PCA). Our findings revealed that reducing complexity and lowering entropy can lead to an increase in model accuracy. However, we also observed that this reduction in complexity comes at the cost of losing important complex patterns in the produced landslide susceptibility maps. By simplifying the model and reducing entropy, certain intricate relationships and uncertain patterns may be overlooked, resulting in a loss of information and potentially compromising the accuracy of the susceptibility maps. The analysis encompassed a diverse range of machine learning algorithms, including Random Forest (RF), Extra Trees (EXT), XGboost, LightGBM, Catboost, Naive Bayes (NB), K-Nearest Neighbors (KNN), Gradient Boosting Machine (GBM), and Decision Trees (DT). Each algorithm was evaluated for its strengths and limitations, considering the tradeoff between accuracy and complexity. Before dimensionality reduction, the algorithms demonstrated promising results, with RF exhibiting excellent AUC/ROC scores and average accuracy. However, computational costs were noted as a potential drawback for RF, especially when dealing with large datasets. EXT showcased robust performance and good accuracy, while XGboost demonstrated its ability to handle complex relationships within large datasets, albeit requiring careful hyperparameter tuning. The efficiency and scalability of LightGBM made it a suitable choice for large datasets, although it displayed sensitivity to class imbalance. Catboost excelled in handling categorical features, but longer training times were observed for larger datasets. NB showcased simplicity and computational efficiency but assumed independence among features. KNN, known for its capability to capture local patterns and spatial relationships, was found to be sensitive to the choice of distance metric. GBM, while capturing complex relationships effectively, was prone to overfitting without proper regularization. DT, with its interpretability and ease of understanding, faced limitations in terms of overfitting and limited generalization. After dimensionality reduction, certain algorithms exhibited improvements in their AUC/ROC scores and average accuracy, including RF, EXT, XGboost, and LightGBM. However, for a few algorithms, such as NB and DT, a decrease in performance was observed. This study provides valuable insights into the performance characteristics, strengths, and limitations of various machine learning algorithms in classification tasks. Researchers and practitioners can utilize these findings to make informed decisions when selecting algorithms for their specific datasets and requirements. We also aim to identify the potential factors contributing to the high accuracy rates obtained from these ensembled algorithms and explore possible shortcomings of non-ensembled algorithms that may result in lower accuracy rates. By conducting a comprehensive analysis of these algorithms, we seek to provide valuable insights into the benefits and limitations of ensembled approaches for landslide susceptibility mapping. Our study sheds light on the challenges faced when balancing accuracy and complexity in machine learning models for landslide susceptibility mapping. It emphasizes the importance of carefully considering the level of complexity and entropy reduction in relation to the specific patterns and uncertainties present in the data. By providing insights into this tradeoff, our research aims to assist researchers and practitioners in making informed decisions regarding model complexity and entropy reduction, ultimately improving the quality and interpretability of landslide susceptibility maps.

Ecologists use the net biotic interactions among plants to predict fundamental ecosystem features. Following this approach, ecologists have built a giant body of theory founded on observational evidence. However, due to the limitations that a phenomenological approach raises both in empirical and theoretical studies, an increasing number of scientists claim the need for a mechanistic understanding of plant interaction outcomes, and a few studies have taken such a mechanistic approach. In this synthesis, we propose a modeling framework to study the plant interaction mechanistically. We first establish a conceptual ground to frame plant-plant interactions, and then, we propose to formalize this research line theoretically developing a family of individual-based, spatially-explicit models in which biotic interactions are an emergent property mediated by the interaction between plants’ functional traits and the environment. These models allow researchers to evaluate the strength and sign of biotic interactions under different environmental scenarios and thus constitute a powerful tool to investigate the mechanisms underlying facilitation, species coexistence, or the formation of vegetation spatial patterns.

High-entropy alloys (HEAs) are of great interest in the field of materials science and engineering. Unlike conventional alloys, which contain a maximum of two base metals, this new category of materials consists of multi-principle elements and the possible number of alloy compositions, in case of HEAs, is outstandingly higher than that for conventional alloys. Here, a review on the high-entropy alloys, has been provided, on the issue whether the earliest definition of High- Entropy alloys, proposed in 2004^{[2, 4]}, is consistent with one of the four-component equiatomic Compositionally complex alloys exhibiting a “High-entropy” effect.

The subject of this paper is to analyse the Math Principia of Economic 3D Black Holes in Roegenian economics. This idea is totally new in the related literature, excepting our papers. In details, we study two special problems: (i) math origin of economic 3D black holes, (ii) entropy and internal political stability depending on national income and the total investment, for economic RN 3D black hole. To solve these problems, it was necessary to jump from macroeconomic side to microeconomic side (a substantial approach so different), to complete the thermodynamics-economics dictionary with new entities, to introduce the flow between two macroeconomic systems, to study the Schwarzschild type metric properties on an economic 4D system, together with Rindler coordinates, Einstein 4D PDEs, and economic RN 3D black hole. In addition, we introduce some economic Ricci type flows or waves, for further research.

In this work, we present a model of the atom that is based on a nonclassical logic called paraconsistent logic (PL), which has the main property of accepting the contradiction in logical interpretations without the conclusions being annulled. The proposed model is constructed with an extension of PL called paraconsistent annotated logic with annotation of two values (PAL2v), which is associated with an interlaced bilattice of four vertices. We use the logarithmic function of the Shannon entropy H_(s) to construct the paraconsistent equations and thus adapt a probabilistic model for representations in quantum physics. Through analyses of the interlaced bilattice, comparative values are obtained for some of the phenomena and effects of quantum mechanics, such as superposition of states, quantum entanglement, wave functions, and equations that determine the energy levels of the layers of an atom. At the end of this article, we use the hydrogen atom as a basis of the representation of the PAL2v model, where the values of the energy levels in six orbital layers are obtained. As an example, we present a possible method of applying the PAL2v model to the use of Raman spectroscopy signals in the detection of lubricating mineral oil quality.

Deep neural networks (DNNs), founded on the brain's neuronal organization, can extract higher-level features from raw input. However, complex intellect via autonomous decision-making is way beyond current AI design. Here we propose an autonomous AI inspired by the thermodynamic cycle of sensory perception, operating between two information density reservoirs. Stimulus unbalances the high entropy resting state and triggers a thermodynamic cycle. By recovering the initial conditions, self-regulation generates a response while accumulating an orthogonal, holographic potential. The resulting high-density manifold is a stable memory and experience field, which increases future freedom of action via intelligent decision-making.

From physics to the social sciences, information is now seen as a fundamental component of reality. However, a form of information seems still underestimated, perhaps precisely because it is so pervasive that we take it for granted: the information encoded in the very environment we live in. We still do not fully understand how information takes the form of cities, and how our minds deal with it in order to learn about the world, make daily decisions, and take part in the complex system of interactions we create as we live together. This paper addresses three related problems that need to be solved if we are to understand the role of environmental information: (1) the physical problem: how can we preserve information in the built environment? (2) The semantic problem: how do we make environmental information meaningful? And (3) the pragmatic problem: how do we enact environmental information in our daily lives? Attempting to devise a solution to these problems, we introduce a three-layered model of information in cities, namely environmental information in physical space, environmental information in semantic space, and the information enacted by interacting agents. We propose forms of calculating entropy in these different layers, and apply these measures to archetypal urban cases and simulated scenarios. Our results suggest that ordered spatial structures and diverse land use patterns encode information, and that aspects of physical and semantic information affect coordination in interaction systems.

A convenient practical model for accurately estimating the total entropy (ΣSi) of atmospheric gases based on physical action is proposed. This realistic approach is fully consistent with statistical mechanics, but reinterprets its partition functions as measures of translational, rotational and vibrational action or quantum states, to estimate the entropy. With all kinds of molecular action expressed as logarithmic functions, the total heat required for warming a chemical system from 0o K (ΣSiT) to a given temperature and pressure can be computed, yielding results identical with published experimental third law values of entropy. All thermodynamic properties of gases including entropy, enthalpy, Gibbs energy and Helmholtz energy are directly estimated using simple algorithms based on simple molecular and physical properties, without resource to tables of standard values; both free energies are measures of quantum field states and of minimal statistical degeneracy, decreasing with temperature and declining density. We propose that this more realistic approach has heuristic value for thermodynamic computation of atmospheric profiles, based on steady state heat flows equilibrating with gravity. Potentially, this application of an action principle can provide better understanding of emergent properties of many natural or evolving complex systems, including modelling of predictions for global warming.

The article analyzes Bernoulli 's binary sequences in representation of empirical events about the distribution of natural resources and population sizes. Considering the event as a nonlinear system, and consisting of two dependent random variables, with memory and probabilities in maximum finite or infinite lengths, constant and equal to ½ for both variables (stationary process). The expressions of the possible trajectories remain constant in sequences that are repeated alternating the presence or absence of one of the variables at each iteration (asymmetric). There are constant oscillations in the event except if the variables X₁ and X₂ are regulated as a function of time Y. It is observed that the variables X₁ and X₂ assume in time T_k → ∞ specific behaviors (geometric variable) that can be used as management tools for random systems. In this way, the article seeks to know from this analyzes, the maximum entropy of information in the system by a theoretical view and how to model resources distribution or containment in the given problem.

The object of this paper is the bending analysis of isotropic rectangular Kirchhoff plates subjected to a thermal gradient (TG) using the Fourier transform method. The bottom and top surfaces of the plate are assumed to have different changes in temperature, whereas the change in temperature of the mid-surface is zero. According to classical plate theory, the governing equation of the plate contains second derivatives of the TG; these derivatives are zero by constant value of the TG, which leads to the absence of the TG in the governing equation. This paper presented an approach by which Fourier sine transform was utilized to describe the TG, while the double trigonometric series of Navier and the simple trigonometric series of Lévy were utilized to describe the deflection. Thus, the TG appeared in the governing equation, which simplified the analysis. Rectangular plates simply supported along all edges were analyzed, bending moments, twisting moments, and deflections being determined. In addition, rectangular plates simply supported along two opposite edges were analyzed, the other edges having various support conditions (free, simply supported, and fixed).

The residual multiparticle entropy (RMPE) of a fluid is defined as the difference, Δs, between the excess entropy per particle (relative to an ideal gas with the same temperature and density), s_ex, and the pair-correlation contribution, s₂. Thus, the RMPE represents the net contribution to s_ex due to spatial correlations involving three, four, or more particles. A heuristic “ordering” criterion identifies the vanishing of the RMPE as an underlying signature of an impending structural or thermodynamic transition of the system from a less ordered to a more spatially organized condition (freezing is a typical example). Regardless of this, the knowledge of the RMPE is important to assess the impact of non-pair multiparticle correlations on the entropy of the fluid. Recently, an accurate and simple proposal for the thermodynamic and structural properties of a hard-sphere fluid in fractional dimension 1 < d < 3 has been proposed [Santos, A.; López de Haro, M. Phys. Rev. E 2016, 93, 062126]. The aim of this work is to use this approach to evaluate the RMPE as a function of both d and the packing fraction ϕ. It is observed that, for any given dimensionality d, the RMPE takes negative values for small densities, reaches a negative minimum Δs_min at a packing fraction ϕ_min, and then rapidly increases, becoming positive beyond a certain packing fraction ϕ₀. Interestingly, while both ϕ_min and ϕ₀ monotonically decrease as dimensionality increases, the value of Δs_min exhibits a nonmonotonic behavior, reaching an absolute minimum at a fractional dimensionality d ≃ 2.38. A plot of the scaled RMPE Δs/|Δs_min| shows a quasiuniversal behavior in the region −0.14 ≲ ϕ − ϕ₀ ≲ 0.02.

Bijective Analysis of 4D Minkowski space-time model confirms that 4D space-time where time would be 4th dimension of space does not exist. In 4D manifold, time is the duration of a physical event which runs in space. An event does not have the duration in time, duration itself is time. It means that any given physical phenomena can only be symmetric in space; not in time.

Voronoi entropy for the random patterns and patterns demonstrating various elements of symmetry are calculated. The symmetric patterns are characterized by the values of the Voronoi entropy very close to those inherent to random ones. This contradicts the idea that the Voronoi entropy quantifies the ordering of the seed points, constituting the pattern. The extension of the Shannon-like formula embracing symmetric patterns is suggested. Analysis of Voronoi diagrams enables revealing of the elements of symmetry of the pattern.

The entropy of Boltzmann-Gibbs, as proved by Shannon and Khinchin, is based on four axioms, where the fourth one concerns additivity. The group theoretic entropies make use of formal group theory to replace this axiom with a more general composability axiom. As has been pointed out before, generalized entropies crucially depend on the number of allowed number degrees of freedom $N$. The functional form of group entropies is restricted (though not uniquely determined) by assuming extensivity on the equal probability ensemble, which leads to classes of functionals corresponding to sub-exponential, exponential or super-exponential dependence of the phase space volume $W$ on $N$. We review the ensuing entropies, discuss the composability axiom, relate to the Gibbs' paradox discussion and explain why group entropies may be particularly relevant from an information theoretic perspective.

Due to related uncertainties brought by changes in energy consumption and the integration of rooftop photovoltaic systems, the accuracy and availability of load profiling data are difficult to achieve. However, project managers and planners use a precise load profile as a crucial tool when determining whether the feeder must be updated or de-loaded. The paper aims to create a non-intrusive monitoring system that predicts the synthetic load profiles behavior of energy consumption using a Light Gradient Boosted and Support Vector Machine (SVM) machine learning technique. The most effective ML algorithm is chosen, and it has the potential to be assessed and verified using validation curves, residuals model generation, and prediction error metrics based on the following key statistical indicators: Mean Absolute Error, Mean Square Error, Root Mean Square Error, R-Square, Root Mean Squared Logarithmic Error, and Mean Absolute Percentage Error. The most effective ML has the potential to be assessed and verified using validation curves, residual model generation, and prediction error metrics based on the following key statistical indicators. The result shows that the estimation of the Irms avg -based on LightGBM is more accurate than the SVM because of its quick, economical, and difficult to overfit, particularly with high-dimensional data, speed, and efficiency of the MAE (3.0698), MSE (15.2757), RMSE (3.9020), RMSLE (0.1433), and MAPE (0.0049) respectively. Additionally, the machine learning model shows that, when compared to the SVM, the LightGBM model had the highest accurate prediction, with R-Square values of 89.8%, 90.3%, and 88.5% for Irms_A_avg, Irms_B_avg, and Irms_C_avg, respectively for Brakfontein Substation supply region, and best represents a diverse customer base.

Following a recent proof of Shannon's entropy power inequality (EPI), a comprehensive framework for deriving various EPIs for the Rényi entropy is presented that uses transport arguments from normal densities and a change of variable by rotation. Simple arguments are given to recover the previously known Rényi EPIs and derive new ones, by unifying a multiplicative form with constant c and a modification with exponent α of previous works. In particular, for log-concave densities, we obtain a simple transportation proof of a sharp varentropy bound.

Gait is a basic cognitive propositive action that has been shown to be altered in late stages of neurodegenerative dementias. Nevertheless, alterations are less clear in mild forms of dementia, and the potential use of gait analysis as a biomarker of initial cognitive decline has hitherto mostly been neglected. We here report the results of a study of gait kinematic time series for two groups of patients (Mild Cognitive Impairment and mild Alzheimer's disease) and a group of matched control subjects. Two metrics based on permutation patterns are considered, respectively measuring the complexity and irreversibility of the time series. Results indicate that kinematic disorganisation is present at early phases of cognitive impairment; in addition, they depict a rich scenario, in which some joint movements display an increased complexity and irreversibility, while others a marked decrease. Beyond their potential use as biomarkers, complexity and irreversibility metrics can open a new door towards the understanding of the role of the nervous system in gait, as well as its adaptation and compensatory mechanisms.

The maximization of entropy S within a closed system is accepted as an inevitability (as the second law of thermodynamics) by statistical inference alone. The Maximum Entropy Production Principle (MEPP) states that not only S maximizes, but $\dot{S}$ as well: a system will dissipate as fast as possible. There is still no consensus on the general validity of this MEPP, even though it shows remarkable explanatory power (both qualitatively and quantitatively), and has been empirically demonstrated for many domains. In this theoretical paper I provide a generalization of entropy gradients, to show that the MEPP actually follows from the same statistical inference, as that of the 2nd law of thermodynamics. For this generalization I only use the concepts of super-statespaces and microstate-density. These concepts also allow for the abstraction of 'Self Organizing Criticality' to a bifurcating local difference in this density, and allow for a generalization of the fundamentally unresolved concepts of 'chaos' and 'order'.

Commercial buildings are a significant consumer of energy worldwide. Logistics facilities, and specifically warehouses, are a common building type yet under-researched in the demand-side energy forecasting literature. Warehouses have an idiosyncratic profile when compared to other commercial and industrial buildings with a significant reliance on a small number of energy systems. As such, warehouse owners and operators are increasingly entering in to energy performance contracts with energy service companies (ESCOs) to minimise environmental impact, reduce costs, and improve competitiveness. ESCOs and warehouse owners and operators require accurate forecasts of their energy consumption so that precautionary and mitigation measures can be taken. This paper explores the performance of three machine learning models (Support Vector Regression (SVR), Random Forest, and Extreme Gradient Boosting (XGBoost)), three deep learning models (Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), and Gated Recurrent Unit (GRU)), and a classical time series model, Autoregressive Integrated Moving Average (ARIMA) for predicting daily energy consumption. The dataset comprises 8,040 records generated over an 11-month period from January to November 2020 from a non-refrigerated logistics facility located in Ireland. The grid search method was used to identify the best configurations for each model. The proposed XGBoost models outperform other models for both very short load forecasting (VSTLF) and short term load forecasting (STLF); the ARIMA model performed the worst.

Synthetic polymer-based gradient foams have considered as promising category of functionally graded materials with unique properties. In this study, the carbon dioxide (CO₂) foaming technology has used for PET-PEN (Polyethylene Terephthalate - Polyethylene Naphthalate) copolymer towards porous functional materials with thermal insulation with reasonable mechanical strength. Through scanning electron microscope based morphological characterization, a potential to fabricate gradient foam structures with micro-pores has identified. It has shown that variation of post-foaming temperature can tune the pore size distribution although the very high post-foaming temperature tends to cause structural instability. Thermal measurement data set the limits of operation, confirmed by simultaneous differential scanning calorimeter and thermo-gravimetric analysis. Mechanical stress and thermal conductivity also has measured to find rationale of thermal insulation with reasonable mechanical strength and to elucidate the actual 3D grid foam of copolymer.

The out-of-equilibrium dynamics of many body systems has recently received a burst of interest, also due to experimental implementations. The dynamics of both observables, such as magnetization and susceptibilities, and quantum information related quantities, such as concurrence and entanglement entropy, have been investigated under different protocols bringing the system out of equilibrium. In this paper we focus on the entanglement entropy dynamics under a sinusoidal drive of the tranverse magnetic field in the 1D quantum Ising model. We find that the area and the volume law of the entanglement entropy coexist under periodic drive for an initial non-critical ground state. Furthermore, starting from a critical ground state, the entanglement entropy exhibits finite size scaling even under such a periodic drive. This critical-like behaviour of the out-of-equilibrium driven state can persist for arbitrarily long time, provided that the entanglement entropy is evaluated on increasingly subsytem sizes, whereas for smaller sizes a volume law holds. Finally, we give an interpretation of the simultaneous occurrence of critical and non-critical behaviour in terms of the propagation of Floquet quasi-particles.

Bello's stochastic linear time-varying system theory has been widely used in the wireless communications literature to characterize multipath fading channel statistics. In the context of radar backscatter, this formulation allows for statistical characterization of distributed radar targets in range and Doppler using wide-sense stationary uncorrelated scattering (WSSUS) models. WSSUS models separate the channel from the effect of the waveform and receive filter, making it an ideal formulation for waveform design problems. Of particular interest in the radar waveform design community is the ability to suppress unwanted backscatter from the earth's surface, known as clutter. Various methods for estimating WSSUS system functions have been studied in the literature, but to date, no analytic expressions for radar surface clutter range-Doppler scattering functions exist. In this work we derive a wideband generalization of the Jakes Doppler spectrum model, which is widely used in the wireless communications literature, adapt it for use in radar problems, and show how the maximum entropy method can be used to extend this model to account for internal clutter motion. Validation of the spectral and stationarity properties of the proposed model against a subset of the Australian Ingara sea clutter database is performed, and good agreement is shown.

Three-dimensional (3D) cell culture is considered more clinically relevant in mimicking the structural and physiological conditions of tumors in vivo compared to two-dimensional cell cultures. In recent years, high-throughput screening (HTS) in 3D cell arrays has been extensively used for drug discovery because of its usability and applicability. Herein, we developed a microfluidic spheroid culture device (μFSCD) with a concentration gradient generator (CGG) that enabled cells to form spheroids and grow in the presence of cancer drug gradients. The device is composed of concave microwells with several serpentine micro-channels which generate a concentration gradient. Once the colon cancer cells (HCT116) formed a single spheroid (approximately 120 μm in diameter) in each microwell, spheroids were perfused in the presence of the cancer drug gradient irinotecan for 3 days. The number of spheroids, roundness, and cell viability, were inversely proportional to the drug concentration. These results suggest that the μFSCD with a CGG has the potential to become an HTS platform for screening the efficacy of cancer drugs.

Hyperspectral images are an important tool to assess ecosystem biodiversity both on terrestrial and benthic habitats. To obtain more precise analysis of biodiversity indicators that agree with indicators obtained using field data, analysis of spectral diversity calculated from images have to be validated with field based diversity estimates. The plant species richness is one of the most important indicators of biodiversity. This indicator can be measured in hyperspectral images considering the Spectral Variation Hypothesis (SVH) which states that the spectral heterogeneity is related to spatial heterogeneity and thus to species richness. The goal of this research is to capture spectral heterogeneity from hyperspectral images for a terrestrial neo tropical forest site using Vector Quantization (VQ) method and then use the result for prediction of plant species richness. The results are compared with that of Hierarchical Agglomerative Clustering (HAC). The validation of the process index is done calculating the Pearson correlation coefficient between the Shannon entropy from actual field data and the Shannon entropy computed in the images. Terrestrial dry forest and marine coastal hyperspectral images with different resolutions have been used for spectral diversity feature validation.

Study background and aims: Laparoscopic cholecystectomy is one of the most frequently performed interventions in departments of general surgery. One of the most important aims in achieving perioperative stability of these patients is diminishing the impact of general anesthesia on the hemodynamic stability and the optimization of anesthetic drug doses based on the individual clinical profile of each patient. The objective of this study is the evaluation of the impact monitoring the depth of anesthesia through Entropy (state entropy – SE and response entropy -RE) has on the hemodynamic stability and on the doses of volatile anesthetic. Material and Methods: This is a prospective, observational, randomized, monocentric study carried out between January 2019 and December 2019 in the Clinic of Anesthesia and Intensive Care from the “Pius Brînzeu” Emergency County Hospital in Timișoara, Romania. The patients included in the study were divided in two study groups; patients in Group A (target group) received multimodal monitoring that included monitoring of standard parameters and of Entropy (SE and RE), while patients in Group B (control group) only received standard monitoring. Anesthetic dose in group A were optimized to achieve a target entropy of 40-60. Results: 68 patients met the inclusion criteria and were allocated to one of the two study groups, Group A (N=43) and Group B (N=25). There were no statistically significant differences identified between the two groups for both demographical and clinical data (p>0.05). Statistically significant differences have been identified for the number of hypotensive episodes (p = 0.011, 95% CI 0.1851 to 0.7042) and for the number of episodes of bradycardia (p < 0.0001, 95% CI 0.3296 to 0.7923). Moreover, there was a significant difference in the Sevoflurane consumption between the two study groups (p = 0.0498, 95% CI -0.3942 to 0.9047). Conclusions: The implementation of the multimodal monitoring protocol that includes the standard parameters and the measurement of Entropy for determining the depth of anesthesia (SE and RE) lead to a considerable improvement in perioperative hemodynamic stability. Optimizing the doses of anesthetic drugs based on the individual clinical profile of each patient leads to a considerable decrease in drug consumption as well as to a lower incidence of hemodynamic side-effects.

Boolean functions and networks are commonly used in the modeling and analysis of complex biological systems, and this paradigm is highly relevant in other important areas in data science and decision making, such as in the medical field and in the finance industry. In a Boolean model, the truth state of a variable is either 0 or 1 at a given time. Despite its apparent simplicity, Boolean networks are surprisingly relevant in many areas of application such as in bioinformatics to model gene expressions and interactions. In the latter case, a gene is either ``on" or ``off" depending on its expression level. Despite the promising utility of Boolean modeling, in most practical applications the Boolean network is not known. Automated learning of a Boolean network and Boolean functions, from data, is a challenging task due in part to the large number of unknowns (including both the structure of the network and the functions) to be estimated, for which a brute force approach would be exponentially complex. In this paper we develop a new information theoretic methodology that we show to be significantly more efficient than previous approaches. Building on the recently developed optimal causation entropy principle (oCSE), that we proved can correctly infer networks distinguishing between direct versus indirect connections, we develop here an efficient algorithm that furthermore infers a Boolean network (including both its structure and function) based on data observed from the evolving states at nodes. We call this new inference method, Boolean optimal causation entropy (BoCSE), which we will show that our method is both computationally efficient and also resilient to noise. Furthermore, it allows for selection of a set of features that best explains the process, a statement that can be described as a networked Boolean function reduced order model. We highlight our method to the feature selection in several real-world examples: (1) diagnosis of urinary diseases, (2) Cardiac SPECT diagnosis, (3) informative positions in the game Tic-Tac-Toe, and (4) risk causality analysis of loans in default status. Our proposed method is effective and efficient in all examples.

Autofocus is an essential part of the SAR imaging process. Multi-subaperture autofocus algorithm is a commonly used autofocus algorithm for processing SAR stripmap mode data. The multi-subaperture autofocus algorithm has two main steps, the first is to estimate the phase error gradient within the subaperture, the second is to splice the phase error gradient, that is, to remove the shift amount between the estimated adjacent subapertures’ error gradients. Previous gradient-splicing algorithms assume that the estimation of subaperture error is accurate, but when the estimation of subaperture phase error gradients is not accurate enough, these algorithm performance will be degraded. A new phase error gradient splicing algorithm is proposed in this paper. It roughly estimates the shift amount first, and then finely estimates the shift amount based on the minimum-entropy criterion, which can improve the robustness of splicing especially when the estimation of the phase error gradients of the subaperture is not accurate enough. To speed up the algorithm, a variable-step-size search method is used. Simulation and experimental results show that the algorithm has enough accuracy and still has good performance when other splicing algorithms doesn’t perform well.

The Carnot cycle and the attendant notions of reversibility and entropy are examined. It is shown how the modern view of these concepts still correspond to the ideas Clausius laid down in the nineteenth century. As such, they reflect the outmoded idea current at the time that heat is motion. It is shown how this view of heat led Clausius to develop the entropy of a body based on the work that could be done in a reversible process rather than the work that was actually done. In consequence, Clausius built into entropy a conflict with energy conservation, which is concerned with actual changes in energy. In this paper, a macroscopic formulation of internal mechanisms of damping based on rate equations for the distribution of energy within a gas. It is shown that work processes involving a step-change in external pressure, however small, are intrinsically irreversible. However, under idealised conditions of zero damping the gas inside a piston expands and traces out a trajectory through the space of equilibrium states. Therefore, the entropy change due to heat flow from the reservoir matches the entropy change of the equilibrium states. This trajectory can traced out in reverse as the piston reverses direction, but if the external conditions are adjusted appro-priately, the gas can be made to trace out a Carnot cycle in P-V space. The cycle is dynamic as opposed to quasi-static as the piston has kinetic energy equal in difference to the work done in-ternally and externally.

Lamellar eutectic structure of Al_0.7CoCrFeNi high-entropy alloy (HEA) is emerging as a promising candidate for structural applications because of its high strength-ductility combination. The alloy consists of a fine-scale lamellar fcc+B2 microstructure with high flow stresses >1500 MPa under quasi-static conditions. The response to shear loading was not investigated so far. This is the first report on the shear deformation of an eutectic structured HEA and effect of precipitation on shear deformation. The dynamic shear response (DSR) of the eutectic HEA was examined in two microstructural conditions, with and without the presence of L1₂ precipitates. A split-Hopkinson pressure bar (SHPB) was used to compress the hat-shaped specimens to study the local DSR of the alloy. The adiabatic shear bands (ASBs) in two different microstructural conditions were characterized after deformation at dynamic strain rates. The adiabatic shear localization occurs at low strains for the high strength material, and the eutectic microstructure does not delay cracking. The width of ASBs and the extent of plastic deformation around them has been correlated with the rate of straining. Dynamic recrystallization within ASBs and profuse twinning around it was observed. Local mechanical response of individual lamellae before and after shear deformation was examined using nano-indentation.

The generation of different types of defective viral genomes (DVG) is an unavoidable consequence of the error-prone replication of RNA viruses. In recent years, a particular class of DVGs, those containing long deletions or genome rearrangements, has gain interest due to their potential therapeutic and biotechnological applications. Identifying such DVGs in high-throughput sequencing data has become an interesting computational problem. Up to nowadays, several algorithms have been proposed, though all incur in false positives, a problem of practical interest if such DVGs have to be synthetized and tested in the laboratory. Here we develop a novel software, DVGfinder, that wraps the two most commonly used algorithms into a pipeline that predicts DVGs. Using a gradient boosting classifier machine learning algorithm, we evaluate the performance of DVGfinder compared to previous algorithms and found that it outcompetes their precision and sensitivity in simulated datasets. DVGfinder generates user-friendly output files in HTML format that can assist users to identify DVGs based on their associated probability of being true positives.

The effect of Zr addition on the melting temperature of the CoCrFeMnNi High Entropy Alloy (HEA), known as the “Cantor’s Alloy”, is investigated, together with its microstructure, mechan-ical properties and thermo-mechanical recrystallization process. The base and Zr-modified al-loys are obtained by vacuum induction melting of mechanically pre-alloyed powders followed by recrystallization. The alloys were characterized by X-ray diffraction, scanning and transmis-sion electron microscopy, thermal analyses, mechanical spectroscopy and indentation measures. The main advantages of Zr addition are: 1) a fast vacuum induction melting (VIM) process; 2) the lower melting temperature, due to Zr eutectics formation with all the Cantor’s alloy elements; 3) the good chemical alloy homogeneity; 4) the mechanical properties improvement of recrystallized grains with a coherent structure. The crystallographic lattice of both alloys resulted to be FCC. Results demonstrate that the Zr-modified HEA presents a higher recrystallization temperature and smaller grain size after recrystallization with respect to the Cantor’s alloy, with precipita-tion of a coherent second phase which enhance the alloy hardness and strength, while maintaining a good tensile ductility.

Human Face and facial parts are the most significant parts as it reveals a person’s true identity. It plays an important role in various biometric applications like crowd analysis, human tracking, photography, cosmetic surgery, etc. There are many techniques are available to detect a facial image. Among them, skin detection is the most popular one. The aim of this paper is to detect first the person's identity from facial image and finally check any spot present the the detected person. The first step is to detect the maximum skin region based on a combination method of RGB and HSV color space model. Next it is to verify the skin areas of human through machine learning approach. The Aggregated Channel Features (ACF) detector is used to identify the different facial parts like eye pairs, nose, and mouth. Bootstrap aggregation decision tree classifier is applied to classify the person’s identity based on Histogram Oriented Gradient (HOG) features value. The experimental results show that the proposed method gives the average 97% accuracy.

This is a review of efforts to discover action principles for Hydrodynamics and Thermodynamics. The work began with a determined attempt to create sources for Einstein's equations that describe continuous matter - as opposed to point particles. This requires a relativistic action principle. This report is mainly about (non relativistic) Adiabatic Thermodynamics, non equilibrium thermodynamics based on the method of Gibbs. The main relations of classical thermodynamics can be derived from an action principle, in the classical global form and in the local form advocated by Callen. The entropy is defined as the negative derivative of the free energy (free energy density) with respect to the volume (density). This is integrated with an action principle for hydrodynamics that was known to Lagrange in 1760. It is strongly limited to irrotational velocity fields, nevertheless it provides the needed Lagrangian for a large part of thermodynamics. This is the subject of the first 3 sections. It includes a brief review of a new theory of mixtures. The most difficult part of the program has been the discovery of Conservative Hydrodynamics with the required four independent degrees of freedom, with general flows. We give an account of the genesis and the structure of this theory, then a tour of recent applications.

The Landauer principle supplies the estimation of the minimal mass of a particle which is capable to record/erase information within a thermal bath at the temperature of T. Particles lighter than ${\tilde{m}}_0=\frac{k_{B}Tln2}{c^2}$will not transform the information to the surrounding bodies and are well expected to be undetectable. The relation of the Landauer principle to the problem of “dark matter” is discussed. The maximal informational content of a particle at rest, estimated as $I_{max}=\frac{m_0{c}^2}{k_{B}Tkn2}$ is introduced. The Landauer principle also allows the estimation of minimal energy of the field which is capable to record/erase 1 bit of information in the surrounding at the temperature of T. The relativistic aspects of the Landauer principle and its relation to the relativistic transformation of temperature are addressed.

We consider the quantum thermodynamic origin of the gravitational force of matter by applying the spacetime entanglement entropy and the Unruh effect originating from vacuum quantum fluctuations. By analyzing both the local thermal equilibrium and quasi-static processes of a system, we may get both the magnitude and direction of Newton's gravitational force in our theoretical model. Our work shows the possibility that the elusive Unruh effect has already shown its manifestation through gravitational force.

This paper presents the automation of the thin-layer chromatography technique whose separation and identification of molecules present in a mixture are currently done manually and laboriously [1]. We have therefore found an interest in automating this technique. In this part, the method implemented comprises 2 steps. First we proceeded to the segmentation of the spots obtained on the chromatographic plate. We then developed a program to identify families of molecules such as coumarins, terpenes, tannins, flavonoids, polyphenols, etc. by calculating segmentation parameters such as standard deviation, entropy, average pixel intensity from an algorithm on the matlab software. Finally our results have been compared to the results obtained by the traditional identification technique in laboratories. Some similarity between the two results obtained shows the reliability and the robustness of our technique.

The current study aims to apply and compare the performance of six machine learning algorithms, including three basic classifiers: random forest (RF), gradient boosting decision tree (GBDT), and extreme gradient boosting (XGB), as well as their hybrid classifiers, using the logistic regression (LR) method (RF+LR, GBDT+LR, and XGB+LR), in order to map the landslide susceptibility of Zhangjiajie City, Hunan Province, China. First, a landslide inventory map was created with 206 historical landslide points and 412 non-landslide points, which was randomly divided into two datasets for model training (80%) and model testing (20%). Second, 15 landslide conditioning factors (i.e., altitude, slope, aspect, plane curvature, profile curvature, relief, roughness, rainfall, topographic wetness index (TWI), normalized difference vegetative index (NDVI), distance to roads, distance to rivers, land use/land cover (LULC), soil texture, and lithology) were initially selected to establish a landslide factor database. Thereafter, the multicollinearity test and information gain ratio (IGR) technique were applied to rank the importance of the factors. Subsequently, we used a series of metrics (e.g., accuracy, precision, recall, f-measure, area under the ROC (receiver operating characteristic) curve (AUC), kappa index, mean absolute error (MAE), and root mean square error (RMSE)) to evaluate the accuracy and performance of the six models. Based on the AUC values derived from the models, the GBDT+LR model with the highest AUC value (0.8168) was identified as the most efficient model for mapping landslide susceptibility, followed by the XGB+LR, XGB, RF+LR, GBDT, and RF models, which achieved AUC values of 0.8124, 0.8118, 0.8060, 0.7927, and 0.7883, respectively. The results from this study suggest that the stacking ensemble machine learning method is promising for use in landslide susceptibility mapping in the Zhangjiajie area and is capable of targeting the areas prone to landslides.

The Maximum Entropy Theory of Ecology, or METE, is a theoretical framework of macroecology that makes a variety of realistic ecological predictions about how species richness, abundance of species, metabolic rate distributions, and spatial aggregation of species interrelate in a given region. In the METE framework, "ecological state variables" (representing total area, total species richness, total abundance, and total metabolic energy) describe macroecological properties of an ecosystem. METE incorporates these state variables into constraints on underlying probability distributions. The method of Lagrange multipliers and maximization of information entropy (MaxEnt) lead to predicted functional forms of distributions of interest. We demonstrate how information entropy is maximized for the general case of a distribution, which has empirical information that provides constraints on the overall predictions. We then show how METE’s two core functions are derived. These functions, called the "Spatial Structure Function" and the "Ecosystem Structure Function" are the core pieces of the theory, from which all the predictions of METE follow (including the Species Area Distribution, the Species Abundance Distribution, and various metabolic distributions). Primarily, we consider the discrete distributions predicted by METE.We also explore the parameter space defined by the METE’s state variables and Lagrange multipliers. We aim to provide a comprehensive resource for ecologists who want to understand the derivations and assumptions of basic mathematical structure of METE.

The heat and matter transfer during glucose catabolism in living systems and their relation with entropy production are a challenging subject of the classical thermodynamics applied to biology. In this respect, an analogy between mechanics and thermodynamics has been performed via the definition of the entropy density acceleration expressed by the time derivative of the rate of entropy density and related to heat and matter transfer in minimum living systems. Cells are regarded as open thermodynamic systems that exchange heat and matter resulting from irreversible processes with the intercellular environment. Prigogine’s minimum energy dissipation principle is reformulated using the notion of entropy density acceleration applied to glucose catabolism. It is shown that, for out-of-equilibrium states, the calculated entropy density acceleration is finite and negative and approaches as a function of time a zero value at global thermodynamic equilibrium for heat and matter transfer independently of the cell type and the metabolic pathway. These results could be important for a deeper understanding of entropy generation and its correlation with heat transfer in cell biology with special regard to glucose catabolism representing the prototype of irreversible reactions and a crucial metabolic pathway in stem cells and cancer stem cells.

Solidification cracking is a major obstacle when joining dissimilar alloys using additive manufacturing. In this work, location-specific solidification cracking susceptibility has been investigated using an integrated computational materials engineering (ICME) approach for a graded alloy formed by mixing P91 steel and Inconel 740H superalloy. An alloy derived from a mixture of 26 wt.% P91 steel and 74 wt.% Inconel 740H, with high configurational and total entropy, was fabricated using wire-arc additive manufacturing. Microstructure characterization revealed intergranular solidification cracks, which increased in length along with the build height. With inputs from experiments, such as secondary dendrite arm spacing, the DICTRA (diffusion-controlled transformations) module within the Thermo-Calc software was used to model location-specific solidification cracking susceptibility. The top region, with the highest cooling rate, has the highest solidification cracking susceptibility and is in good agreement with the experimentally observed crack length. From Scheil simulations, it was deduced that pronounced segregation of Nb and Cu within the cracks increased the solidification range by suppressing the solidus temperature. The overall solidification cracking susceptibility and freezing range was highest for the 26 wt.% P91 alloy amongst the mixed compositions between P91 steel and 740H superalloy, proving that solidification characteristics play a major role in alloy design for additive manufacturing.

The time’s arrow of macroscopic physical phenomenon is reflected by irreversible physical process, which essentially occurs from small probability state to high probability state. In this paper, simplified models are proposed to understand the macroscopic physical process. In order to describe the information of a physical system, we defined the full self-information as "information height" to describe the complexity or difficulty of a macrostate of physical system. In this way, the direction of macroscopic physical process is from high information height to low information height. We can judge the direction of physical process by the information height. If we want the macroscopic physical process to evolve from the low information height state to the high information height state, the system need to add extra information and corresponding energy to increase the information height.

In our recently proposed theory of quantum gravity, a black hole arises from the spontaneous localisation of an entangled state of a large number of atoms of space-time-matter [STM]. Prior to localisation, the non-commutative curvature of an STM atom is described by the spectral action of non-commutative geometry. By using the techniques of statistical thermodynamics from trace dynamics, we show that the gravitational entropy of a Schwarzschild black hole results from the microstates of the entangled STM atoms and is given (subject to certain assumptions) by the classical Euclidean gravitational action. This action, in turn, equals the Bekenstein-Hawking entropy (Area/$4{L_P}^2$) of the black hole. We argue that spontaneous localisation is related to black-hole evaporation through the fluctuation-dissipation theorem.

While entropy was introduced in the second half of the 19th century in the international vocabulary as a scientific term, in the 20th century it became common in colloquial use. Popular imagination has loaded “entropy” with almost every negative quality in the universe, in life and in society, with a dominant meaning of disorder and disorganization. Exploring the history of the term and many different approaches on it, we show that entropy has a universal stochastic definition which is not disorder. The accompanying principle of maximum entropy, which lies behind the Second Law, gives explanatory and inferential power to the concept and promotes entropy as the mother of creativity and evolution. As social sciences are often contaminated by subjectivity and ideological influences, we try to explore whether the maximum entropy, applied to the distribution of wealth quantified by annual income, can give an objective description. Using publicly available income data, we show that the income distribution is consistent with the principle of the maximum entropy. The increase of entropy is associated to increase of society’s wealth yet a standardized form of entropy can be used to quantify inequality. Historically, technology has played a major role in development and increase of the entropy of income. Such findings are contrary to the theories of ecological economics and other theories which use the term entropy in a Malthusian perspective.

The Schelling model of segregation allows for a general description of residential movements in an environment modeled by a lattice. The key factor is that occupants change positions until they are surrounded by a designated minimum number of similarly labeled residents. An analogy to the Ising model has been made in previous research, primarily due the assumption of state changes being dependent upon the adjacent cell positions. This allows for concepts produced in statistical mechanics to be applied to the Schelling model. Here is presented a methodology to estimate the entropy of the model for different states of the simulation. A Monte Carlo estimate is obtained for the set of macrostates defined as the different aggregate homogeneity satisfaction values across all residents, which allows for the entropy value to be produced for each state. This produces a trace of the estimated entropy value for the states of the lattice configurations to be displayed with each iteration. The results show that the initial random placements of residents have larger entropy values than the final states of the simulation when the overall homogeneity of the residential locality is increased.

For the solution existence condition of the Navier-Stokes equation, we propose a conjecture as follows: "\emph{The Navier-Stokes equation has a solution if and only if the determinant of flow velocity gradient is not zero, namely $\det (\bm \nabla \bm v)\neq 0$.}"

Drilling of wells for oil and gas production is a highly complex and expensive part of reservoir development. Thus, together with injury prevention, there is a goal to save cost expenditures on downtime and repair of drilling equipment. Nowadays companies have begun to look for ways to improve the efficiency of drilling and minimize non-production time with the help of new technologies. To support decisions in a narrow time frame, it is valuable to have an early warning system. Such a decision support system will help an engineer to intervene in the drilling process and prevent high expenses of unproductive time and equipment repair due to a problem. This work is describing a comparison of machine learning algorithms for anomaly detection during well drilling. Tested models classify drilling problems based on historical data from previously drilled wells. To validate anomaly detection algorithms, we use historical logs of drilling problems for 67 wells at a large brownfield in Siberia, Russia. Wells with problems were selected and analyzed. It should be noted that out of the 67 wells, 20 wells were drilled without expenses for unproductive time. Experiential results illustrated that a model based on gradient boosting can classify the complications in the drilling process best of all.

One of the intriguing recent results in the field of high-entropy alloys is the discovery of single-phase equiatomic multi-component Laves intermetallics. However, there is no clear understanding that a combination of chemical elements will form such high-entropy compounds. Here we contribute to understanding this issue by modifying the composition of duodenary TiZrHfNbVCrMoMnFeCoNiAl (12x) alloy in which we recently reported the fabrication of hexagonal C14 Laves phase. We consider three alloys based on 12x: 7x=12x-VCrMoMnFe, 12x+Sc, 12x+Be and observe that all of them crystalize with the formation of C14 Laves phase as a dominant structure. We report that 12x+Be alloy reveals single-phase C14 structure with very high concentration of structural defects and ultra-fine dendritic microstructure with almost homogenous distribution of the constituted elements over the alloy matrix. The 7x and 12x+Sc alloys contain C14 as a main phase and unknown impurity phases. To characterize the materials, we examine their heat capacity, electrical conductivity and magnetic properties. The measurements reveal that the Laves phases are Curie-Weiss paramagnets, which demonstrate metallic conduction; 7x and 12x alloys also reveal a pronounced Kondo-like anomaly. Analysis of experimental data as well as ab initio calculations suggests that chemical complexity and compositional disorder cause strong s-d band scattering and thus the rather high density of d-states in the conduction band. Analysis of the results suggests that the mechanism of Laves phase formation in multicomponent multi-principal element metallic alloys is may be the same as in polydisperse hardspheres mixtures. Another important conclusion is that the configurational entropy is a negligible factor in the stabilization of multi-element Laves phases.

The entropy models have been recently adopted in many studies to evaluate the distribution of the shear stress in circular channels. However, the uncertainty in their predictions and their reliability remains an open question. We present a novel method to evaluate the uncertainty of four popular entropy models, including Shannon, Shannon-Power Low (PL), Tsallis, and Renyi, in shear stress estimation in circular channels. The Bayesian Monte-Carlo (BMC) uncertainty method is simplified considering a 95% Confidence Bound (CB). We developed a new statistic index called as FREE_opt-based OCB (FOCB) using the statistical indices Forecasting Range of Error Estimation (FREE) and the percentage of observed data in the CB (N_in), which integrates their combined effect. The Shannon and Shannon PL entropies had close values of the FOCB equal to 8.781 and 9.808, respectively, had the highest certainty in the calculation of shear stress values in circular channels followed by traditional uniform flow shear stress and Tsallis models with close values of 14.491 and 14.895, respectively. However, Renyi entropy with much higher values of FOCB equal to 57.726 has less certainty in the estimation of shear stress than other models. Using the presented results in this study, the amount of confidence in entropy methods in the calculation of shear stress to design and implement different types of open channels and their stability is determined.

Primary energy consumption is one of the key drivers of global CO₂ emissions that, in turn, heavily depend on the efficiency of involved technologies. Either the improvement in technology efficiency or the expansion of non-fossil fuel consumption require large investments. The planning and financing of such investments, by policy makers or global energy firms, require, in turn, reliable measures of associated global spreads and their evolution in time. In this paper, our main contribution is the introduction of index measures for accessing global spreads (that is, measures of inequality or inhomogeneity in the statistical distribution of a related quantity of interest) of technology efficiency and CO₂ emission in primary energy consumption. These indexes are based on the Gini index, as used in economical sciences, and generalised entropy measures. Regarding primary energy sources, we consider petroleum, coal, natural gas and non-fossil fuels. Between our findings, we attest some stable relations in the evolution of global spreads of technology efficiency and CO₂ emission, and a positive relation between changes in global spreads of technology efficiency and use of non-fossil fuel.

Information-theoretically provable unique true random numbers, which cannot be correlated or controlled by an attacker, can be generated based on quantum measurement of vacuum state and universal-hashing randomness extraction. Quantum entropy in the measurements decides the quality and security of the random number generator (RNG). At the same time, it directly determines the extraction ratio of true randomness from the raw data, in other words, it obviously affects quantum random bits generating rate. In this work, we commit to enhancing quantum entropy content in the vacuum noise based quantum RNG. We have taken into account main factors in this proposal to establish the theoretical model of quantum entropy content, including the effects of classical noise, the optimum dynamical analog-digital convertor (ADC) range, the local gain and the electronic gain of the homodyne system. We demonstrate that by amplifying the vacuum quantum noise, abundant quantum entropy is extractable in the step of post-processing even classical noise excursion, which may be deliberately induced by an eavesdropper, is large. Based on the discussion and the fact that the bandwidth of quantum vacuum noise is infinite, we propose large dynamical range and moderate TIA gain to pursue higher local oscillator (LO) amplification of vacuum quadrature and broader detection bandwidth in homodyne system. High true randomness extraction ratio together with high sampling rate is attainable. Experimentally, an extraction ratio of true randomness of 85.3% is achieved by finite enhancement of the laser power of the LO when classical noise excursions of the raw data is obvious.

How to build an optimal model where three terms “time, causality, and entropy” will be interrelated in a most correct way? This task has a semantic and physical aspect. We give in this article the solution that is based only on elementary perception. In physics, we experience time with our senses as the duration of material change running in space. This fact is the standpoint for our model where causality is only a principle, it is not a physical actuality and entropy runs only in space and not in time. Time is merely a duration of entropy increasing and is entering existence when measured by the observer.

In this letter, instead of choosing the Einstein Rosen bridge between two black holes as in ER=EPR, we consider a wormhole between a black hole and a closed edge of the wormhole. We assume that information in a black hole travels through a wormhole, turns to mass (dark matter) in the closed region. This study is in contradiction with the existence of the white hole in our Universe. We replace the notion of the white hole with the massive closed region. We prove the metric of the closed region by the Hopf fibration, this new metric generalizes the $AdS_{5}$\ metric.

The emergence of various electronic devices and equipment such as electric vehicles and drones requires higher energy density energy storage devices. Lithium-sulfur batteries (LSBs) are considered as the most promising new generation energy storage system owing to high theoretical specific capacity and energy density. However, the severe shuttle behaviors of soluble lithium polysulfides (LiPSs) and the slow redox kinetics lead to low sulfur utilization and poor cycling stability, which seriously hinder the commercial application of LSBs. Therefore, various catalytic materials have been employed to solve these troublesome problems. High entropy materials (HEMs), as advanced materials, can provide unique surface and electronic structures that expose plentiful catalytic active sites, which opens new ideas for the regulation of LiPSs redox kinetics. Notwithstanding many instructive reviews in the land of LSBs, while this review aims to offer a complete and shrewd summary of the current progresses in HEMs-based LSBs, including in-depth interpretation of design principles and mechanistic electrocatalysis functions as well as pragmatic perspectives.

Although most biological processes are characterized by a strong temporal asymmetry, several popular mathematical models neglect this issue. Maximum entropy methods provide a principled way of addressing time irreversibility, which leverages powerful results and ideas from the3literature of non-equilibrium statistical mechanics. This article provides a comprehensive overview of these issues, with a focus in the case of spike train statistics. We provide a detailed account of the5mathematical foundations and work out examples to illustrate the key concepts and results from non-equilibrium statistical mechanics

The Thermodynamic Formalism provides a rigorous mathematical framework to study quantitative and qualitative aspects of dynamical systems. At its core there is a variational principle and corresponding, in its simplest form, to the Maximum Entropy principle, used as a statistical inference procedure to represent, by specific probability measures (Gibbs measures), the collective behaviour of complex systems. This framework has found applications in different domains of scienThe Thermodynamic Formalism provides a rigorous mathematical framework to study quantitative and qualitative aspects of dynamical systems. At its core there is a variational principle and corresponding, in its simplest form, to the Maximum Entropy principle, used as a statistical inference procedure to represent, by specific probability measures (Gibbs measures), the collective behaviour of complex systems. This framework has found applications in different domains of science, in particular, has been fruitful and influential in neurosciences. In this article, we review how the Thermodynamic Formalism can be exploited in the field of theoretical neuroscience, as a conceptual and operational tool, to link the dynamics of interacting neurons and the statistics of action potentials from either experimental data or mathematical models. We comment on perspectives and open problems in theoretical neuroscience that could be addressed within this formalism.ce, in particular, has been fruitful and influential in neurosciences. In this article, we review how the Thermodynamic Formalism can be exploited in the field of theoretical neuroscience, as a conceptual and operational tool, to link the dynamics of interacting neurons and the statistics of action potentials from either experimental data or mathematical models. We comment on perspectives and open problems in theoretical neuroscience that could be addressed within this formalism.

The continuous energy transformation processes in heating, ventilation and air conditioning systems of buildings are responsible for 36% of global final energy consumption. Tighter thermal insulation requirements for buildings have significantly reduced heat transfer losses. Unfortunately, this has little effect on energy demand for ventilation. On the basis of the First and the Second Law of Thermodynamics, the concepts of entropy and exergy are applied to the analysis of ventilation air handling unit (AHU) with a heat pump in this paper. This study aims to develop a consistent approach for this purpose, taking into account the variations of reference temperature and temperatures of working fluids. An analytical investigation on entropy generation and exergy analysis are used, when exergy is determined by calculating coenthalpies and evaluating exergy flows and their directions. The results show that each component of the AHU has its individual character of generated entropy, destroyed exergy and exergy efficiency variation. However, the evaporator of heat pump and fans have unabated quantities of exergy destruction. The exergy efficiency of AHU decreases from 45-55% to 12-15% when outdoor air temperature is within the range of –30°C…+10°C, respectively. This helps to determine conditions and components of improving the exergy efficiency of the AHU at variable real-world local climate conditions. The presented methodological approach could be used in the dynamic modelling software and contribute to a wider application of the Second Law of Thermodynamics in practice.

Physics has been thought to truly represent reality since at least Galileo, and the foundations of physics are always established using philosophical ideas. In particular, the elegant naming of physical entities is usually very influential in the acceptance of physical theories. We here demonstrate (using current developments in thermodynamics as an example) that both the epistemology and the ontology of physics ultimately rest on poetic language. What we understand depends essentially on the language we use. We wish to establish our knowledge securely, but strictly speaking this is impossible using only analytic language. Knowledge of the meanings of things must use a natural language designed to express meaning, that is, poetic language. Although the world is really there, and although we can indeed know it truly, this knowledge is never either complete or certain but ultimately must rest on intuition. Reading a recently discovered artefact with a palaeo-Hebrew inscription as from the first century, we demonstrate from it that this ontological understanding long predates the Hellenic period. Poetic language is primary, both logically and temporally.

This comprehensive analysis thoroughly examines the topic of adversarial attacks in artificial intelligence (AI), providing a detailed overview of the various methods used to compromise machine learning models. It explores different attack techniques, ranging from the simple Fast Gradient Sign Method (FGSM) to the intricate Carlini and Wagner Attack (C&W), emphasising the wide range of adversarial approaches and their intended goals. The discussion also distinguishes between targeted and non-targeted attacks, highlighting the adaptability and versatility of these malicious efforts. Additionally, the study delves into the realm of black-box attacks, revealing the capability of adversarial strategies to compromise models even with limited knowledge. Real-life examples illustrate the tangible consequences and potential dangers of adversarial attacks in various fields such as self-driving cars, multimedia, and voice assistants. These cases highlight the difficulties in ensuring the legitimacy and dependability of AI-powered technologies and programs. The article stresses the importance of ongoing research and innovation to address the growing difficulties posed by advanced methods like deepfakes and disguised voice commands in preserving the security of AI systems. This study provides valuable insights on how different adversarial strategies and defence mechanisms interact within AI. The results emphasise the urgent need for stronger and more secure AI models to combat the increasing number of adversarial threats in today's AI landscape. These findings can guide future research and innovations in developing more resilient AI technologies that can better withstand various adversarial vulnerabilities and challenges.

We investigate the physics of a medium-size quantum particle' gases, of the order of hundreds or thousands of fermions/bosons (far below the thermodynamic limit $N \, \rightarrow \, 10^{24}$). Appeal to microcanonical ensemble becomes then unavoidable. The so-called statistical complexity is our protagonist. Interesting facts are uncovered, both for fermions and bosons, yielded by statistical quantifiers.

Traditional discrimination techniques for Euler deconvolution use only the color spectrums of structural indexes, without considering the spatial distribution characteristics and inherent relationships among the Euler solutions to separate adjacent causative sources. In the present study, a new approach was developed for discriminating uncorrelated Euler solutions from coherent solutions based on the focusing levels indicated by the probability density distributions generated using multivariate kernel density estimations (KDE). A novel multiple coverage technique was proposed by using a series of different sized moving windows over gridded gravity data, which formed tight clusters of Euler solutions for different sized causative sources. The results of the probability density distributions were obtained using a 3-D KDE method for the Euler solution subsets {x, y, z} of synthetical models, and real data from a survey conducted in British Columbia (Canada) which had successfully established more credible and meaningful geological models when compared with three other subsets.