Working Paper Article Version 1 This version is not peer-reviewed

Eigen Artificial Neural Networks

Version 1 : Received: 14 September 2019 / Approved: 16 September 2019 / Online: 16 September 2019 (09:11:47 CEST)

How to cite: Yepes Barrera, F. Eigen Artificial Neural Networks. Preprints 2019, 2019060175 Yepes Barrera, F. Eigen Artificial Neural Networks. Preprints 2019, 2019060175


This work has its origin in intuitive physical and statistical considerations. The problem of optimizing an artificial neural network is treated as a physical system, composed of a conservative vector force field. The derived scalar potential is a measure of the potential energy of the network, a function of the distance between predictions and targets. Starting from some analogies with wave mechanics, the description of the sys-tem is justified with an eigenvalue equation that is a variant of the Schr˜odinger equation, in which the potential is defined by the mutual information between inputs and targets. The weights and parameters of the network, as well as those of the state function, are varied so as to minimize energy, using an equivalent of the variational theorem of wave mechanics. The minimum energy thus obtained implies the principle of minimum mutual information (MinMI). We also propose a definition of the potential work produced by the force field to bring a network from an arbitrary probability distribution to the potential-constrained system, which allows to establish a measure of the complexity of the system. At the end of the discussion we expose a recursive procedure that allows to refine the state function and bypass some initial assumptions, as well as a discussion of some topics in quantum mechanics applied to the formalism, such as the uncertainty principle and the temporal evolution of the system. Results demonstrate how the minimization of energy effectively leads to a decrease in the average error between network predictions and targets.


aritificial neural networks optimization; variational techniques; Minimum Mutual Information Principle; wave mechanics; eigenvalue problem


Computer Science and Mathematics, Computer Science

Comments (1)

Comment 1
Received: 16 September 2019
Commenter: Francisco Yepes Barrera
Commenter's Conflict of Interests: Author
Comment: Included submission notice to IEEE TRansactions on Neural Networks and Learning Systems on first page.
+ Respond to this comment

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 1
Metrics 0

Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.