Working Paper Article Version 1 This version is not peer-reviewed

Eigen Artificial Neural Networks

Version 1 : Received: 17 June 2019 / Approved: 18 June 2019 / Online: 18 June 2019 (12:36:02 CEST)

How to cite: Yepes Barrera, F. Eigen Artificial Neural Networks. Preprints 2019, 2019060175 Yepes Barrera, F. Eigen Artificial Neural Networks. Preprints 2019, 2019060175

Abstract

This work has its origin in intuitive physical and statistical considerations. The problem of optimizing an artificial neural network is treated as a physical system, composed of a conservative vector force field. The derived scalar potential is a measure of the potential energy of the network, a function of the distance between predictions and targets. Starting from some analogies with wave mechanics, the description of the system is justified with an eigenvalue equation that is a variant of the Schrõdinger equation, in which the potential is defined by the mutual information between inputs and targets. The weights and parameters of the network, as well as those of the state function, are varied so as to minimize energy, using an equivalent of the variational theorem of wave mechanics. The minimum energy thus obtained implies the principle of minimum mutual information (MinMI). We also propose a definition of the work produced by the force field to bring a network from an arbitrary probability distribution to the potential-constrained system. At the end of the discussion we expose a recursive procedure that allows to refine the state function and bypass some initial assumptions. The results demonstrate how the minimization of energy effectively leads to a decrease in the average error between network and target predictions.

Subject Areas

aritificial neural networks optimization; variational techniques; Minimum Mutual Information Principle; wave mechanics; eigenvalue problem

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our diversity statement.

Leave a public comment
Send a private comment to the author(s)
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.