Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

Evolutionary Reinforcement Learning of Neural Network Controller for Acrobot Task — Part3: Differential Evolution

Version 1 : Received: 1 February 2024 / Approved: 2 February 2024 / Online: 2 February 2024 (09:12:20 CET)

How to cite: Okada, H. Evolutionary Reinforcement Learning of Neural Network Controller for Acrobot Task — Part3: Differential Evolution. Preprints 2024, 2024020145. https://doi.org/10.20944/preprints202402.0145.v1 Okada, H. Evolutionary Reinforcement Learning of Neural Network Controller for Acrobot Task — Part3: Differential Evolution. Preprints 2024, 2024020145. https://doi.org/10.20944/preprints202402.0145.v1

Abstract

Evolutionary algorithms find applicability in reinforcement learning of neural networks due to their independence from gradient-based methods. To achieve successful training of neural networks using evolutionary algorithms, careful considerations must be made to select appropriate algorithms due to the availability of various algorithmic variations. In Part1 and Part2, the author previously reported experimental evaluations on Genetic Algorithm and Evolution Strategy for reinforcement learning of neural networks, utilizing the Acrobot control task. This article constitutes Part3 of the series of comparative research. In this study, Differential Evolution is adopted as the third instance of major evolutionary algorithms. The experimental results show a statistically significant superiority of DE over both GA and ES (p < .01). In addition, DE exhibits its robustness to variations in hyperparameter configurations (the number of offsprings and generations). In the previous experiments, both ES and GA showed significant performance differences depending on the configurations, whereas in the experiment reported in this article, such differences are not detected for DE.

Keywords

evolutionary algorithm; differential evolution; neural network; neuroevolution; reinforcement learning

Subject

Computer Science and Mathematics, Artificial Intelligence and Machine Learning

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.