Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

An Extensible and Modular Design and Implementation of Monte Carlo Tree Search for the JVM

Version 1 : Received: 27 July 2021 / Approved: 28 July 2021 / Online: 28 July 2021 (10:29:08 CEST)

How to cite: Liu, L.; Luo, J.T. An Extensible and Modular Design and Implementation of Monte Carlo Tree Search for the JVM . Preprints 2021, 2021070622 (doi: 10.20944/preprints202107.0622.v1). Liu, L.; Luo, J.T. An Extensible and Modular Design and Implementation of Monte Carlo Tree Search for the JVM . Preprints 2021, 2021070622 (doi: 10.20944/preprints202107.0622.v1).

Abstract

Flexible implementations of Monte Carlo Tree Search (MCTS), combined with domain specific knowledge and hybridization with other search algorithms, can be a very powerful for the solution of problems in complex planning. We introduce mctreesearch4j, a standard MCTS implementation written as a standard JVM library following key design principles of object oriented programming. We define key class abstractions allowing the MCTS library to flexibly adapt to any well defined Markov Decision Process or turn-based adversarial game. Furthermore, our library is designed to be modular and extensible, utilizing class inheritance and generic typing to standardize custom algorithm definitions. We demon- strate that the design of the MCTS implementation provides ease of adaptation for unique heuristics and customization across varying Markov Decision Process (MDP) domains. In addition, the implementation is reasonably performant and accurate for standard MDP’s. In addition, via the implementation of mctreesearch4j, the nuances of different types of MCTS algorithms are discussed.

Keywords

Monte Carlo Tree Search, Software Design, Markov Decision Process

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our diversity statement.

Leave a public comment
Send a private comment to the author(s)
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.