Version 1
: Received: 22 July 2020 / Approved: 24 July 2020 / Online: 24 July 2020 (14:45:33 CEST)
How to cite:
Allen, M.; Monks, T. Integrating Deep Reinforcement Learning Networks with Health System Simulations.. Preprints2020, 2020070598. https://doi.org/10.20944/preprints202007.0598.v1
Allen, M.; Monks, T. Integrating Deep Reinforcement Learning Networks with Health System Simulations.. Preprints 2020, 2020070598. https://doi.org/10.20944/preprints202007.0598.v1
Allen, M.; Monks, T. Integrating Deep Reinforcement Learning Networks with Health System Simulations.. Preprints2020, 2020070598. https://doi.org/10.20944/preprints202007.0598.v1
APA Style
Allen, M., & Monks, T. (2020). Integrating Deep Reinforcement Learning Networks with Health System Simulations.. Preprints. https://doi.org/10.20944/preprints202007.0598.v1
Chicago/Turabian Style
Allen, M. and Thomas Monks. 2020 "Integrating Deep Reinforcement Learning Networks with Health System Simulations." Preprints. https://doi.org/10.20944/preprints202007.0598.v1
Abstract
Background and motivation: Combining Deep Reinforcement Learning (Deep RL) and Health Systems Simulations has significant potential, for both research into improving Deep RL performance and safety, and in operational practice. While individual toolkits exist for Deep RL and Health Systems Simulations, no framework to integrate the two has been established. Aim: Provide a framework for integrating Deep RL Networks with Health System Simulations, and to ensure this framework is compatible with Deep RL agents that have been developed and tested using OpenAI Gym. Methods: We developed our framework based on the OpenAI Gym framework, and demonstrate its use on a simple hospital bed capacity model. We built the Deep RL agents using PyTorch, and the Hospital Simulation using SimPy. Results: We demonstrate example models using a Double Deep Q Network or a Duelling Double Deep Q Network as the Deep RL agent. Conclusion: SimPy may be used to create Health System Simulations that are compatible with agents developed and tested on OpenAI Gym environments. GitHub repository of code: https://github.com/MichaelAllen1966/learninghospital
Reinforcement Learning; Simulation; Health Services Research; Operational Research
Subject
Computer Science and Mathematics, Artificial Intelligence and Machine Learning
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
