Working Paper Article Version 1 This version is not peer-reviewed

Research and Implementation of Hybrid Intelligent Wargame Based on Prior Knowledge-DQN Algorithm

Version 1 : Received: 28 August 2020 / Approved: 31 August 2020 / Online: 31 August 2020 (04:08:04 CEST)

A peer-reviewed article of this Preprint also exists.

Sun, Y.; Yuan, B.; Zhang, T.; Tang, B.; Zheng, W.; Zhou, X. Research and Implementation of Intelligent Decision Based on a Priori Knowledge and DQN Algorithms in Wargame Environment. Electronics 2020, 9, 1668. Sun, Y.; Yuan, B.; Zhang, T.; Tang, B.; Zheng, W.; Zhou, X. Research and Implementation of Intelligent Decision Based on a Priori Knowledge and DQN Algorithms in Wargame Environment. Electronics 2020, 9, 1668.

Abstract

The reinforcement learning problem of complex action control in the Multi-player wargame is a hot research topic in recent years. In this paper , a game system based on turn-based confrontation is designed and implemented with the state-of-the-art deep reinforcement learning models. Specifically, we first design a Q-learning algorithm to achieve intelligent decision-making, which is based the DQN(Deep Q Network) to model the complex game behaviors. Then, a priori- knowledge based algorithm PK-DQN(Prior Knowledge- Deep Q Network) is introduced to improve the DQN algorithm, which accelerates the convergence speed and stability of the algorithm. The experiments demonstrate, the correctness of the PK-DQN algorithm is validated and its performance surpass the conventional DQN algorithm. Furthermore, the PK-DQN algorithm shows effectiveness in defeating the high level of rule-based opponents, which provides promising results for the exploration of the field of smart chess and intelligent game deduction.

Keywords

DQN Algorithm; Policy Modeling; Prior Knowledge; Intelligent Decision

Subject

Engineering, Automotive Engineering

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.