Version 1
: Received: 30 March 2024 / Approved: 1 April 2024 / Online: 1 April 2024 (12:21:24 CEST)
How to cite:
Jiang, X.; Gong, S.; Deng, C.; Li, L.; Gu, B. Deep Reinforcement Learning for Optimizing Restricted Access Window in IEEE 802.11ah MAC Layer. Preprints2024, 2024040067. https://doi.org/10.20944/preprints202404.0067.v1
Jiang, X.; Gong, S.; Deng, C.; Li, L.; Gu, B. Deep Reinforcement Learning for Optimizing Restricted Access Window in IEEE 802.11ah MAC Layer. Preprints 2024, 2024040067. https://doi.org/10.20944/preprints202404.0067.v1
Jiang, X.; Gong, S.; Deng, C.; Li, L.; Gu, B. Deep Reinforcement Learning for Optimizing Restricted Access Window in IEEE 802.11ah MAC Layer. Preprints2024, 2024040067. https://doi.org/10.20944/preprints202404.0067.v1
APA Style
Jiang, X., Gong, S., Deng, C., Li, L., & Gu, B. (2024). Deep Reinforcement Learning for Optimizing Restricted Access Window in IEEE 802.11ah MAC Layer. Preprints. https://doi.org/10.20944/preprints202404.0067.v1
Chicago/Turabian Style
Jiang, X., Lanhua Li and Bo Gu. 2024 "Deep Reinforcement Learning for Optimizing Restricted Access Window in IEEE 802.11ah MAC Layer" Preprints. https://doi.org/10.20944/preprints202404.0067.v1
Abstract
The IEEE 802.11ah standard is introduced to address the growing scale of Internet of Things (IoT) applications. To reduce contention and enhance energy efficiency within the system, the restricted access window (RAW) mechanism is introduced at the medium access control (MAC) layer to manage the significant number of stations accessing the network. However, the RAW parameters need to be appropriately determined to achieve optimal network performance. In this paper, we optimize the configuration of RAW parameters in the IEEE 802.11ah-based IoT network. We analyze and propose an RAW parameters optimization problem with the objective of improving network throughput and formulate it as a Markov decision process. To cope with the complex and dynamic network conditions, we propose a proximal policy optimization (PPO)-based deep reinforcement learning (DRL) algorithm to find the optimal RAW parameters. We construct network environments with periodic and random traffic in the NS-3 simulator to validate the performance of the proposed PPO-based RAW parameters optimization algorithm. Simulation results reveal that using the PPO-based DRL algorithm, optimal RAW parameters can be obtained under different network conditions, thereby significantly improving network throughput.
Keywords
IEEE 802.11ah; restricted access window (RAW); deep reinforcement learning (DRL)
Subject
Computer Science and Mathematics, Computer Networks and Communications
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
