Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

Deep Reinforcement Learning for Optimizing Restricted Access Window in IEEE 802.11ah MAC Layer

Version 1 : Received: 30 March 2024 / Approved: 1 April 2024 / Online: 1 April 2024 (12:21:24 CEST)

A peer-reviewed article of this Preprint also exists.

Jiang, X.; Gong, S.; Deng, C.; Li, L.; Gu, B. Deep Reinforcement Learning for Optimizing Restricted Access Window in IEEE 802.11ah MAC Layer. Sensors 2024, 24, 3031. Jiang, X.; Gong, S.; Deng, C.; Li, L.; Gu, B. Deep Reinforcement Learning for Optimizing Restricted Access Window in IEEE 802.11ah MAC Layer. Sensors 2024, 24, 3031.

Abstract

The IEEE 802.11ah standard is introduced to address the growing scale of Internet of Things (IoT) applications. To reduce contention and enhance energy efficiency within the system, the restricted access window (RAW) mechanism is introduced at the medium access control (MAC) layer to manage the significant number of stations accessing the network. However, the RAW parameters need to be appropriately determined to achieve optimal network performance. In this paper, we optimize the configuration of RAW parameters in the IEEE 802.11ah-based IoT network. We analyze and propose an RAW parameters optimization problem with the objective of improving network throughput and formulate it as a Markov decision process. To cope with the complex and dynamic network conditions, we propose a proximal policy optimization (PPO)-based deep reinforcement learning (DRL) algorithm to find the optimal RAW parameters. We construct network environments with periodic and random traffic in the NS-3 simulator to validate the performance of the proposed PPO-based RAW parameters optimization algorithm. Simulation results reveal that using the PPO-based DRL algorithm, optimal RAW parameters can be obtained under different network conditions, thereby significantly improving network throughput.

Keywords

IEEE 802.11ah; restricted access window (RAW); deep reinforcement learning (DRL)

Subject

Computer Science and Mathematics, Computer Networks and Communications

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.

Leave a public comment
Send a private comment to the author(s)
* All users must log in before leaving a comment
Views 0
Downloads 0
Comments 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.