Kyung, Y.; Sung, J.; Ko, H.; Song, T.; Kim, Y. Priority-Aware Actuation Update Scheme in Heterogeneous Industrial Networks. Sensors2024, 24, 357.
Kyung, Y.; Sung, J.; Ko, H.; Song, T.; Kim, Y. Priority-Aware Actuation Update Scheme in Heterogeneous Industrial Networks. Sensors 2024, 24, 357.
Kyung, Y.; Sung, J.; Ko, H.; Song, T.; Kim, Y. Priority-Aware Actuation Update Scheme in Heterogeneous Industrial Networks. Sensors2024, 24, 357.
Kyung, Y.; Sung, J.; Ko, H.; Song, T.; Kim, Y. Priority-Aware Actuation Update Scheme in Heterogeneous Industrial Networks. Sensors 2024, 24, 357.
Abstract
In the heterogeneous wireless networked control system (WNCS), age of information (AoI) of the actuation update and actuation update cost are important performance metrics. To reduce the monetary cost, the control system can wait for the availability of WiFi network of the actuator and then conduct the update by using WiFi network in an opportunistic manner, but it leads to the increased AoI of the actuation update. To assess this problem, this paper proposes a priority-aware actuation update scheme (PAUS) where the control system decides whether to deliver or delay the actuation update to the actuator by considering the control priority (i.e., robustness of AoI of the actuation update). For the optimal decision, we formulate a Markov decision process model and derive the optimal policy based on Q-learning. Simulation results demonstrate that PAUS outperforms the comparison schemes in terms of the expected reward.
Keywords
Actuation update; age of information; industrial networks; wireless networked control systems; Markov decision process; Q-learning
Subject
Computer Science and Mathematics, Computer Networks and Communications
Copyright:
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
