ARTICLE | doi:10.20944/preprints202203.0094.v1
Subject: Engineering, Automotive Engineering Keywords: Smart scheduling; Smart Reservations; Reinforcement Learning; Electric vehicle charging; Electric Vehicle Charging Management platform; DQN Reinforcement Learning algorithm
Online: 7 March 2022 (09:20:13 CET)
Abstract: As the policies and regulations currently in place concentrate on environmental protection and greenhouse gas reduction, we are steadily witnessing a shift in the transportation industry towards electromobility. There are, though, several issues that need to be addressed to encourage the adoption of EVs at a larger scale. To this end, we propose a solution capable of addressing multiple EV charging scheduling issues, such as congestion management, scheduling a charging station in advance, and allowing EV drivers to plan optimized long trips using their EVs. The smart charging scheduling system we propose considers a variety of factors such as battery charge level, trip distance, nearby charging stations, other appointments, and average speed. Given the scarcity of data sets required to train the Reinforcement Learning algorithms, the novelty of the recommended solution lies in the scenario simulator, which generates the labelled datasets needed to train the algorithm. Based on the generated scenarios, we created and trained a neural network that uses a history of previous situations to identify the optimal charging station and time interval for recharging. The results are promising and for future work we are planning to train the DQN model using real-world data.
Subject: Engineering, Automotive Engineering Keywords: DQN Algorithm; Policy Modeling; Prior Knowledge; Intelligent Decision
Online: 31 August 2020 (04:08:04 CEST)
The reinforcement learning problem of complex action control in the Multi-player wargame is a hot research topic in recent years. In this paper , a game system based on turn-based confrontation is designed and implemented with the state-of-the-art deep reinforcement learning models. Specifically, we first design a Q-learning algorithm to achieve intelligent decision-making, which is based the DQN(Deep Q Network) to model the complex game behaviors. Then, a priori- knowledge based algorithm PK-DQN(Prior Knowledge- Deep Q Network) is introduced to improve the DQN algorithm, which accelerates the convergence speed and stability of the algorithm. The experiments demonstrate, the correctness of the PK-DQN algorithm is validated and its performance surpass the conventional DQN algorithm. Furthermore, the PK-DQN algorithm shows effectiveness in defeating the high level of rule-based opponents, which provides promising results for the exploration of the field of smart chess and intelligent game deduction.
ARTICLE | doi:10.20944/preprints202203.0119.v1
Subject: Engineering, Automotive Engineering Keywords: smart scheduling; smart reservations; reinforcement learning; electric vehicle charging; electric vehicle charging management platform; neural network; DQN reinforcement Learning algorithm
Online: 8 March 2022 (08:54:48 CET)
The widespread adoption of electromobility constitutes one of the measures designed to reduce air pollution caused by traditional fossil fuels. However, several factors are currently impending this process, ranging from insufficient charging infrastructure, battery capacity, long queueing and charging time, to psychological factors. On top of range anxiety, the frustration of the EV drivers is further fueled by the lack the uncertainty of finding an available charging point on their route. To address this issue, we propose a solution that comes to bypass the limitations of the Reserve now function of the OCPP standard, enabling drivers to make charging reservations for the upcoming days, especially when planning a longer trip. We created an algorithm that generates reservation intervals based on the charging station's reservation and transaction history. Subsequently, we ran a series of test cases that yielded promising results, with no overlapping reservations.