Navigating Electric Vehicles Along a Signalized Corridor via Reinforcement Learning: Toward Adaptive Eco-Driving Control
Tóm tắt
One problem associated with the operation of electric vehicles (EVs) is the limited battery, which cannot guarantee their endurance. The increasing electricity consumption will also impose a burden on economy and ecology of the vehicles. To achieve energy saving, this paper proposes an adaptive eco-driving method in the environment of signalized corridors. The framework with adaptive and real-time control is implemented by the reinforcement learning technique. First, the operation of EVs in the proximity of intersections is defined as a Markov Decision Process (MDP) to apply the twin delayed deep deterministic policy gradient (TD3) algorithm, to deal with the decision process with continuous action space. Therefore, the speed of the vehicle can be adjusted continuously. Second, safety, traffic mobility, energy consumption, and comfort are all considered by designing a comprehensive reward function for the MDP. Third, the simulation study takes Aoti Street in Nanjing City with several consecutive signalized intersections as the research road network, and the state representation in MDP considers the information from consecutive downstream traffic signals. After the parameter tuning procedure, simulations are carried out for three typical eco-driving scenarios, including free flow, car following, and congestion flow. By comparing with default car-following behavior in the simulation platform SUMO and several state-of-the-art deep reinforcement learning algorithms, the proposed strategy shows a balanced and stable performance.
Từ khóa
Tài liệu tham khảo
Hao P., 2020, Developing an Adaptive Strategy for Connected Eco-Driving Under Uncertain Traffic and Signal Conditions
Wang H., Zhang J., Dong S., Tang F., Ban X. J., Ran B. Multi-Agent Reinforcement Learning Method for Arterial Traffic Signal Control With Delayed Reward. Presented at 99th Annual Meeting of the Transportation Research Board, Washington, D.C., 2020.
Sutton R. S., 2018, Reinforcement Learning: An Introduction
Zhang J., 2020, Journal of Advanced Transportation, 2020, 5847814
Hayward J.C., 1972, Highway Research Record
Fujimoto S., 2018, Proc., International Conference on Machine Learning (PMLR), 1587
Silver D., 2014, Proc., International Conference on Machine Learning
Schaul T., 2015, arXiv Preprint arXiv:1511.05952