Decision making framework for autonomous vehicles driving behavior in complex scenarios via hierarchical state machine
Tóm tắt
With the development of autonomous car, a vehicle is capable to sense its environment more precisely. That allows improved drving behavior decision strategy to be used for more safety and effectiveness in complex scenarios. In this paper, a decision making framework based on hierarchical state machine is proposed with a top-down structure of three-layer finite state machine decision system. The upper layer classifies the driving scenario based on relative position of the vehicle and its surrounding vehicles. The middle layer judges the optimal driving behavior according to the improved energy efficiency function targeted at multiple criteria including driving efficiency, safety and the grid-based lane vacancy rate. The lower layer constructs the state transition matrix combined with the calculation results of the previous layer to predict the optimal pass way in the region. The simulation results show that the proposed driving strategy can integrate multiple criteria to evaluate the energy efficiency value of vehicle behavior in real time, and realize the selection of optimal vehicle driving strategy. With popularity of automatic vehicles in future, the driving strategy can be used as a reference to provide assistance for human drive or even the real-time decision-making of autonomous driving.
Tài liệu tham khảo
S.I. Oh, H.B. Kang, Fast occupancy grid filtering using grid cell clusters from LIDAR and stereo vision sensor data. IEEE Sensors J. 16(19), 7258–7266 (2016)
S. Sivaraman, M.M. Trivedi, Dynamic probabilistic drivability maps for lane change and merge driver assistance. IEEE Trans. Intell. Transp. Syst. 15(5), 2063–2073 (2014)
G. Yang, P. Wang, W. Han, et al. Automatic generation of fine-grained traffic load spectrum via fusion of weigh-in-motion and vehicle spatial–temporal information. Computer-Aided Civil and Infrastructure Engineering.
W. Yuan, P. Wang, J. Yang, Y. Meng, An alternative reliability method to evaluate the regional traffic congestion from GPS data obtained from floating cars. IET Smart Cities. 3(2), 79–90 (2021)
P. Wang, Y. Zhang, S. Wang, L. Li, X. Li, Forecasting travel speed in the rainfall days to develop suitable variable speed limits control strategy for less driving risk. J. Adv. Transp. 2021, Article ID 6639559, 13 pages (2021)
S. Brechtel, T. Gindele, R. Dillmann, in Proceedings of the 30th international conference on machine learning. Solving continuous POMDPs: Value iteration with incremental learning of an efficient space representation (2013), pp. 370–378
J. Wei, J.M. Dolan, J.M. Snider, B. Litkouhi, in Robotics and Automation (ICRA), 2011 IEEE international conference on, IEEE. A point-based MDP for robust single-lane autonomous driving behavior under uncertainties (2011), pp. 2586–2592
S. Brechtel, T. Gindele, R. Dillmann, in Intelligent Transportation Systems (ITSC), 2014 IEEE 17th international conference on, IEEE. Probabilistic decision-making under uncertainty for autonomous driving using continuous POMDPs (2014), pp. 392–399
S. Brechtel, T. Gindele, in Proceedings of the 30th International conference on machine learning. Solving continuous POMDPs: Value iteration with incremental learning of an efficient space representation (2013), pp. 370–378
M. Bojarski, D.D. Testa, D. Dworakowski, End to end learning for self -driving cars. arXiv: Computer Vision and Pattern Recognition (2016)
F. Codevilla, M. Müller, A. López, V. Koltun, A. Dosovitskiy, End-to-end driving via conditional imitation learning. 2018 IEEE International Conference on Robotics and Automation (ICRA), (2018)
P. Wang, W. Hao, Y. Jin, in IEEE transactions on intelligent transportation systems. Fine-grained traffic flow prediction of various vehicle types via fusison of multisource data and deep learning approaches. https://doi.org/10.1109/TITS.2020.2997412
S. Ulbrich, M. Maurer, in Intelligent Transportation Systems-(ITSC), 2013 16th international IEEE conference on, IEEE. Probabilistic online POMDP decision making for lane changes in fully automated driving (2013), pp. 2063–2067
B. Vanholme, D. Gruyer, B. Lusetti, S. Glaser, S. Mammar, Highly automated driving on highways based on legal safety. Intell. Transportation Syst. IEEE Trans. 14(1), 333–347 (2013)
L. Fletcher, S. Teller, E. Olson, D. Moore, Y. Kuwata, J. How, et al., The MIT–Cornell collision and why it happened. J. Field Robot. 25(10), 775–807 (2008)
J. Yang, P. Wang, W. Yuan, et al., Automatic generation of optimal road trajectory for the rescue vehicle in case of emergency on mountain freeway using reinforcement learning approach. IET Intell. Transp. Syst. 15, 1142–1152 (2021)
L. Zhao, R. Ichise, Y. Sasaki, L. Zheng, T. Yoshikawa, in Intelligent vehicles symposium, IEEE. Fast decision making using ontology-based knowledge base (2016), pp. 173–178
M. Montemerlo, J. Becker, S. Bhat Jr., The Stanford entry in the urban challenge. J. Field Robot. 25(9), 569–597 (2008)
J. Ziegler, P. Bender, M. Schreiber, Making bertha drive—An autonomous journey on a historic route. Intell. Transportation Syst. Mag. IEEE 6(2), 8–20 (2014)
T. Gindele, D. Jagszent, B. Pitzer, R. Dillmann, in Intelligent vehicles symposium, IEEE. Design of the planner of Team AnnieWAY’s autonomous vehicle used in the DARPA Urban Challenge 2007 (2008), pp. 1131–1136
A. Kurt, U. Ozguner, Hierarchical finite state machines for autonomous mobile systems. Control. Eng. Pract. 21(2), 184–194 (2013)
S. Ma, G. Gong, L. Han, X. Song, in 2008 Asia simulation conference-7th international conference on system simulation and scientific computing. Military task programming based on finite state machine (FSM) decision-making model (2008), pp. 1416–1420
Q.H. Do, H. Tehrani, S. Mita, M. Egawa, K. Muto, K.Y. Oneda, Human drivers based active-passive model for automated lane change. IEEE Intell. Transp. Syst. Mag. 9(1), 42–56 (2017)
L. Jin, V. Bart, S. Yang, et al., Safety lane change model of vehicle assistant driving on highway. J. Jilin Univ. Eng. Technol. 39(3), 582–586 (2009)
S. Wu, Research on the risk assessment algorithm for accounting information system based on analytic hierarchy process, Seventh International Conference on Measuring Technology and Mechatronics Automation (2015) pp. 934-937. https://doi.org/10.1109/ICMTMA.2015.346.