A systematic review on detection and prediction of driver drowsiness

Abbas, 2020, Hybrid fatigue: A real-time driver drowsiness detection using hybrid features and transfer learning, Int. J. Adv. Comput. Sci. Appl. (IJACSA), 11, 585 Åkerstedt, 2014, Subjective sleepiness is a sensitive indicator of insufficient sleep and impaired waking function, J. Sleep Res., 23, 240, 10.1111/jsr.12158 Akerstedt, 1990, Subjective and objective sleepiness in the active individual, Int. J. Neurosci., 52, 29, 10.3109/00207459008994241 Anund, 2013, Observer Rated Sleepiness and Real Road Driving: An Explorative Study, PLoS One, 8, 1, 10.1371/journal.pone.0064782 Arefnezhad, S.; Eichberger, A.; Frühwirth, M.; Kaufmann, C.; Moser, M. (2020). Driver Drowsiness Classification Using Data Fusion of Vehicle-based Measures and ECG Signals. In Proceedings of the 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Toronto, ON, Canada, 451–456. Awais, 2017, A hybrid approach to detect driver drowsiness utilizing physiological signals to improve system performance and wearability, Sensors, 17, 1991, 10.3390/s17091991 Bakheet, 2021, A Framework for Instantaneous Driver Drowsiness Detection Based on Improved HOG Features and Naïve Bayesian Classification, Brain Sci., 11, 240, 10.3390/brainsci11020240 Bamidele, 2019, Non-intrusive Driver Drowsiness Detection based on Face and Eye Tracking, Int. J. Adv. Comput. Sci. Appl. (IJACSA), 10 Barua, 2019, Automatic driver sleepiness detection using EEG, EOG and contextual information, Expert Syst. Appl., 115, 121, 10.1016/j.eswa.2018.07.054 Becerra-Sánchez, 2019, Wearable Sensors for Evaluating Driver Drowsiness and High Stress, IEEE Lat. Am. Trans., 17, 418, 10.1109/TLA.2019.8863312 Boyraz P, Acar M, Kerr D. (2008). Multi-sensor driver drowsiness monitoring. Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering. 2008; 222(11):2041-2062. Caffier, 2003, Experimental evaluation of eye-blink parameters as a drowsiness measure, Eur. J. Appl. Physiol., 89, 319, 10.1007/s00421-003-0807-5 Chaabene, 2021, Convolutional Neural Network for Drowsiness Detection Using EEG Signals, Sensors, 21, 1734, 10.3390/s21051734 Chen, 2021, Driver Drowsiness Estimation Based on Factorized Bilinear Feature Fusion and a Long-Short-Term Recurrent Convolutional Network, Information, 12, 3, 10.3390/info12010003 Chen, 2015, Automatic detection of alertness/drowsiness from physiological signals using wavelet-based nonlinear features and machine learning, Expert Syst. Appl., 42, 7344, 10.1016/j.eswa.2015.05.028 Cui, Y., Wu, D. (2017). EEG-Based Driver Drowsiness Estimation Using Convolutional Neural Networks. International Conference on Neural Information Processing. Guangzhou, China, Nov. 2017, pp. 822–832. Cui, 2019, EEG-Based Driver Drowsiness Estimation Using Feature Weighted Episodic Training, IEEE Trans. Neural Syst. Rehabil. Eng., 27, 2263, 10.1109/TNSRE.2019.2945794 De Naurois, 2018, Adapting artificial neural networks to a specific driver enhances detection and prediction of drowsiness, Accid. Anal. Prev., 121, 118, 10.1016/j.aap.2018.08.017 Dehzangi, 2018, Unobtrusive Driver Drowsiness Prediction Using Driving Behavior from Vehicular Sensors, 3598 Dua, 2021, Deep CNN models-based ensemble approach to driver drowsiness detection, Neural Comput. Applic., 33, 3155, 10.1007/s00521-020-05209-7 Dwivedi, 2014, Drowsy driver detection using representation learning, IEEE Int. Adv. Comput. Conf. (IACC), 995 Ed-Doughmi, Y., Idrissi, N., Hbali, Y. (2020). Real-Time System for Driver Fatigue Detection Based on a Recurrent Neuronal Network. Journal of Imaging, 6, 8. Eskandarian, 2017, Evaluation of a Smart Algorithm for Commercial Vehicle Driver Drowsiness Detection, IEEE Intell. Vehicles Sympos., 553 Flores, 2010, Real-Time Warning System for Driver Drowsiness Detection Using Visual Information, J. Intell. Rob. Syst., 59, 103, 10.1007/s10846-009-9391-1 Forsman, 2013, Efficient driver drowsiness detection at moderate levels of drowsiness, Accid. Anal. Prev., 50, 341, 10.1016/j.aap.2012.05.005 Fujiwara, 2019, Heart Rate Variability-Based Driver Drowsiness Detection and Its Validation with EEG, IEEE Trans. Biomed. Eng., 66, 1769, 10.1109/TBME.2018.2879346 Gao, 2019, A recurrence network-based convolutional neural network for fatigue driving detection from EEG. Chaos: An Interdisciplinary, J. Nonlinear Sci., 29 Gao, 2019, EEG-based spatio-temporal convolutional neural network for driver fatigue evaluation, IEEE Trans. Neural Networks Learn. Syst., 30, 2755, 10.1109/TNNLS.2018.2886414 Ghourabi, A., Ghazouani, H., Barhoumi, W. (2020). Driver Drowsiness Detection Based on Joint Monitoring of Yawning, Blinking and Nodding. IEEE 16th International Conference on Intelligent Computer Communication and Processing (ICCP), 407-414.s. Guo, 2019, Driver drowsiness detection using hybrid convolutional neural network and long short-term memory, Multimed. Tools Appl., 78, 29059, 10.1007/s11042-018-6378-6 Guo, 2016, Driver drowsiness detection model identification with Bayesian network structure learning method, Chin. Control Decision Conf. (CCDC), 2016, 131 Gupta, N., Najeeb, D., Gabrielian, V., & Nahapetian, A. (2017). Mobile ECG-based drowsiness detection. In 2017 14th IEEE Annual Consumer Communications & Networking Conference (CCNC), 29-32. Gwak, 2020, An Investigation of Early Detection of Driver Drowsiness Using Ensemble Machine Learning Based on Hybrid Sensing, Appl. Sci., 10, 2890, 10.3390/app10082890 Hachisuka, 2013, Human and Vehicle-Driver Drowsiness Detection by Facial Expression, International Conference on Biometrics and Kansei Engineering, 320 Hajinoroozi, 2015, Prediction of driver's drowsy and alert states from EEG signals with deep learning, 493 Hallvig, 2013, Sleepy Driving on the Real Road and in the Simulator - A Comparison, Accid. Anal. Prev., 50, 44, 10.1016/j.aap.2012.09.033 Hallvig, 2014, Real Driving at Night - Predicting Lane Departures from Physiological and Subjective Sleepiness, Biology Psychology, 101, 18, 10.1016/j.biopsycho.2014.07.001 Han, 2015, Driver Drowsiness Detection Based on Novel Eye Openness Recognition Method and Unsupervised Feature Learning, IEEE International Conference on Systems, Man, and Cybernetics, 1470 Hasan, 2021, Physiological signal-based drowsiness detection using machine learning: singular and hybrid signal approaches, J. Saf. Res., 80, 215 Huang, 2016, 000463 Huynh X.P., Park, S.M., Kim, Y.G. (2017). Detection of Driver Drowsiness Using 3D Deep Neural Network and Semi-Supervised Gradient Boosting Machine. Asian Conference on Computer Vision, Computer Vision – ACCV 2016 Workshops. 134-145. Ingre, 2006, Subjective sleepiness, simulated driving performance and blink duration, J. Sleep Res., 15, 47, 10.1111/j.1365-2869.2006.00504.x Ingre, 2006, Subjective sleepiness, simulated driving performance and blink duration: Examining individual differences, J. Sleep Res., 15, 47, 10.1111/j.1365-2869.2006.00504.x Jabbar, R., Shinoy, M., Kharbeche, M., Al-Khalifa, K., Krichen, M., Barkaoui, K. (2020). Driver Drowsiness Detection Model Using Convolutional Neural Networks Techniques for Android Application. ICIoT 2020, Doha, Qatar. Hal-02479367. Josephin, J. S. F., Lakshmi, C., James, S. J. (2020). A review on the measures and techniques adapted for the detection of driver drowsiness. In: IOP Conference Series: Materials Science and Engineering, 993, 012101. Kaida, 2006, Validation of the Karolinska sleepiness scale against performance and EEG variables, Clin. Neurophysiol., 117, 1574, 10.1016/j.clinph.2006.03.011 Kim, 2019, Utilizing HRV-Derived Respiration Measures for Driver Drowsiness Detection, Electronics, 8, 669, 10.3390/electronics8060669 Lawoyin, 2014, 1636 Lenné, 2016, Predicting drowsiness-related driving events: a review of recent research methods and future opportunities, Theor. Issues Ergon. Sci., 17, 533, 10.1080/1463922X.2016.1155239 Lenné, 2016, Predicting drowsiness-related driving events: a review of recent research methods and future opportunities, Theor. Issues Ergon. Sci., 17, 533, 10.1080/1463922X.2016.1155239 Li, 2014, Estimation of Eye Closure Degree Using EEG Sensors and Its Application in Driver Drowsiness Detection, Sensors, 14, 17491, 10.3390/s140917491 Liu, 2016, Brain Dynamics in Predicting Driving Fatigue Using a Recurrent Self-Evolving Fuzzy Neural Network, IEEE Trans. Neural Networks Learn. Syst., 27, 347, 10.1109/TNNLS.2015.2496330 Liu, 2019, Convolutional Two-Stream Network Using Multi-Facial Feature Fusion for Driver Fatigue Detection, Future Internet, 11, 115, 10.3390/fi11050115 Ma, 2016, Wearable driver drowsiness detection using electrooculography signal, IEEE Topical Conference on Wireless Sensors and Sensor Networks (WiSNet), 41, 10.1109/WISNET.2016.7444317 Mashko, 2017, Subjective methods for assessment of driver drowsiness, Acta Polytechnica CTU Proceedings, 12, 64, 10.14311/APP.2017.12.0064 McDonalda, 2018, A contextual and temporal algorithm for driver drowsiness detection, Accid. Anal. Prev., 113, 25, 10.1016/j.aap.2018.01.005 Nguyen, 2017, Utilization of a combined EEG/NIRS system to predict driver drowsiness, Sci. Rep., 7, 43933, 10.1038/srep43933 Park S., Pan F., Kang S., Yoo C.D. (2017) Driver Drowsiness Detection System Based on Feature Representation Learning Using Various Deep Networks. Asian Conference on Computer Vision. Computer Vision – ACCV 2016 Workshops. 154-164. Quddus, 2021, Using long short term memory and convolutional neural networks for driver drowsiness detection, Accid. Anal. Prev., 156, 106107, 10.1016/j.aap.2021.106107 Rajamohana, 2021, Driver drowsiness detection system using hybrid approach of convolutional neural network and bidirectional long short term memory (CNN_BILSTM), Mater. Today:. Proc., 45, 2897 Reddy, 2017, Real-Time Driver Drowsiness Detection for Embedded System Using Model Compression of Deep Neural Networks, IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 438 A. Sahayadhas, K. Sundaraj, M.J.S. Murugappan, (2012). Detecting driver drowsiness based on sensors: a review Sensors, 12 (12) (2012), pp. 16937-16953. Sahayadhas, 2012, Detecting Driver Drowsiness Based on Sensors: A Review, Sensors, 12, 16937, 10.3390/s121216937 Saif, 2020, Robust Drowsiness Detection for Vehicle Driver using Deep Convolutional Neural Network, Int. J. Adv. Comput. Sci. Appl., 11, 343 Sandberg, 2011, The Characteristics of Sleepiness during Real Driving at Night- A Study of Driving Performance, Physiology and Subjective Experience. Sleep., 34, 1317 Shaik, 2021, A review on neural network techniques for the prediction of road traffic accident severity, Asian Transp. Stud., 7, 100040, 10.1016/j.eastsj.2021.100040 Shih TH., Hsu CT. (2017) MSTN: Multistage Spatial-Temporal Network for Driver Drowsiness Detection. Asian Conference on Computer Vision, Computer Vision – ACCV 2016, Workshops, 146-153. Shuyan, 2009, Driver drowsiness detection with eyelid related parameters by support vector machine, Expert Syst. Appl., 36, 7651, 10.1016/j.eswa.2008.09.030 Siddiqui, 2021, Non-Invasive Driver Drowsiness Detection System, Non-Invasive Driver Drowsiness Detection System. Sensors, 21, 4833 Sommer, 2010, Biosignal based discrimination between slight and strong driver hypovigilance by support-vector machines, Agents and Artificial Intelligence., 67, 177, 10.1007/978-3-642-11819-7_14 Taherisadr, 2019, EEG-Based Driver Distraction Detection via GameTheoretic-Based Channel Selection, 93 Van Dongen, 2004, Comparison of mathematical model predictions to experimental data of fatigue and performance, Aviat. Space Environ. Med., 75, A15 Vijayan, 2019, Real time detection system of driver drowsiness based on representation learning using deep neural networks, J. Intell. Fuzzy Syst., 36, 1 Vu, T. H., An D., Wang, J-C. (2019). A Deep Neural Network for Real-Time Driver Drowsiness Detection, IEICE Transactions on Information and Systems, E102.D, 12, 2637-2641. Vural, 2009 Wang, 2016, Driver drowsiness detection based on non-intrusive metrics considering individual specifics, Accid. Anal. Prev., 95, 350, 10.1016/j.aap.2015.09.002 Wang, 2015, Real-Time EEG-Based Detection of Fatigue Driving Danger for Accident Prediction, Int. J. Neural Syst., 25, 1550002, 10.1142/S0129065715500021 Warwick, 2015, Detecting Driver Drowsiness Using Wireless Wearables, 585 Weng CH., Lai YH., Lai SH. (2017) Driver Drowsiness Detection via a Hierarchical Temporal Deep Belief Network. Workshops. ACCV 2016. Asian Conference on Computer Vision, Computer Vision – ACCV 2016 Workshops. 117-133. Wijnands, 2020, Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks, Neural Comput. & Applic., 32, 9731, 10.1007/s00521-019-04506-0 Yu, 2019, Driver Drowsiness Detection Using Condition-Adaptive Representation Learning Framework, IEEE Trans. Intell. Transp. Syst., 20, 4206, 10.1109/TITS.2018.2883823 Zhang, 2012, Driver Drowsiness Recognition Based on Computer Vision Technology, Tsinghua Sci. Technol., 17, 354, 10.1109/TST.2012.6216768 Zhang, 2020, Driver Drowsiness Detection Using Mixed-effect Ordered Logit Model Considering Time Cumulative Effect, Analytic Methods in Accident Research., 26, 100114, 10.1016/j.amar.2020.100114 Zhao, 2020, Driver drowsiness recognition via transferred deep 3D convolutional network and state probability vector, Multimed. Tools Appl., 79, 26683, 10.1007/s11042-020-09259-w Zhu, 2021, Vehicle driver drowsiness detection method using wearable EEG based on convolutional neural network, Neural Comput. Applic., 33, 13965, 10.1007/s00521-021-06038-y Zhu, 2014, EOG-based drowsiness detection using convolutional neural networks, Int. Joint Conf. Neural Netw. (IJCNN), 128