Information fusion with Bayesian networks for monitoring human fatigue

Peilin Lan1, Qiang Ji2, C.G. Looney1
1Department of CS, University of Nevada,슠Reno, Reno, NV, USA
2Department of ECSE, Rensselaer Polytechnic Institute, Troy, NY, USA

Tóm tắt

In this paper, we introduce a probabilistic model based on Bayesian networks (BNs) for inferring human fatigue by integrating information from various visual cues and certain relevant contextual information. First, we briefly review the modern physiological and behavioral studies on human fatigue to identify the major causes for human fatigue and the significant factors affecting fatigue. These factors are then extracted from those studies and form the contextual information variables in our fatigue model. Visual parameters, typically characterizing the cognitive states of a person including parameters related to eyelid movement, gaze, head movement, and facial expression, serve as the sensory observations in the fatigue model. The fatigue model is subsequently parameterized based on the statistics extracted from recent studies on fatigue and on our subjective knowledge. Such a model provides mathematically coherent and sound basis for systematically aggregating visual evidences from different sources, augmented with relevant contextual information. The inference results produced by running the fatigue model using Microsoft BNs engine MSBNX demonstrate the utility of the proposed framework for predicting and modeling fatigue.

Từ khóa

#Bayesian methods #Humans #Fatigue #Context modeling #Data mining #Predictive models #Biomedical monitoring #Eyelids #Statistics #Mathematical model

Tài liệu tham khảo

looney, 2001, Bayesian/Belief Networks Lecture for CS 773c-Intelligent Systems Applications Information Fusion Unit 8 jordan, 1999, Learning in Graphical Models li, 1998, An Introduction to Belief Networks 10.1109/VNIS.1994.396872 10.1109/VNIS.1994.396873 boverie, 1998, Intelligent systems for video monitoring of vehicle cockpit, 1998 International Congress and Exposition ITS Advanced Controls and Vehicle Navigation Systems, 1 ishii, 1987, Automatic recognition of driver's facial expression by image analysis, J JSAE, 41, 1398 czeisler, 1995, Fatigue Symposium Proceedings, 59 harris, 0, Fatigue Circadian Rhythm and Truck Accidents Vigilance Theory Operational Performance and Physiological Correlates 2002 10.1007/978-1-4757-3502-4 wierville, 1994, Overview of Research on Driver Drowsiness Definition and Driver Drowsiness Detection wierville, 1994, Research on vehicle based driver status/performance monitoring Development validation and refinement of algorithms for detection of driver drowsiness dinges, 1998, Evaluation of Techniques for Ocular Measurement as an Index of Fatigue and the Basis for Alertness Management 1999, Proximity array sensing system Head position monitor/metric pena, 1995, Fatigue Symposium Proceedings, 7 co, 1999, Crew factors in flight operations XI A survey of fatigue factors in regional airline operations rosekind, 1995, Physiological Considerations of Fatigue, 17 rosekind, 2000, Crew factors in flight operations XIII A survey of fatigue factors in corporate/executive aviation operations ji, 2001, Real time visual cues extraction for monitoring driver vigilance, International Workshop on Computer Vision Systems, 10.1007/3-540-48222-9_8 ji, 2002, A Computer Vision System for Real Time Driver Alertness Monitoring sherry, 2000, Fatigue Countermeasures in the Railroad Industry-Past and Current Developments danaher, 1995, Fatigue Symposium Proceedings, 11 fatigue, 2001, The Multiple Sclerosis Resource Center (MSRC) rosekind, 2000, Crew factors in flight operations XII A survey of sleep quantity and quality in on-board crew rest facilities