Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction
Tóm tắt
This paper describes technology and tools for intelligent human-computer interaction (IHCI) in which human cognitive, perceptual, motor and affective factors are modeled and used to adapt the H-C interface. IHCI emphasizes that human behavior encompasses both apparent human behavior and the hidden mental state behind behavioral performance. IHCI expands on the interpretation of human activities, known as W4 (what, where, when, who). While W4 only addresses the apparent perceptual aspect of human behavior the W5+ technology for IHCI described in this paper addresses also the why and how questions, whose solution requires recognizing specific cognitive states. IHCI integrates parsing and interpretation of nonverbal information with a computational cognitive model of the user which, in turn, feeds into processes that adapt the interface to enhance operator performance and provide for rational decision-making. The technology proposed is based on a general four-stage interactive framework, which moves from parsing the raw sensory-motor input, to interpreting the user's motions and emotions, to building an understanding of the user's current cognitive state. It then diagnoses various problems in the situation and adapts the interface appropriately. The interactive component of the system improves processing at each stage. Examples of perceptual, behavioral, and cognitive tools are described throughout the paper Adaptive and intelligent HCI are important for novel applications of computing, including ubiquitous and human-centered computing.
Từ khóa
#Human computer interaction #Computer interfaces #Electronic switching systems #Decision making #Psychology #Computational modeling #Feeds #Application software #Computer applications #Pervasive computingTài liệu tham khảo
10.1109/ICCV.1999.791284
10.1109/ICCV.1995.466882
10.1109/TPAMI.1980.6447705
quinlan, 1993, C4 5 Programs for Machine Learning
10.1037/0096-3445.130.1.59
schunn, 1999, What Gestures Reveal About the Scientist s Mind Data Analyzes of Data Analysis
10.1016/0262-8856(83)90003-3
10.1006/ciun.1994.1006
10.1145/258734.258822
10.1207/S15327051HCI1601_2
10.1145/267505.267514
sidenbladh, 2000, stochastic tracking of 3d human figures using 2d image motion, Proc Eur Conf Computer Vision
gray, 2002, simulated task environments: the role of high-fidelity simulations, scaled worlds, synthetic environments, and microworlds in basic and applied cognitive research, Cogn Sci, 2, 205
10.1109/CVPR.1989.37831
10.1037/0033-295X.100.2.279
10.1109/ICCV.1999.791202
10.1109/CVPR.1998.698720
10.1142/S021800149700038X
guest, 1989, Choreo-Graphics A Comparison of Dance Notation Systems from the Fifteenh Century to the Present
10.1145/331490.332826
10.1109/CVPR.1994.323868
10.1109/CVPR.1997.609319
10.1109/34.868684
10.1006/cviu.1998.0716
10.1109/34.598226
10.1109/CVPR.2000.854739
10.1017/CBO9781139173933
pearl, 1988, Probabilistic Reasoning in Intelligent Systems Networks of Plausible Inference
10.1109/CVPR.1996.517056
philomin, 2000, quasi-random sampling for condensation, Proc Eur Conf Computer Vision, 2, 134
picard, 1998, Affective Computing
10.1023/A:1007975200487
10.1016/0031-3203(84)90036-0
price, 0, Annotated Computer Vision Bibliography
10.1006/cviu.1997.0620
10.1109/CVPR.1997.609439
10.1109/CVPR.2000.854758
davis, 1998, ghost: a human body part labeling system using silhouettes, Proc ARPA Image Understanding Workshop, 229
eshkol, 1958, Movement Notation
10.1109/AFGR.2002.1004178
10.1109/34.598232
10.1109/ICCV.1995.466916
knapp, 1997, Nonverbal Communication in Human Interaction
10.1016/0734-189X(85)90094-5
2000, Int Conf Automat Face and Gesture Recognition
1998, Int Conf Automat Face and Gesture Recognition
1996, Int Conf Automat Face and Gesture Recognition
10.1006/cviu.2000.0897
10.1109/AFGR.2000.840658
10.1006/cviu.2000.0870
10.1037/0096-3445.128.2.107
10.1006/obhd.1996.0087
lewontin, 1989, the science of metamorphosis, The New York Reviews of Books XXXVI (7)
10.1109/34.385981
10.1016/0031-3203(87)90017-3
barzel, 1992, Physically-Based Modeling for Computer Graphics
10.1109/AFGR.1996.557272
10.1098/rstb.1997.0108
10.1109/CVPR.1997.609382
10.1016/0747-5632(93)90005-D
10.1109/CVPR.1998.698581
10.1109/ICIP.1996.561025
10.1007/s00221-005-2285-y
starner, 1995, visual recognition of american sign language using hidden markov models, Proc Int Workshop Automatic Face and Gesture Recognition, 189
10.1016/0262-8856(95)93154-K
10.1109/ICCV.1999.790304
10.1109/CVPR.1999.784636
wechsler, 1990, Computational Vision
cohen, 1977, A New Dictionary of Sign Language, 10.1515/9783110813814
10.1006/cviu.1999.0758
10.1016/S0031-3203(01)00116-9
10.1016/0004-3702(90)90093-F
1995, Proc Int Workshop Automatic Face and Gesture Recognition
10.1006/cogp.1993.1012
10.1207/s15327051hci1204_5
anderson, 1998, Atomic Components of Thought
10.1145/356757.356760
10.1109/34.598236
10.1207/s15327051hci1204_4
badler, 1993, Simulating Humans, 10.1093/oso/9780195073591.001.0001
10.1109/34.506414
10.1109/CVPR.1999.786979
10.1007/978-3-642-79980-8_73
zatsiorsky, 1997, Kinematics of Human Motion
10.1109/AFGR.1996.557241
10.1007/BF00309043
10.1109/ICCV.1995.466881
jung, 1996, Motion Analysis of Articulated Object for Optical Motion Capture
10.1109/ICPR.2000.902997
10.1109/ICCV.1999.790398
10.3758/BF03212378
jähne jahne, 1997, Digital Image Processing, 10.1007/978-3-662-03477-4