Short-term emotion assessment in a recall paradigm

International Journal of Human-Computer Studies - Tập 67 - Trang 607-627 - 2009
Guillaume Chanel1, Joep J.M. Kierkels1, Mohammad Soleymani1, Thierry Pun1
1Computer Science Department - University of Geneva, Route de Drize 7, CH-1227 Carouge, Switzerland

Tài liệu tham khảo

Aboy, 2005, An automatic beat detection algorithm for pressure signals, IEEE Transactions on Biomedical Engineering, 52, 1662, 10.1109/TBME.2005.855725

Adolphs, 2003, Dissociable neural systems for recognizing emotions, Brain and Cognition, 52, 61, 10.1016/S0278-2626(03)00009-5

Aftanas, 2004, Analysis of evoked EEG synchronization and desynchronization in conditions of emotional activation in humans: temporal and topographic characteristics, Neuroscience and Behavioral Physiology, 34, 859, 10.1023/B:NEAB.0000038139.39812.eb

Ansari-Asl, K., Chanel, G., Pun, T., 2007. A channel selection method for EEG classification in emotion assessment based on synchronization likelihood. In: Proceedings of the 15th European Signal Processing Conference, Poznan.

Bailón, R., Laguna, P., Mainardi, L., Sörnmo, L., 2007. Analysis of heart rate variability using time-varying frequency bands based on respiratory frequency. In: IEEE 29th International Conference on EMBS, Lyon, France.

Benoit, A., Bonnaud, L., Caplier, A., Ngo, P., Lawson, L., Trevisan, D., Levacik, V., Mancas, C., Chanel, G., 2006. Multimodal focus attention and stress detection and feedback in an augmented driver simulator. In: 3rd IFIP Conference on Artificial Intelligence Applications & Innovations (AIAI), Athens, Greece.

Berntson, 1997, Heart rate variability: origins, methods, and interpretive caveats, Psychophysiology, 34, 623, 10.1111/j.1469-8986.1997.tb02140.x

Bishop, 2006

Blankertz, 2003, Boosting bit rates and error detection for the classification of fast-paced motor commands based on single-trial EEG analysis, IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11, 127, 10.1109/TNSRE.2003.814456

Brave, 2005, Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent, International Journal of Human Computer Studies, 62, 161, 10.1016/j.ijhcs.2004.11.002

Chanel, G., Ansari-Asl, K., Pun, T., 2007. Valence–arousal evaluation using physiological signals in an emotion recall paradigm. In: IEEE SMC and International Conference on Systems, Man and Cybernetics, Smart Cooperative Systems and Cybernetics: Advancing Knowledge and Security for Humanity, Montreal, Canada.

Chanel, 2006, Emotion assessment: arousal evaluation using EEG's and peripheral physiological signals, vol. 4105, 530

Chanel, G., Rebetez, C., Bétrancourt, M., Pun, T., 2008. Boredom, engagement and anxiety as indicators for adaptation to difficulty in games. In: 12th International MindTrek Conference: Entertainment and Media in the Ubiquitous Era. ACM, Tampere, Finland.

Chang, C.-C., Lin, C.-J., 2001. LIBSVM: a library for support vector machines.

Chen, 2007, Flow in games (and everything else)—a well-designed game transports its players to their personal flow zones, delivering genuine feelings of pleasure and happiness, Communications of the ACM, 50, 31, 10.1145/1232743.1232769

Choi, 2007, ERP training with a web-based electronic learning system: the flow theory perspective, International Journal of Human-Computer Studies, 65, 223, 10.1016/j.ijhcs.2006.10.002

Cohen, 2003, Facial expression recognition from video sequences: temporal and static modeling, Computer Vision and Image Understanding, 91, 160, 10.1016/S1077-3142(03)00081-X

Cornelius, 1996

Coulson, 2004, Attributing emotion to static body postures: recognition accuracy, confusions, and viewpoint dependence, Journal of Nonverbal Behavior, 28, 117, 10.1023/B:JONB.0000023655.25550.be

Cowie, R., 2000. Describing the emotional states expressed in speech. In: ISCA Workshop on Speech and Emotion, Northern Ireland.

Cowie, 2001, Emotion recognition in human–computer interaction, IEEE Signal Processing Magazine, 18, 32, 10.1109/79.911197

Damasio, 2000, Subcortical and cortical brain activity during the feeling of self-generated emotions, Nature Neuroscience, 3, 1049, 10.1038/79871

Davidson, 2003, Affective neuroscience and psychophysiology: toward a synthesis, Psychophysiology, 40, 655, 10.1111/1469-8986.00067

Davidson, 2000, Emotion, plasticity, context and regulation: perspectives from affective neuroscience, Psychological Bulletin, 126, 890, 10.1037/0033-2909.126.6.890

Devillers, 2005, Challenges in real-life emotion annotation and machine learning based detection, Neural Networks, 18, 407, 10.1016/j.neunet.2005.03.007

Duda, 2001

Ekman, 1987, Universals and cultural differences in the judgments of facial expressions of emotion, Journal of Personality and Social Psychology, 53, 712, 10.1037/0022-3514.53.4.712

Ekman, 1983, Autonomic nervous-system activity distinguishes among emotions, Science, 221, 1208, 10.1126/science.6612338

Fasel, 2003, Automatic facial expression analysis: a survey, Pattern Recognition, 36, 259, 10.1016/S0031-3203(02)00052-3

Grandjean, 2008, Conscious emotional experience emerges as a function of multilevel, appraisal-driven response synchronization, Consciousness and Cognition, 17, 484, 10.1016/j.concog.2008.03.019

Guger, 2003, How many people are able to operate an EEG-based brain–computer interface (BCI)?, IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11, 145, 10.1109/TNSRE.2003.814481

Haag, A., Goronzy, S., Schaich, P., Williams, J., 2004. Emotion recognition using bio-sensors: first step toward an automatic system. In: Affective Dialog Systems: Tutorial and Research Workshop, Kloster Irsee, Germany.

Hanjalic, 2005, Affective video content representation and modeling, IEEE Transactions on Multimedia, 7, 143, 10.1109/TMM.2004.840618

Hazlett, 2007, Measuring emotional valence to understand the user's experience of software, International Journal of Human–Computer Studies, 65, 306, 10.1016/j.ijhcs.2006.11.005

Healey, J.A., 2000. Wearable and automotive systems for affect recognition from physiology. Doctor of Philosophy. Electrical Engineering and Computer Science Department, MIT.

Hua, 2005, Optimal number of features as a function of sample size for various classification rules, Bioinformatics, 21, 1509, 10.1093/bioinformatics/bti171

Isomursu, 2007, Experimental evaluation of five methods for collecting emotions in field settings with mobile applications, International Journal of Human–Computer Studies, 65, 404, 10.1016/j.ijhcs.2006.11.007

Kapoor, 2007, Automatic prediction of frustration, International Journal of Human–Computer Studies, 65, 724, 10.1016/j.ijhcs.2007.02.003

Kierkels, 2006, A model-based objective evaluation of eye movement correction in EEG recordings, IEEE Transactions on Biomedical Engineering, 53, 246, 10.1109/TBME.2005.862533

Kim, J., 2004. Emotion recognition from physiological measurement. In: Humaine European Network of Excellence Workshop, Santorini, Greece.

Kim, J., Andre, E., Rehm, M., Vogt, T., Wagner, J., 2005. Integrating information from speech and physiological signals to achieve emotional sensitivity. In: Proceedings of the 9th European Conference on Speech Communication and Technology, Lisboa, Portugal.

Kronegg, 2007, EEG-based synchronized brain–computer interfaces: a model for optimizing the number of mental tasks, IEEE Transactions on Neural Systems and Rehabilitation Engineering, 15, 50, 10.1109/TNSRE.2007.891389

Lang, P.J., Bradley, M.M., Cuthbert, B.N., 2005. International affective picture system (IAPS): digitized photographs, instruction manual and affective ratings. Technical Report A-6, University of Florida, Gainesville, FL.

Lang, 1993, Looking at pictures: affective, facial, visceral, and behavioral reactions, Psychophysiology, 30, 261, 10.1111/j.1469-8986.1993.tb03352.x

Leon, 2007, A user-independent real-time emotion recognition system for software agents in domestic environments, Engineering Applications of Artificial Intelligence, 20, 337, 10.1016/j.engappai.2006.06.001

Lisetti, 2004, Using noninvasive wearable computers to recognize human emotions from physiological signals, Journal on Applied Signal Processing, 11, 1672, 10.1155/S1110865704406192

Lotte, 2007, A review of classification algorithms for EEG-based brain–computer interfaces, Journal of Neural Engineering, 4, R1, 10.1088/1741-2560/4/2/R01

Mandryk, 2007, A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies, International Journal of Human–Computer Studies, 65, 329, 10.1016/j.ijhcs.2006.11.011

Mandryk, 2006, Using psychophysiological techniques to measure user experience with entertainment technologies, Behaviour & Information Technology, 25, 141, 10.1080/01449290500331156

MettingVanRijn, A.C., Kuiper, A.P., Dankers, T.E., Grimbergen, C.A., 1996. Low-cost active electrode improves the resolution in biopotential recordings. In: 18th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Amsterdam, The Netherlands.

Moddemeijer, 1989, On estimation of entropy and mutual information of continuous distributions, Signal Processing, 16, 233, 10.1016/0165-1684(89)90132-1

Norman, 1990

Pantic, 2003, Toward an affect-sensitive multimodal human–computer interaction, Proceedings of the IEEE, 91, 1370, 10.1109/JPROC.2003.817122

Pelzer, 1994, Effect of respiration on short-term heart-rate-variability, Faseb Journal, 8, A846

Picard, 1997

Picard, R.W., Daily, S.B., 2005. Evaluating affective interactions: alternatives to asking what users feel. In: CHI Workshop on Evaluating Affective Interfaces: Innovative Approaches, Portland.

Picard, 2001, Toward machine emotional intelligence: analysis of affective physiological state, IEEE Transactions on Pattern Analysis and Machine Intelligence, 23, 1175, 10.1109/34.954607

Platt, 2000, Probabilities for SV machines, 61

Pudil, P., Ferri, F., Novovicová, J., Kittler, J., 1994. Floating search methods for feature selection with nonmonotonic criterion functions. In: Proceedings of the IEEE International Conference on Pattern Recognition, vol. 2. pp. 279–283.

Rainville, 2006, Basic emotions are associated with distinct patterns of cardiorespiratory activity, International Journal of Psychophysiology, 61, 5, 10.1016/j.ijpsycho.2005.10.024

Rani, 2006, An empirical study of machine learning techniques for affect recognition in human–robot interaction, Pattern Analysis and Applications, 9, 58, 10.1007/s10044-006-0025-y

Rani, P., Sarkar, N., Liu, C., 2005. Maintaining optimal challenge in computer games through real-time physiological feedback. In: 11th HCI International, Las Vegas, USA. Lawrence Erlbaum Associates, Inc.

Rolls, 2000, Précis of the brain and emotion, Behavioral and Brain Sciences, 23, 177, 10.1017/S0140525X00002429

Romero, 2008, A comparative study of automatic techniques for ocular artifact reduction in spontaneous EEG signals based on clinical target variables: a simulation case, Computers in Biology and Medicine, 38, 348, 10.1016/j.compbiomed.2007.12.001

Russell, 1980, A circumplex model of affect, Journal of Personality and Social Psychology, 39, 1161, 10.1037/h0077714

Sakata, T., Watanuki, S., Sakamoto, H., Sumi, T., Kim, Y.-K., 2007. Objective evaluation of Kansei by a complementary use of physiological indexes, brain wave and facial expressions for user oriented designs. In: Proceedings of the10th Qmod Conference, Quality Management and Organisational Development: Our Dreams of Excellence, Helsingborg, Sweden.

Salahuddin, L., Cho, J., Jeong, M.G., Kim, D., 2007. Ultra short term analysis of heart rate variability for monitoring mental stress in mobile settings. In: IEEE 29th International conference of the EMBS, Lyon, France.

Sander, 2005, A systems approach to appraisal mechanisms in emotion, Neural Networks, 18, 317, 10.1016/j.neunet.2005.03.001

Sanderson, 2004, Identity verification using speech and face information, Digital Signal Processing, 14, 449, 10.1016/j.dsp.2004.05.001

Scherer, 2001

Sinha, 1992, Cardiovascular differentiation of emotions, Psychosomatic Medicine, 54, 422, 10.1097/00006842-199207000-00005

Sinha, 1996, Multivariate response patterning of fear and anger, Cognition & Emotion, 10, 173, 10.1080/026999396380321

Smith, 2006, Task and content modulate amygdala–hippocampal connectivity in emotional retrieval, Neuron, 49, 631, 10.1016/j.neuron.2005.12.025

Soleymani, 2008

Stemmler, 2001, Constraints for emotion specificity in fear and anger: the context counts, Psychophysiology, 38, 275, 10.1111/1469-8986.3820275

Takahashi, K., 2004. Remarks on emotion recognition from bio-potential signals. In: Proceedings of the 2nd International Conference on Autonomous Robots and Agents, Palmerston North, New Zealand.

Tipping, 2001, Sparse Bayesian learning and the relevance vector machine, Journal of Machine Learning Research, 1, 211

van den Broek, 2006, Computing emotion awareness through facial electromyography, Computer Vision in Human–Computer Interaction, 3979, 52, 10.1007/11754336_6

Vaughan, 2003, Brain–computer interface technology: a review of the second international meeting, IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11, 94, 10.1109/TNSRE.2003.814799

Ververidis, 2006, Emotional speech recognition: resources, features and methods, Speech Communication, 48, 1162, 10.1016/j.specom.2006.04.003

Wagner, J., Kim, J., André, E., 2005. From physiological signals to emotions: implementing and comparing selected methods for features extraction and classification. In: IEEE International Conference on Multimedia & Expo.

Wu, 2004, Probability estimates for multi-class classification by pairwise coupling, Journal of Machine Learning Research, 5, 975

Xu, 2006, Expressive image generation: towards expressive Internet communications, Journal of Visual Languages and Computing, 17, 445, 10.1016/j.jvlc.2006.03.005

Zeng, 2008, Audio–visual affective expression recognition through multistream fused HMM, IEEE Transactions on Multimedia, 10, 570, 10.1109/TMM.2008.921737

Zhang, 2005

Thông tin
Thông tin xuất bản

International Journal of Human-Computer Studies

Tập 67

607-627

Thông tin tác giả