Automatic facial expression analysis: a survey
Tóm tắt
Từ khóa
Tài liệu tham khảo
Darwin, 1872
Ekman, 1971, Constants across cultures in the face and emotion, J. Personality Social Psychol., 17, 124, 10.1037/h0030377
M. Suwa, N. Sugie, K. Fujimora, A preliminary note on pattern recognition of human emotional expression, Proceedings of the Fourth International Joint Conference on Pattern Recognition, Kyoto, Japan, 1978, pp. 408–410.
Mase, 1991, Recognition of facial expression from optical flow, IEICE Trans. E, 74, 3474
Dulguerov, 1999, Review of objective topographic facial nerve evaluation methods, Am. J. Otol., 20, 672
R. Koenen, Mpeg-4 Project Overview, International Organisation for Standartistion, ISO/IEC JTC1/SC29/WG11, La Baule, 2000.
Schwartz, 1976, Facial expression and imagery in depression: an electromyographic study, Psychosomatic Med., 38
Ekman, 1982
Ekman, 1978
W. Friesen, P. Ekman, Emotional facial action coding system, unpublished manual, 1984.
C. Izard, The maximally descriminative facial movement coding system (MAX), Available from Instructional Resource Center, University of Delaware, Newark, Delaware, 1979.
C. Izard, L. Dougherty, E. Hembree, A system for indentifying affect expressions by holistic judgments, unpublished manuscript, 1983.
N. Tsapatsoulis, K. Karpouzis, G. Stamou, A fuzzy system for emotion classification based on the MPEG-4 facial definition parameter, European Association on Signal Processing EUSIPCO, 2000.
M. Hoch, G. Fleischmann, B. Girod, Modeling and animation of facial expressions based on B-splines, Visual Comput. (1994) 87–95.
W. Friesen, P. Ekman, Dictionary—interpretation of FACS scoring, unpublished manuscript, 1987.
P. Ekman, E. Rosenberg, J. Hager, Facial action coding system affect interpretation database (FACSAID), http://nirc.com/Expression/FACSAID/facsaid.html, July 1998.
Ekman, 1982, Methods for measuring facial actions, 45
Matsumoto, 1990, Cultural similarities and differences in display rules, Motivation Emotion, 14, 195, 10.1007/BF00995569
Matsumoto, 1993, Ethnic differences in affect intensity, emotion judgments, display rules, and self-reported emotional expression, Motivation Emotion, 17, 107, 10.1007/BF00995188
Lanitis, 1997, Automatic interpretation and coding of face images using flexible models, IEEE Trans. Pattern Anal. Mach. Intell., 19, 743, 10.1109/34.598231
H. Hong, H. Neven, C. Von der Malsburg, Online facial expression recognition based on personalized galleries, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, (FG’98), IEEE, Nara, Japan, 1998, pp. 354–359.
J. Steffens, E. Elagin, H. Neven, PersonSpotter—fast and robust system for human detection, tracking and recognition, Proceedings of the Second International Conference on Face and Gesture Recognition, (FG’98), Nara, Japan, 1998, pp. 516–521.
Essa, 1997, Coding, analysis, interpretation and recognition of facial expressions, IEEE Trans. Pattern Anal. Mach. Intell., 19, 757, 10.1109/34.598232
A. Pentland, B. Moghaddam, T. Starner, View-based and modular eigenspaces for face recognition, IEEE Conference on Computer Vision and Pattern Recognition, Seattle, NA, USA, 1994, pp. 84–91.
Rowley, 1998, Neural network-based face detection, IEEE Trans. Pattern Anal. Mach. Intell., 20, 23, 10.1109/34.655647
W. Fellenz, J. Taylor, N. Tsapatsoulis, S. Kollias, Comparing template-based, feature-based and supervised classification of facial expressions from static images, Proceedings of Circuits, Systems, Communications and Computers (CSCC’99), Nugata, Japan, 1999, pp. 5331–5336.
Belhumeur, 1997, Eigenfaces vs. fisherfaces: recognition using class specific linear projection, IEEE Trans. Pattern Anal. Mach. Intell., 19, 711, 10.1109/34.598228
M. Black, D. Fleet, Y. Yacoob, A framework for modeling appearance change in image sequences, Sixth International Conference on Computer Vision (ICCV’98), IEEE Computer Society Press, Silverspring, MD, 1998.
Black, 1997, Recognizing facial expressions in image sequences using local parameterized models of image motion, Internat. J. Comput. Vision, 25, 23, 10.1023/A:1007977618277
M. Dailey, G. Cottrell, PCA Gabor for expression recognition, Institution UCSD, Number CS-629, 1999.
C. Lisetti, D. Rumelhart, Facial expression recognition using a neural network, Proceedings of the 11th International Flairs Conference, AAAI Press, New York, 1998.
M. Bartlett, Face image analysis by unsupervised learning and redundancy reduction, Ph.D. Thesis, University of California, San Diego, 1998.
J. Lien, Automatic recognition of facial expression using hidden Markov models and estimation of expression intensity, Ph.D. Thesis, The Robotics Institute, CMU, April 1998.
C. Padgett, G. Cottrell, Representing face image for emotion classification, in: M. Mozer, M. Jordan, T. Petsche (Eds.), Advances in Neural Information Processing Systems, Vol. 9, MIT Press, Cambridge, MA, pp. 894–900.
G.W. Cottrell, J. Metcalfe, EMPATH: face, gender and emotion recognition using holons, in: R. Lippman, J. Moody, D. Touretzky (Eds.), Advances in Neural Information Processing Systems, Morgan Kaufman, San Mateo, CA, Vol. 3, 1991, pp. 564–571.
G. Edwards, T. Cootes, C. Taylor, Face recognition using active appearance models, Proceedings of the Fifth European Conference on Computer Vision (ECCV), Vol. 2, University of Freiburg, Germany, 1998, pp. 581–695.
H. Kobayashi, F. Hara, Facial interaction between animated 3D face robot and human beings, Proceedings of the International Conference on Systems, Man and Cybernetics, Orlando, FL, USA, 1997, pp. 3732–3737.
Huang, 1997, Facial expression recognition using model-based feature extraction and action parameters classification, J. Visual Commun. Image Representation, 8, 278, 10.1006/jvci.1997.0359
Pantic, 2000, Expert system for automatic analysis of facial expression, Image Vision Comput. J., 18, 881, 10.1016/S0262-8856(00)00034-2
Z. Zhang, M. Lyons, M. Schuster, S. Akamatsu, Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron, IEEE Proceedings of the Second International Conference on Automatic Face and Gesture Recognition (FG’98), Nara, Japan, 1998, pp. 454–459.
Lyons, 1999, Automatic classification of single facial images, IEEE Trans. Pattern Anal. Mach. Intell., 21, 10.1109/34.817413
T. Otsuka, J. Ohya, Spotting segments displaying facial expression from image sequences using HMM, IEEE Proceedings of the Second International Conference on Automatic Face and Gesture Recognition (FG’98), Nara, Japan, 1998, pp. 442–447.
M. Yoneyama, Y. Iwano, A. Ohtake, K. Shirai, Facial expression recognition using discrete Hopfield neural networks, Proceedings of the International Conference on Image Processing (ICIP), Santa Barbara, CA, USA, Vol. 3, 1997, pp. 117–120.
P. Eisert, B. Girod, Facial expression analysis for model-based coding of video sequences, Picture Coding Symposium, Berlin, Germany, 1997, pp. 33–38.
Yacoob, 1996, Recognizing human facial expression from long image sequences using optical flow, IEEE Trans. Pattern Anal. Mach. Intell., 18, 636, 10.1109/34.506414
D. DeCarlo, D. Metaxas, The integration of optical flow and deformable models with applications to human face shape and motion estimation, Proceedings of the International Conference on Computer Vision and Pattern Recognition (CVPR’96), 1996, pp. 231–238.
S. Basu, N. Oliver, A. Pentland, 3D modeling and tracking of human lip motions, Proceedings of ICCV 98, Bombay, India, 1998.
Tian, 2001, Recognizing action units for facial expression analysis, IEEE Trans. Pattern Anal. Mach. Intell., 23, 97, 10.1109/34.908962
M. Wang, Y. Iwai, M. Yachida, Expression recognition from time-sequential facial images by use of expression change model, IEEE Proceedings of the Second International Conference on Automatic Face and Gesture Recognition (FG’98), Nara, Japan, 1998, pp. 324–329.
T. Otsuka, J. Ohya, Extracting facial motion parameters by tracking feature points, Proceedings of First International Conference on Advanced Multimedia Content Processing, Osaka, Japan, 1998, pp. 442–453.
Rosenblum, 1996, Human expression recognition from motion using a radial basis function network architecture, IEEE Trans. Neural Networks, 7, 1121, 10.1109/72.536309
Donato, 1999, Classifying facial actions, IEEE Trans. Pattern Anal. Mach. Intell., 21, 974, 10.1109/34.799905
B. Fasel, J. Luettin, Recognition of asymmetric facial action unit activities and intensities, Proceedings of the International Conference on Pattern Recognition (ICPR 2000), Barcelona, Spain, 2000.
T. Choudhury, A. Pentland, Motion field histograms for robust modeling of facial expressions, Proceedings of the International Conference on Pattern Recognition (ICPR 2000), Barcelona, Spain, 2000.
B. Bascle, A. Blake, Separability of pose and expression in facial tracking and animation, Proceedings of the International Conference on Computer Vision, Bombay, India, 1998.
Kaiser, 1992, Automated coding of facial behavior in human–computer interactions with FACS, J. Nonverbal Behavior, 16, 67, 10.1007/BF00990323
I. Essa, A. Pentland, Facial expression recognition using a dynamic model and motion energy, IEEE Proceedings of the Fifth International Conference on Computer Vision (ICCV 1995), Cambridge, MA, 1995, pp. 360–367.
K. Karpouzis, G. Votsis, G. Moschovitis, S. Kollias, Emotion recognition using feature extraction and 3-D models, Proceedings of IMACS International Multiconference on Circuits and Systems Communications and Computers (CSCC’99), Athens, Greece, 1999, pp. 5371–5376.
Hardcastle, 1976
Pollen, 1981, Phase relationship between adjacent simple cells in the visual cortex, Science, 212, 1409, 10.1126/science.7233231
Daugman, 1988, Complete discrete 2D Gabor transform by neural networks for image analysis and compression, IEEE Trans. Acoustics, Speech Signal Process., 36, 1169, 10.1109/29.1644
I. Matthews, Active shape model toolbox, University of East Anglia, Norwich, UK, Matlab Toolbox version 2.0.0, July 1997.
Nagel, 1987, On the estimation of optical flow, Artif. Intell., 33, 299, 10.1016/0004-3702(87)90041-5
Y. Wu, T. Kanade, J. Cohn, C. Li, Optical flow estimation using wavelet motion model, IEEE International Conference on Computer Vision, Bombay, India, 1998, pp. 992–998.
Cai, 1996, Adaptive multiresolution collocation methods for initial boundary value problems of nonlinear PDEs, Soc. Ind. Appl. Math., 33, 937
E. Simoncelli, Distributed representation and analysis of visual motion, Ph.D Thesis, Massachusetts Institute of Technology, 1993.
M. Abdel-Mottaleb, R. Chellappa, A. Rosenfeld, Binocular motion stereo using MAP estimation, IEEE CVPR (1993) 321–327.
D. Terzopoulos, K. Waters, Analysis of facial images using physical and anatomical models, Proceeding of the Third International Conference on Computer Vision, Osaka, Japan, 1990, pp. 727–732.
B. Schiele, J. Crowley, Probabilistic object recognition using multidimensional receptive field histograms, Proceedings of the International Conference on Pattern Recognition (ICPR 1996), Vienna, Austria, 1996.
J. Cohn, A. Zlochower, J. Lien, Y. Wu, T. Kanade, Automated face coding: a computer-vision based method of facial expression analysis, Seventh European Conference on Facial Expression Measurement and Meaning, Salzburg, Austria, 1997, pp. 329–333.
N. Oliver, A. Pentland, F. Berard, LAFTER: a real-time lips and face tracker with facial expression recognition, Proceedings of the IEEE Conference on Computer Vision (CVPR97), S. Juan, Puerto Rico, 1997.
H. Kobayashi, F. Hara, Dynamic recognition of basic facial expressions by discrete-time recurrent neural network, Proceedings of the International Joint Conference on Neural Networks, 1993, pp. 155–158.
J. Zhao, G. Kearney, Classifying facial emotions by backpropagation neural networks with fuzzy inputs, Proceedings of the International Conference on Neural Information Processing, Vol. 1, 1996, pp. 454–457.
J. Lien, T. Kanade, J. Cohn, C. Li, Automated facial expression recognition based on FACS action units, IEEE Proceedings of the Second International Conference on Automatic Face and Gesture Recognition (FG’98), Nara, Japan, 1998.
C. Padgett, G. Cottrell, R. Adolphs, Categorical perception in facial emotion classification, Proceedings of the 18th Annual Conference of the Cognitive Science Society, San Diego, CA, USA, 1996.
S. Kimura, M. Yachida, Facial expression recognition and its degree estimation, IEEE Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, 1997, pp. 295–300.
Lisetti, 2000, Automatic facial expression interpretation, pragmatics and cognition (Special issue on facial information processing: a multidisciplinary perspective) Pragmat. Cognition, 8, 185, 10.1075/pc.8.1.09lis
Lades, 1993, Distortion invariant object recognition in the dynamic link architecture, IEEE Trans. Comput., 42, 300, 10.1109/12.210173
Bergen, 1992, Hierarchical model-based motion estimation, Vol. 588, 237
M. Bartlett, P. Viola, T. Sejnowski, B. Golomb, J. Larsen, J. Hager, P. Ekman, Classifying facial action, Advances in Neural Information Processing Systems, Vol. 8, MIT Press, Cambridge, 1996.
J. Cohn, G. Katz, Bimodal expression of emotion by face and voice, Workshop on Face/Gesture Recognition and Their Applications, Sixth ACM International Multimedia Conference, Bristol, UK, 1998.
L. Chen, T. Huang, T. Miyasato, R. Nakatsu, Multimodal human emotion/expression recognition, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition (FG’98), IEEE, Nara, Japan, 1998.
T. Cootes, C. Taylor, A. Lanitis, Multi-resolution search using active shape models, 12th International Conference on Pattern Recognition, Vol. 1, IEEE CS Press, Los Alamitos, CA, 1994, pp. 610–612.
T. Kanade, J. Cohn, Y. Tian, Comprehensive database for facial expression analysis, IEEE Proceedings of the Fourth International Conference on Automatic Face and Gesture Recognition (FG’00), Grenoble, France, 2000.
Ekman, 1979, About brows, 169