Facial expression recognition from video sequences: temporal and static modeling

S. Baluja, Probabilistic modelling for face orientation discrimination: learning from labeled and unlabeled data, in: Neural Information Processing Systems (NIPS’98), 1998, pp. 854–860 M.J. Black, Y. Yacoob, Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion, in: Proc. Internat. Conf. Computer Vision (ICCV’95), 1995, pp. 374–381 Cacioppo, 1990, Inferring psychological significance from physiological signals, Amer. Psychologist, 45, 16, 10.1037/0003-066X.45.1.16 L.S. Chen, Joint processing of audio–visual information for the recognition of emotional expressions in human–computer interaction, Ph.D. Thesis, University of Illinois at Urbana-Champaign, Department of Electrical Engineering, 2000 Chow, 1968, Approximating discrete probability distribution with dependence trees, IEEE Trans. Inform. Theory, 14, 462, 10.1109/TIT.1968.1054142 I. Cohen, Automatic facial expression recognition from video sequences using temporal information. MS Thesis, University of Illinois at Urbana-Champaign, Department of Electrical Engineering, 2000 Cormen, 1990 L.C. De Silva, T. Miyasato, R. Natatsu, Facial emotion recognition using multimodal information. in: Proc. IEEE Internat. Conf. on Information, Communications and Signal Processing (ICICS’97), 1997, pp. 397–401 Donato, 1999, Classifying facial actions, IEEE Trans. Pattern Anal. Machine Intell., 21, 974, 10.1109/34.799905 Ekman, 1994, Strong evidence for universals in facial expressions: a reply to Russell’s mistaken critique, Psychol. Bull., 115, 268, 10.1037/0033-2909.115.2.268 Ekman, 1978 Essa, 1997, Coding, analysis, interpretation, and recognition of facial expressions, IEEE Trans. Pattern Anal. Machine Intell., 19, 757, 10.1109/34.598232 Friedman, 1997, On bias, variance, 0/1-loss, and the curse-of-dimensionality, Data Mining Knowledge Discovery, 1, 55, 10.1023/A:1009778005914 Friedman, 1997, Bayesian network classifiers, Machine Learning, 29, 131, 10.1023/A:1007465528199 A. Garg, D. Roth, Understanding probabilistic classifiers, in: Proc. Eur. Conf. on Machine Learning, 2001, pp. 179–191 Goleman, 1995 Haas, 1970, Inferences for the Cauchy distribution based on maximum likelihood estimators, Biometrika, 57, 403 Izard, 1994, Innate and universal facial expressions: evidence from developmental and cross-cultural research, Psychol. Bull., 115, 288, 10.1037/0033-2909.115.2.288 T. Kanade, J. Cohn, Y. Tian, Comprehensive database for facial expression analysis, 2000 Kay, 1990 A. Lanitis, C.J. Taylor, T.F. Cootes, A unified approach to coding and interpreting face images, in: Proc. 5th Internat. Conf. on Computer Vision (ICCV’95), 1995, pp. 368–373 Levinson, 1983, An introduction to the application of the theory of probabilitic functions of a Markov process to automatic speech recognition, Bell Lab System Technical J., 62, 1035, 10.1002/j.1538-7305.1983.tb03114.x J. Lien, Automatic recognition of facial expressions using hidden Markov models and estimation of expression intensity. Ph.D. Thesis, Carnegie Mellon University, 1998 A. Martinez, Face image retrieval using HMMs, in: IEEE Workshop on Content-based Access of Images and Video Libraries, 1999, pp. 35–39 Mase, 1991, Recognition of facial expression from optical flow, IEICE Trans., E74, 3474 A. Nefian, M. Hayes, Face recognition using an embedded HMM, in: IEEE Conf. on Audio and Video-based Biometric Person Authentication, 1999, pp. 19–24 Nigam, 2000, Text classification from labeled and unlabeled documents using EM, Machine Learning, 39, 103, 10.1023/A:1007692713085 Oliver, 2000, LAFTER: a real-time face and lips tracker with facial expression recognition, Pattern Recognition, 33, 1369, 10.1016/S0031-3203(99)00113-2 N. Oliver, A. Pentland, F. Bérard, LAFTER: lips and face real time tracker, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR’97), 1997, pp. 123–129 T. Otsuka, J. Ohya, Recognizing multiple persons’ facial expressions using HMM based on automatic extraction of significant frames from image sequences, in: Proc. Internat. Conf. on Image Processing (ICIP’97), 1997, pp. 546–549 T. Otsuka, J. Ohya, A study of transformation of facial expressions based on expression recognition from temproal image sequences, Technical Report, Institute of Electronic, Information, and Communications Engineers (IEICE), 1997 Pantic, 2000, Automatic analysis of facial expressions: the state of the art, IEEE Trans. Pattern Anal. Machine Intell., 22, 1424, 10.1109/34.895976 Rabiner, 1989, A tutorial on hidden Markov models and selected applications in speech processing, Proc. IEEE, 77, 257, 10.1109/5.18626 Rabiner, 1993 Rosenblum, 1996, Human expression recognition from motion using a radial basis function network architecture, IEEE Trans. Neural Network, 7, 1121, 10.1109/72.536309 Salovey, 1990, Emotional intelligence, Imagination, Cognition, Personality, 9, 185, 10.2190/DUGG-P24E-52WK-6CDG Sebe, 2000, Toward improved ranking metrics, IEEE Trans. Pattern Anal. Machine Intell., 22, 1132, 10.1109/34.879793 Starks, 1994 H. Tao, T.S. Huang, Connected vibrations: a modal analysis approach to non-rigid motion tracking, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR’98), 1998, pp. 735–740 Ueki, 1994, Expression analysis/synthesis system based on emotion space constructed by multilayered neural network, Systems Comput. Japan, 25, 95 Yacoob, 1996, Recognizing human facial expressions from long image sequences using optical flow, IEEE Trans. Pattern Anal. Machine Intell., 18, 636, 10.1109/34.506414