Face detection and recognition of natural human emotion using Markov random fields

Personal Technologies - 2007
Ilias Maglogiannis1, Demosthenes Vouyioukas1, Chris Aggelopoulos1
1Department of Information and Communication Systems Engineering, University of the Aegean, Samos, Greece

Tóm tắt

This paper presents an integrated system for emotion detection. In this research effort, we have taken into account the fact that emotions are most widely represented with eye and mouth expressions. The proposed system uses color images and it is consisted of three modules. The first module implements skin detection, using Markov random fields models for image segmentation and skin detection. A set of several colored images with human faces have been considered as the training set. A second module is responsible for eye and mouth detection and extraction. The specific module uses the HLV color space of the specified eye and mouth region. The third module detects the emotions pictured in the eyes and mouth, using edge detection and measuring the gradient of eyes’ and mouth’s region figure. The paper provides results from the system application, along with proposals for further research.

Từ khóa


Tài liệu tham khảo

Besag JE (1974) Spatial interaction and statistical analysis of lattice systems. J R Stat Soc Ser B 36(2):192–236

Celeux G, Forbes F, Peyrard N (2002) EM procedures using mean field-like approximations for Markov model-based image segmentation. Pattern Recognit 36(1):131–144

Chai D, Ngan KN (1999) Face segmentation using skin-color map in videophone applications. IEEE Trans Circuits Syst Video Technol 9(4):551–564

Chellapa P, Wilson C, Sirohey S (1995) Human and machine recognition of faces: a survey. In: Proceedings of IEEE, vol 83(5), pp 705–740

Chellappa R, Jain A (eds) (1996) Markov random fields: theory and applications. Academic, New York

Chellappa R, Wilson CL, Sirohey S (1995) Human and machine recognition of faces: a survey. In: Proceeding of IEEE, vol 83(5), pp 705–741

Cowie R, Douglas-Cowie E, Tsapatsoulis N, Votsis G, Kollias S, Fellenz W, Taylor J (2001) Emotion recognition in human-computer interaction. IEEE Signal Process Mag 18(1):32–80

DeCarlo D, Metaxas D (2000) Optical flow constraints on deformable models with applications to face tracking. Int J Comput Visi 38(2):99–127

Feraud R, Bernier OJ, Viallet JE, Collobert M (2001) A fast and accurate face detection based on neural network. IEEE Trans Pattern Anal Mach Intell 23(1):42–53

Hjelm E, Low BK (2001) Face detection: a survey. Comput Vis Image Underst 83(3):236–274

Ioannou S, Caridakis G, Karpouzis K, Kollias S (2006) Robust feature detection for facial expression recognition. EURASIP J Image Video Process. Special issue on Facial Image Processing

Ioannou S, Raouzaiou A, Tzouvaras V, Mailis T, Karpouzis K, Kollias S (2006) Emotion recognition through facial expression analysis based on a neurofuzzy network. Special issue on emotion: understanding & recognition neural networks. Elsevier, Amsterdam, vol 18(4), pp 423–435

Jones MJ, Rehg JM (2002) Statistical color models with application to skin detection. Comput Vis Pattern Recognit 46(1):274–280

Maio D, Maltoni D (2000) Real-time face location on gray-scale static images. Pattern Recognit 33(9):1525–1539

Pantic M, Rothkrantz LJM (1996) Automatic analysis of facial expressions: the state of the art. IEEE Trans Pattern Anal Mach Intell 22(12):1424–1445

Pantic M, Rothkrantz L (2004) Facial action recognition for facial expression analysis from static face images. IEEE Trans Syst Man Cybern Part B 34(3):1449–1461

Smeulders AWM, Worring M, Santini S, Gupta A (2000) Jain R content-based image retrieval at the end of the early years. IEEE Trans Pattern Anal Mach Intell 22(12):1349–1380

Sobottka K, Pitas I (1998) A novel method for automatic face segmentation, facial feature extraction and tracking. Signal Process Image Commun 12(3):263–281

Wallace M, Ioannou S, Raouzaiou A, Karpouzis K, Kollias S (2006) Dealing with feature uncertainty in facial expression recognition using possibilistic fuzzy rule evaluation. Int J Intell Syst Technol Appl 1:3–4

Wang H, Chang SF (1997) A highly efficient system for automatic face region detection in MPEG video. IEEE Trans Circuits Syst Video Technol 7(4):615–628

Wang Y, Yuan B (2001) A novel approach for human face detection from color images under complex background. Pattern Recognit 34:1983–1992

Wechsler H, Phillips P, Bruce V, Soulie F, Huang T (eds) (1998) Face recognition: from theory to applications. Springer, Heidelberg

Winkler G (1995) Image analysis, random fields and dynamic Monte Carlo methods. Springer, Heidelberg

Wong KW, Lam KM, Siu WC (2003) A robust scheme for live detection of human faces in color images. Signal Process Image Commun 18(2):103–114

Yang MH, Kriegman D, Ahuja N (2002) Detecting faces in images: a survey. IEEE Trans Pattern Anal Mach Intell 24(1):34–58

Ying Li, Lai JH, Yuen PC (2006) Multi-template ASM Method for feature points detection of facial image with diverse expressions. Autom Face Gesture Recognit 435–440

Zhao W, Chellappa R, Rosenfeld A, Phillips PJ (2003) Face recognition: a literature survey. CVL technical report, Center for Automation Research, University of Maryland at College Park. http://www.cfar.umd.edu/ftp/TRs/FaceSurvey.ps.gz

Thông tin
Thông tin xuất bản

Personal Technologies

Thông tin tác giả