Can edges help convolution neural networks in emotion recognition?

Halder, 2013, General and interval type-2 fuzzy face-space approach to emotion recognition, IEEE Transactions on Systems, Man, and Cybernetics: Systems, 43, 587, 10.1109/TSMCA.2012.2207107 Kobayashi, 1997, Facial interaction between animated 3d face robot and human beings, 3732 Ekman, 1978 P. EKMAN, Facial action coding system (facs), A Human Face. Gao, 2003, Facial expression recognition from line-based caricatures, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 33, 407, 10.1109/TSMCA.2003.817057 Dahmane, 2014, Prototype-based modeling for facial expression analysis, IEEE Transactions on Multimedia, 16, 1574, 10.1109/TMM.2014.2321113 Liu, 2002, Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition, IEEE Transactions on Image processing, 11, 467, 10.1109/TIP.2002.999679 Zhang, 2014, Random gabor based templates for facial expression recognition in images with facial occlusion, Neurocomputing, 145, 451, 10.1016/j.neucom.2014.05.008 W. Zhen, Y. Zilu, Facial expression recognition based on local phase quantization and sparse representation, in: Proceedings of Eighth International Conference on Natural Computation (ICNC2012), 2012, pp. 222–225. Shan, 2013, Facial expression recognition based on local binary patterns: a comprehensive study, Image and Vision Computing, 27, 803, 10.1016/j.imavis.2008.08.005 Zhao, 2007, Dynamic texture recognition using local binary patterns with an application to facial expressions, IEEE Transactions on Pattern Analysis and Machine Intelligence, 29, 915, 10.1109/TPAMI.2007.1110 Kenji, 1991, Recognition of facial expression from optical flow, IEICE Transactions on Information and Systems, 74, 3474 M. F. Valstar, M. Pantic, I. Patras, Motion history for facial action detection from face video, in: Proceedings of IEEE Int’l Conf. Systems, Man and Cybernetics (SMC’04), The Hague, Netherlands, 2004, pp. 635–640. Wang, 2018, Intelligent facial emotion recognition based on stationary wavelet entropy and jaya algorithm, Neurocomputing, 272, 668, 10.1016/j.neucom.2017.08.015 Hegde, 2016, Kernel locality preserving symmetrical weighted fisher discriminant analysis based subspace approach for expression recognition, Engineering Science and Technology, an International Journal, 19, 1321, 10.1016/j.jestch.2016.03.005 D. I. Islam, S. N. Anal, A. Datta, Facial expression recognition using 2dpca on segmented images, in: Advanced Computational and Communication Paradigms, Springer, 2018, pp. 289–297. Siddiqi, 2014, Depth camera-based facial expression recognition system using multilayer scheme, IETE Technical Review, 31, 277, 10.1080/02564602.2014.944588 Siddiqi, 2015, Human facial expression recognition using stepwise linear discriminant analysis and hidden conditional random fields, IEEE Transactions on Image Processing, 24, 1386, 10.1109/TIP.2015.2405346 S. Wang, Y. Yuan, X. Zheng, X. Lu, Local and correlation attention learning for subtle facial expression recognition, Neurocomputing doi: 10.1016/j.neucom.2020.07.120. S. Noh, H. Park, Y. Jin, J.-I. Park, Feature-adaptive motion energy analysis for facial expression recognition, in: International Symposium on Visual Computing, Springer, 2007, pp. 452–463. Rashid, 2016, Convolutional neural networks based method for improving facial expression recognition, 73 Owusu, 2014, A neural-adaboost based facial expression recognition system, Expert Systems with Applications, 41, 3383, 10.1016/j.eswa.2013.11.041 Zhao, 2007, Facial complex expression recognition based on fuzzy kernel clustering and support vector machine, IEEE Transactions on Pattern Analysis and Machine Intelligence, 562–566 Wang, 2010, Emotion detection via discriminative kernel method, 7 Zeng, 2018, Facial expression recognition via learning deep sparse autoencoders, Neurocomputing, 273, 643, 10.1016/j.neucom.2017.08.043 Fei, 2020, Deep convolution network based emotion analysis towards mental health care, Neurocomputing, 388, 212, 10.1016/j.neucom.2020.01.034 A. Gudi, Recognizing semantic features in faces using deep learning, CoRR abs/1512.00743. A. Mollahosseini, D. Chan, M. H. Mahoor, Going deeper in facial expression recognition using deep neural networks, in: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), 2016, pp. 1–10. Khorrami, 2015, Do deep neural networks learn facial action units when doing expression recognition?, 19 E. Correa, A. Jonker, M. Ozo, R. Stolk, Emotion recognition using deep convolutional neural networks, Tech. rep., TU Delft (June 2016). Yu, 2015, Image based static facial expression recognition with multiple deep network learning, 435 Chen, 2014, Joint cascade face detection and alignment, 109 Zhang, 2014, Improving multiview face detection with multi-task deep convolutional neural networks, 1036 Zhu, 2012, Face detection, pose estimation, and landmark localization in the wild, 2879 Challenges in representation learning: Facial expression recognition challenge, http://www.kaggle.com/c/challengesin-representation-learning-facial-expression-recognitionchallenge. R. Breuer, R. Kimmel, A deep learning perspective on the origin of facial expressions, 2017, arXiv:1705.01842. S. Kherchaoui, A. Houacine, Facial expression identification system with euclidean distance of facial edges, in: 2014 6th International Conference of Soft Computing and Pattern Recognition (SoCPaR), 2014, pp. 6–10. doi:10.1109/SOCPAR.2014.7007973. L. H. Thai, N. D. T. Nguyen, T. S. Hai, A facial expression classification system integrating canny, principal component analysis and artificial neural network, CoRR abs/1111.4052. Canny, 1986, A computational approach to edge detection, IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-8, 679, 10.1109/TPAMI.1986.4767851 R. Gonzalez, R. Woods, Digital Image Processing, Pearson Education, 2011. Heath, 1997, A robust visual method for assessing the relative performance of edge detection algorithms, IEEE Transactions on Pattern Analysis and Machine Intelligence, 19, 1338, 10.1109/34.643893 S. Katiyar, A. V, Comparative analysis of common edge detection techniques in context of object extraction, IEEE Transactions on Geoscience and Remote Sensing 50 (2012) 68–78. M. Kamachi, M. Lyons, J. Gyoba, The japanese female facial expression (jaffe) database, Available: http://www.kasrl.org/jaffe.html. Oztürka, 2015, Comparison of edge detection algorithms for texture analysis on glass production, Procedia-Social and Behavioral Sciences, 195, 2675, 10.1016/j.sbspro.2015.06.477 V. Ramesh, R. Haralick, Performance characterization of edge detectors, in: Defense, Security, and Sensing, 1992. J. X. Y., A. Hoover, G. Jean-Baptiste, D. Goldgof, K. Bowyer, H. Bunke, A methodology for evaluating edge detection techniques for range images, in: Proc. Asian Conf. Computer Vision, 1995, pp. 415–419. Zhu, 1996, Efficient evaluations of edge connectivity and width uniformity, Image and Vision Computing, 14, 21, 10.1016/0262-8856(95)01036-X Karmakar, 2018, How to make a neural network say don’t know, Information Sciences, 430–431, 444, 10.1016/j.ins.2017.11.061