Feature selection for spatially enhanced LBP: application to face recognition
Tóm tắt
Block-based local binary patterns a.k.a. enhanced local binary patterns (ELBPs) have proven to be a highly discriminative descriptor for face recognition and image retrieval. Since this descriptor is mainly composed by histograms, little work (if any) has been done for selecting its relevant features (either the bins or the blocks). In this paper, we address feature selection for both the classic ELBP representation and the recently proposed color quaternionic LBP (QLBP). We introduce a filter method for the automatic weighting of attributes or blocks using an improved version of the margin-based iterative search Simba algorithm. This new improved version introduces two main modifications: (i) the hypothesis margin of a given instance is computed by taking into account the K-nearest neighboring examples within the same class as well as the K-nearest neighboring examples with a different label; (ii) the distances between samples and their nearest neighbors are computed using the weighted
$$\chi ^2$$
distance instead of the Euclidean one. This algorithm has been compared favorably with several competing feature selection algorithms including the Euclidean-based Simba as well as variance and Fisher score algorithms giving higher performances. The proposed method is useful for other descriptors that are formed by histograms. Experimental results show that the QLBP descriptor allows an improvement of the accuracy in discriminating faces compared with the ELBP. They also show that the obtained selection (attributes or blocks) can either improve recognition performance or maintain it with a significant reduction in the descriptor size.
Tài liệu tham khảo
Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. In: Buxton, B., Cipolla, R. (eds.) Computer Vision ECCV ’96, Volume 1064 of Lecture Notes in Computer Science, pp. 43–58. Springer, Berlin (1996)
Bishop, C .M.: Neural Networks for Pattern Recognition. Oxford University Press, Oxford (1995)
Gilad-Bachrach, R., Amir, N., Naftali, T.: Margin based feature selection—theory and algorithms. In: Proceedings of the Twenty-First International Conference on Machine Learning, ICML ’04, p. 43. ACM, New York, NY (2004)
Guan, D., Yuan, W., Lee, Y.-K., Najeebullah, K., Rasel, M.K.: A review of ensemble learning based feature selection. IETE Tech. Rev. 31(3), 190–198 (2014)
Huang, S.H.: Supervised feature selection: a tutorial. Artif. Intell. Res. 4(2), 22–37 (2015)
Hu, L.-Y., Huang, M.-W., Ke, S.-W., Tsai, C.-F.: The distance function effect on k-nearest neighbor classification for medical datasets. SpringerPlus 5(1), 1304 (2016). https://doi.org/10.1186/s40064-016-2941-7
Lan, R., Zhou, Y., Tang, Y.Y., Chen, C.L.P.: Person reidentification using quaternionic local binary pattern. In: 2014 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2014)
Luengo, J., García, S., Herrera, F.: On the choice of the best imputation methods for missing values considering three groups of classification methods. Knowl. Inf. Syst. 32(1), 77–108 (2012). https://doi.org/10.1007/s10115-011-0424-2
Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)
Peng, Z., Gurram, P., Kwon, H., Yin, W.: Sparse kernel learning-based feature selection for anomaly detection. IEEE Trans. Aerosp. Electron. Syst. 51(3), 1698–1716 (2015)
Samaria, F.S., Harter, A.C.: Parameterisation of a stochastic model for human face identification. In: Proceedings of the Second IEEE Workshop on Applications of Computer Vision, 1994, pp. 138–142 (1994)
Sun, Y., Todorovic, S., Goodison, S.: Local learning based feature selection for high dimensional data analysis. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1–18 (2010)
Sun, Y., Wu, D.: Feature extraction through local learning. Stat. Anal. Data Min. 2(1), 34–47 (2009)
Sez, J.A., Derrac, J., Luengo, J., Herrera, F.: Statistical computation of feature weighting schemes through data estimation for nearest neighbor classifiers. Pattern Recognit. 47, 3941–3948 (2014)
Yang, B., Chen, S.: A comparative study on local binary pattern (LBP) based face recognition: LBP histogram versus LBP image. Neurocomputing 120, 365–379 (2013)
Yang, M., Wang, F., Yang, P.: A novel feature selection algorithm based on hypothesis-margin. J. Comput. 3(12), 27–34 (2008)
Zhou, X., Wang, J.J.: Feature selection for image classification based on a new ranking criterion. J. Comput. Commun. 3, 74–79 (2015)