Self-weighted Robust LDA for Multiclass Classification with Edge Classes
Tóm tắt
Linear discriminant analysis (LDA) is a popular technique to learn the most discriminative features for multi-class classification. A vast majority of existing LDA algorithms are prone to be dominated by the class with very large deviation from the others, i.e., edge class, which occurs frequently in multi-class classification. First, the existence of edge classes often makes the total mean biased in the calculation of between-class scatter matrix. Second, the exploitation of ℓ2-norm based between-class distance criterion magnifies the extremely large distance corresponding to edge class. In this regard, a novel self-weighted robust LDA with ℓ2,1-norm based pairwise between-class distance criterion, called SWRLDA, is proposed for multi-class classification especially with edge classes. SWRLDA can automatically avoid the optimal mean calculation and simultaneously learn adaptive weights for each class pair without setting any additional parameter. An efficient re-weighted algorithm is exploited to derive the global optimum of the challenging ℓ2,1-norm maximization problem. The proposed SWRLDA is easy to implement and converges fast in practice. Extensive experiments demonstrate that SWRLDA performs favorably against other compared methods on both synthetic and real-world datasets while presenting superior computational efficiency in comparison with other techniques.
Từ khóa
Tài liệu tham khảo
Abou-Moustafa Karim T., Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
Bian Wei, 2008, Proceedings of the International Conference on Pattern Recognition.
C. L. Blake and C. J. Merz. 1998. UCI Repository of Machine Learning Databases. Department of Information and Computer Science University of California Irvine CA. C. L. Blake and C. J. Merz. 1998. UCI Repository of Machine Learning Databases. Department of Information and Computer Science University of California Irvine CA.
Chang Xiaojun, Proceedings of the European Conference on Computer Vision, Vittorio Ferrari, Martial Hebert, Cristian Sminchisescu, and Yair Weiss (Eds.).
Chang Xiaojun, 2015, Proceedings of the AAAI Conference on Artificial Intelligence, Blai Bonet and Sven Koenig (Eds.).
Xiaojun Chang Haoquan Shen Sen Wang Jiajun Liu and Xue Li. 2014. Semi-supervised feature analysis for multimedia annotation by mining label correlation. In Proceedings of the 18th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining (Lecture Notes in Computer Science) Vincent S. Tseng Tu Bao Ho Zhi-Hua Zhou Arbee L. P. Chen and Hung-Yu Kao (Eds.) Vol. 8444. Springer 74--85. Xiaojun Chang Haoquan Shen Sen Wang Jiajun Liu and Xue Li. 2014. Semi-supervised feature analysis for multimedia annotation by mining label correlation. In Proceedings of the 18th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining (Lecture Notes in Computer Science) Vincent S. Tseng Tu Bao Ho Zhi-Hua Zhou Arbee L. P. Chen and Hung-Yu Kao (Eds.) Vol. 8444. Springer 74--85.
Chang Xiaojun, Proceedings of the Conference on Computer Vision and Pattern Recognition.
Fanty Mark, 1991, Proceedings of the Conference on Neural Information Processing Systems.
Fukunaga Keinosuke, Introduction to Statistical Pattern Recognition
Luo Minnan, 2016, Proceedings of the International Joint Conference on Artificial Intelligence, Subbarao Kambhampati (Ed.).
Douglas Martin R., 2006, Yohai
Peng Chong, 2016, A supervised learning model for high-dimensional and large-scale data, ACM Trans. Intell. Syst. Technol., 8, 1, 10.1145/2972957
Peng Chong, 2019, Discriminative ridge machine: A classifier for high-dimensional data or imbalanced data. arXiv preprint arXiv:1904.07496
Rao C. Radhakrishna, 1948, The utilization of multiple measurements in problems of biological classification, J. Royal Stat. Soc., 10, 159, 10.1111/j.2517-6161.1948.tb00008.x
Gilbert W. Stewart. 2001. Eigensystem. Society for Industrial 8 Applied Mathematics. Gilbert W. Stewart. 2001. Eigensystem. Society for Industrial 8 Applied Mathematics.
Xue Xiaowei, 2017, In Proceedings of the AAAI Conference on Artificial Intelligence, Satinder P. Singh and Shaul Markovitch (Eds.).
Syed Yahaya Sharipah Soaad, 2016, Robust linear discriminant analysis with automatic trimmed mean, J. Telecommun. Electron. Comput. Eng., 8, 1
Zhang Liang, Proceedings of the International Conference on Acoustics, Speech and Signal Processing.
Zhang Yu, 2010, Proceedings of the Conference on Neural Information Processing Systems.
Zhu Lei, Proceedings of the ACM International Conference on Multimedia, Qiong Liu, Rainer Lienhart, Haohong Wang, Sheng-Wei “Kuan-Ta