Fast distant support vector data description
Tóm tắt
As an indispensable approach of one class classification, support vector data description (SVDD) has been studied within diverse research areas and application domains. Distant SVDD (dSVDD) is a variant of SVDD that shows higher identification accuracy. However, dSVDD is caught by the pricy cost and troublesome parameterization, which diminishes its popularity. This paper proposes a fast distant SVDD (fdSVDD) algorithm that addresses above two problems while maintaining the performance. To this end, a new objective that is equivalent to dSVDD’s original objective is proposed firstly; then the least square version of such a new objective serves as the objective of fdSVDD; finally, fdSVDD is implemented by solving a set of linear equations. To handle the parameterization problem, a data-derived heuristic is given. To foster the efficiency, fdSVDD is equipped with the reduction strategy of training data and the specification strategy of support vectors. And in the existence of negative data, fdSVDD is extended to fast parallel SVDD (fpSVDD). In experiments on real datasets, the proposed algorithms exhibit obvious improvement in efficiency and competitive behaviors compared with the peers.
Tài liệu tham khảo
Tax DMJ, Duin RPW (2004) Support vector data description. Mach Learn 54(1):45–66
Shin JH, Lee B, Park KS (2011) Detection of abnormal living patterns for elderly living alone using support vector data description. Inf Technol 11(2):225–239
Wang S, Yu J, Lapira E et al (2013) A modified support vector data description based novelty detection approach for machinery components. Appl Soft Comput 13(2):1193–1205
Jay P, Singh PK (2015) An effective multiobjective approach for hard partitional clustering. Memet Comput 7(2):93–104
Benkedjouh T, Medjaher K, Zerhouni N et al (2012) Fault prognostic of bearings by using support vector data description. In: IEEE Conference on Prognostics and Health Management (PHM), pp 1–7
Ge Z, Gao F, Song Z (2011) Batch process monitoring based on support vector data description method. J Process Control 21(6):949–959
Jiang Q, Yan X, Lv Z et al (2014) Independent component analysis-based non-Gaussian process monitoring with preselecting optimal components and support vector data description. Int J Prod Res 52(11):3273–3286
Hwang BW, Kwon SJ, Lee SW (2014) Facial image reconstruction from a corrupted image by support vector data description. Comput Inform 32(6):1212–1228
Nekkaa Messaouda, Boughaci Dalila (2015) A memetic algorithm with support vector machine for feature selection and classification. Memet Comput 7(1):59–73
Choi YS (2009) Least squares one-class support vector machine. Pattern Recognit Lett 30:1236–1240
Liu YH, Member, Liu YC, Chen YJ (2010) Fast support vector data descriptions for novelty detection. IEEE Trans Neural Netw 21(8):1296–1313
Bo L, Xiao YS, Yun Z, Hao ZF (2012) An efficient approach to boost support vector data description. iN: Proceedings of the international conference on cybernetics and informatics, Lecture notes in electrical engineering, vol 163, pp 2231–2238
Zhe W, Gao DQ (2010) Discriminant support vector data description. In: Third international workshop on advanced computational intelligence, pp 97–100
Iván C, Ignacio A, Natalio K, Hidalg JI (2014) Blind optimisation problem instance classification via enhanced universal similarity metric. Memet Comput 6(4):263–276
Trung L, Dat T, Tien T, Khanh N, Wanli M (2013) Fuzzy entropy semi-supervised support vector data description. In: The IEEE international joint conference on neural networks, pp 1–5
Lee KY, Kim DW, Kwang HL, Doheon L (2007) Density-induced support vector data description. IEEE Trans Neural Netw 18(1):284–289
Bo L, Xiao YS, Cao LB, Hao ZF, Deng FQ (2013) SVDD-based outlier detection on uncertain data. Knowl Inf Syst 34(3):597–618
Myungraee C, Jun SK, Baek JG (2014) Density weighted support vector data description. Expert Syst Appl 41:3343–3350
Phuoc N, Dat T, Xu H, Ma WL (2013) Parallel support vector data description. In: Advances in computational intelligence. Springer, Berlin, Heidelberg, pp 280–290
Horn D, Gottlieb A (2002) Algorithm for data clustering in pattern recognition problems based on quantum mechanics. Phys Rev Lett 88(1):1–22
Patvardhan C, Sulabh B, Anand S (2015) Quantum-inspired evolutionary algorithm for difficult knapsack problems. Memet Comput 7(2):135–155
http://archive.ics.uci.edu/ml/
Yuh-Jye L, Mangasarian OL (2001) RSVM: reduced support vector machines. In: Proc of the first siam international conference on data mining, Chicago, pp 350–366
Williams C, Seeger M (2001) Using Nyström method to speed up kernel machines. Adv Neural Inf Process Syst 13:682–688
Wang SS, Zhang ZH (2014) Efficient algorithms and error analysis for the modified nystrom method. arXiv:1404.0138