A Transfer Learning Algorithm Based on Support Vector Machine
Tóm tắt
In many scenarios of classification, test and training data must come from same feature space and have same distribution. However, this assumption may not be satisfactory in many practical applications. In recent years, the emergence of transfer learning has provided a new technology to solve this problem. Aiming at problems that the existing transfer learning algorithms only utilize the data in source domain to assist the learning tasks of target domain without considering the effect of target data to source domain, the selectivity bias of knowledge and scarce labeled samples, this paper proposed a collaboration mutual transfer learning algorithm based on support vector machine -CMATLSVM.CMATLSVM realizes multiple mutual learnings between source and target domains through the collaborative mutual assistance. In collaborative mutual assistance, in order to further improve the classification effect of target domain task, a similarity measure is introduced, which restricts negative transfer in constraints of objective function. At the same time representative dataset in source domain are obtained to reduce the size of training data and improve training efficiency. The experimental results on several real-world datasets show the effectiveness of CMATLSVM, and it also has certain advantages compared with benchmark algorithms.
Từ khóa
Tài liệu tham khảo
Jordan MI, Mitchell TM (2015) Machine learning: trends, perspectives, and prospects. Science 349(6245):255–260
Chuan-Long Y, Yue-Fei Z, Jin-Long F et al (2017) A deep learning approach for intrusion detection using recurrent neural networks. IEEE Access 99:1–1
Abdel-Hamid O, Mohamed AR, Jiang H et al (2014) Convolutional neural networks for speech recognition. IEEE/ACM Trans Audio Speech Lang Process 22(10):1533–1545
Athanasios V, Nikolaos D, Anastasios D et al (2018) Deep learning for computer vision: a brief review. Comput Intell Neurosci 2018:1–13
UiUz H (2011) A two-stage feature selection method for text categorization by using information gain, principal component analysis and genetic algorithm. Knowl-Based Syst 24(7):1024–1032
Jiang M, Pan Z, Li N (2017) Multi-label text categorization using L21-norm minimization extreme learning machine. Neurocomputing 261:4–10
Olatunji Olusanya S (2017) Improved email spam detection model based on support vector machines. Neural Comput Appl 31(3):691–699
Cao J, Zhang K, Luo M et al (2016) Extreme learning machine and adaptive sparse representation for image classification. Neural Networks 81:91–102
Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359
Day O, Khoshgoftaar TM (2017) A survey on heterogeneous transfer learning. J Big Data 4(1):29
Weiss K, Khoshgoftaar TM, Wang DD (2016) A survey of transfer learning. J Big Data 3(1):9
Long M, Wang J, Ding G et al (2014) Adaptation regularization: a general framework for transfer learning. IEEE Trans Knowl Data Eng 26(5):1076–1089
Mozafari AS, Jamzad M (2016) A SVM-based model-transferring method for heterogeneous domain adaptation. Pattern Recognit 56:142
Li X, Mao W, Jiang W (2016) Extreme learning machine based transfer learning for data classification. Neurocomputing 174:203–211
Gao J, Fan W, Jiang J, et al (2008) Knowledge transfer via multiple model local structure mapping. In: international conference on knowledge discovery & data mining. pp 283–291.
Quanz B, Huan J (2009) Large margin transductive transfer learning. In: ACM conference on information and knowledge management. ACM pp 1327–1336
Xie G, Sun Y, Lin M et al (2017) A selective transfer learning method for concept drift adaptation. IEEE Trans Neural Networks Learn Syst 29:4822–4832
Li J, Weifei Wu, Xue Di (2019) Transfer naive bayes algorithm with group probabilities. Appl Intell. https://doi.org/10.1007/s10489-019-01512-6
Ni T, Gu X, Wang J et al (2018) Scalable transfer support vector machine with group probabilities. Neurocompting 20:570–582
Long M, Wang J, Ding G, et al (2012) Transfer learning with graph co-regularization. In: twenty-sixth AAAI conference on artificial intelligence. AAAI Press
Li J, Wu W, Xue D, Gao P (2019) Multi-source deep transfer neural network algorithm. Sensors 19(18):3992–4009
Shaha M, Pawar M (2018) Transfer learning for image classification. In: 2018 second international conference on electronics, communication and aerospace technology (ICECA). IEEE
Shao L, Zhu F, Li X (2017) Transfer learning for visual categorization: a survey. IEEE Trans Neural Networks Learn Syst 26(5):1019–1034
Zhang L, Zhang D (2016) Robust visual knowledge transfer via extreme learning machine based domain adaptation. IEEE Trans Image Process 2:1–10
Siyu S, Stephen MA, Ruqiang Y et al (2018) Highly-accurate machine fault diagnosis using deep transfer learning. IEEE Trans Indust Informat 202:1–19
Bocsi B, Csato L, Peters J (2014) Alignment-based transfer learning for robot models. In: international joint conference on neural networks. IEEE
Cortes C, Vapnik VN (1995) Support vector networks. Mach Learn 20(3):273–297
Suzuki S, Shouno H (2017) Support vector machine histogram: new analysis and architecture design method of deep convolutional neural network. Neural Process Lett 2017(4):1–16
Suykens JAK, Lukas L, Vandewalle J (2000) Sparse least squares support vector machine classifiers. Neural Process Lett 9(3):293–300
Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300
Yang Z, Zhou Z, Jiang Y (2016) Least squares support vector machine with parametric margin for binary classification1. J Intell Fuzzy Syst 30(5):2897–2904
Maheswari RV, Subburaj P, Vigneshwaran B et al (2014) Non linear support vector machine based partial discharge patterns recognition using fractal features. J Intell Fuzzy Syst Appl Eng Technol 27(5):2649–2664
Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):1–27
Bickel S (2006) ECML-PKDD discovery challenge 2006 overview. In: Proceedings of ECML-PKDD discovery challenge workshop at Humboldt-Universit¨at zu Berlin Germany. 2006 pp 1–9
Deng NY, Tian YJ (2004) New method in data mining: support vector machine. Beijing Science Press, Beijing, pp 4–19
Han T, Liu C, Yang W et al (2018) Deep transfer network with joint distribution adaptation: a new intelligent fault diagnosis framework for industry application. ISA Trans 97:269–281
Li J, Wu W, Xue D (2020) Research on transfer learning algorithm based on support vector machine. J Intell Fuzzy Syst 38(10):1–16
Hong J, Yin J et al (2011) TrSVM: a transfer learning algorithm using domain similarity. Comput Res Develop 48(10):1823–1830