Evolutionary based ensemble framework for realizing transfer learning in HIV-1 Protease cleavage sites prediction
Tóm tắt
The role of human immunodeficiency virus (HIV) protease in viral maturation is indispensable as the drug therapy primarily targets the HIV protease for the treatment of human immunodeficiency virus infection. Protease inhibitors are designed to block the active site of the protease, thereby restraining the replication of the viral particle. However, designing efficient inhibitors is challenging due to little or no similarity of the sequence among the cleaved sites and availability of few experimentally-verified sites. In order to learn the sequence structure, support vector machines have been comprehensively used however insufficient training data degrades the performance. Thus, a cross-domain approach is adopted by the proposed ensemble model for predicting the HIV-1 protease cleavage sites. In this study, a method for combining multiple weighted classifiers optimally by incorporating the knowledge derived from various amino acid encoding techniques is proposed. As a result, each classifier pair with a specific type of heterogeneous information which is generated by the different encoding method, and the final prediction could be obtained by aggregating the locally trained classifiers. The optimally coupled sequence of features and classifiers that characterized the heterogeneous feature is achieved promptly by genetic algorithm. Furthermore, the efficiency of the model is verified by the tests conducted on the four HIV-1 protease datasets offered at UCI machine learning database. The performance parameters such as average accuracy, standard deviation, and area under curve have been evaluated on the proposed model to justify the advancements over the other state- of-the-art methods. In addition, Friedman and post hoc tests were conducted to show the significant improvement achieved by the proposed framework. These results quantified the enhancement of the proposed ensemble model performance.
Tài liệu tham khảo
Gallo C, Montagnier L (2003) The discovery of HIV as the cause of AIDS. N Engl J Med 24:2283–2285
Shen H-B, Chou K-C (2008) HIVcleave: a web-server for predicting human immunodeficiency virus protease cleavage sites in proteins. Anal Biochem 375:388–90. https://doi.org/10.1016/j.ab.2008.01.012
Chou KC (1996) Prediction of human immunodeficiency virus protease cleavage sites in proteins. Anal Biochem 233:1–14. https://doi.org/10.1006/abio.1996.0001
Chou JJ (1993) Predicting cleavability of peptide sequences by HIV protease via correlation-angle approach. J Protein Chem 12:291–302. https://doi.org/10.1007/BF01028191
Gök M, Özcerit AT (2013) A new feature encoding scheme for HIV-1 protease cleavage site prediction. Neural Comput Appl 22:1757–1761. https://doi.org/10.1007/s00521-012-0967-5
Lumini A, Nanni L (2006) Machine learning for HIV-1 protease cleavage site prediction. Pattern Recogn Lett 27:1537–1544. https://doi.org/10.1016/j.patrec.2006.01.014
Zeng A, Pan D, Bin H e J (2007) Prediction of MHC II-binding peptides using rough set-based rule sets ensemble. Appl Intell 27:153–166. https://doi.org/10.1007/s10489-006-0025-z
Rognvaldsson T, You L, Garwicz D (2015) State of the art prediction of HIV-1 protease cleavage sites. Bioinformatics 31:1204–1210. https://doi.org/10.1093/bioinformatics/btu810
Rögnvaldsson T, You L (2004) Why neural networks should not be used for HIV-1 protease cleavage site prediction. Bioinformatics 20:1702–1709. https://doi.org/10.1093/bioinformatics/bth144
Nanni L, Lumini A (2009) Using ensemble of classifiers for predicting HIV protease cleavage sites in proteins. Amino Acids 36:409–416. https://doi.org/10.1007/s00726-008-0076-z
Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22:1345–1359. https://doi.org/10.1109/TKDE.2009.191
Weiss K, Khoshgoftaar TM, Wang D (2016) A survey of transfer learning. Journal of Big Data. https://doi.org/10.1186/s40537-016-0043-6
Verspurten J, Gevaert K, Declercq W, Vandenabeele P (2009) SitePredicting the cleavage of proteinase substrates. Trends Biochem Sci 34:319–323. https://doi.org/10.1016/j.tibs.2009.04.001
Nanni L (2006) Comparison among feature extraction methods for HIV-1 protease cleavage site prediction. Pattern Recogn 39:711–713. https://doi.org/10.1016/j.patcog.2005.11.002
Sammut C, Webb GI (2017) Supervised learning. In: Encyclopedia of machine learning and data mining, pp 1213–1214
Greenwald HS, Oertel CK (2017) Future directions in machine learning. Front Robot AI 3:1–7. https://doi.org/10.3389/frobt.2016.00079
Weiss KR, Khoshgoftaar TM (2016) An investigation of transfer learning and traditional machine learning algorithms. In: Proceedings - 2016 IEEE 28th international conference on tools with artificial intelligence, ICTAI 2016, pp 283–290. https://doi.org/10.1109/ICTAI.2016.48
Maetschke S, Towsey M, Mi B (2005) BLOMAP: an encoding of amino acids which improves signal peptide cleavage site prediction. pp 141–150
Fall ML, Zuluaga M (2013) Ensemble methods. https://doi.org/10.1007/978-3-642-03711-5
Chen Z, Lin T, Chen R et al (2017) Creating diversity in ensembles using synthetic neighborhoods of training samples. Appl Intell 47:570–583. https://doi.org/10.1007/s10489-017-0922-3
Abe N, Mamitsuka H (1998) Query learning strategies using boosting and bagging. Proc 25th Int Conf Mach Learn 388:1–9. https://doi.org/10.1017/CBO9781107415324.004
Kolter J, Maloof M (2007) Dynamic weighted majority?: an ensemble method for drifting concepts. J Mach Learn Res 8:2755–2790. https://doi.org/10.1.1.140.2481
Singh D, Singh P, Sisodia DS (2018) Evolutionary based optimal ensemble classifiers for HIV-1 protease cleavage sites prediction. Expert Syst Appl 109:86–99. https://doi.org/10.1016/j.eswa.2018.05.003
Rögnvaldsson T, Etchells T, You L et al (2009) How to find simple and accurate rules for viral protease cleavage specificities. BMC Bioinformatics 10:149. https://doi.org/10.1186/1471-2105-10-149
Qian N, Sejnowski TJ (1988) Predicting the secondary structure of globular proteins using neural network models. J Mol Biol 202:865–884. https://doi.org/10.1016/0022-2836(88)90564-5
Kawashima Shuichi, Kanehisa M (2000) AAindex: amino acid index database. Nucleic Acids Res 28:374–374
Kidera A, Konishi Y, Oka M et al (1985) Statistical analysis of the physical properties of the 20 naturally occurring amino acids. J Protein Chem 4:23–55
Nanni L, Lumini A (2006) MppS: an ensemble of support vector machine based on multiple physicochemical properties of amino acids. Neurocomputing 69:1688–1690. https://doi.org/10.1016/j.neucom.2006.04.001
Mundra P, Kumar M, Kumar KK et al (2007) Using pseudo amino acid composition to predict protein subnuclear localization: approached with PSSM. Pattern Recogn Lett 28:1610–1615
Huang W, Tung C, Huang H et al (2007) ProLoc: prediction of protein subnuclear localization using SVM with automatic selection from physicochemical composition features. BioSystems 90:57–581
You L, Garwicz D, Rögnvaldsson T (2005) Comprehensive bioinformatic analysis of the specificity of human immunodeficiency virus type 1 protease. J Virol 79:12477–12486
Kontijevskis A, Wikberg JES, Komorowski J (2007) Computational proteomics analysis of HIV-1 protease interactome. Protein: Struct Funct Bioinforma 68:305–312
Oğul H (2009) Variable context Markov chains for HIV protease cleavage site prediction. BioSystems 96:246–250
Jaeger S, Chen S S -S (2010) Information fusion for biological prediction. J Data Sci 8:269–288
Liu H, Shi X, Guo D, Zhao Z (2015) Feature selection combined with neural network structure optimization for HIV-1 protease cleavage site prediction. BioMed Research International
Qiao S, Yan B, Li J (2017) Ensemble learning for protein multiplex subcellular localization prediction based on weighted KNN with different features. Appl Intell 48:1–12. https://doi.org/10.1007/s10489-017-1029-6
Nanni L, Lumini A (2008) A genetic approach for building different alphabets for peptide and protein classification. BMC Bioinforma 9:45. https://doi.org/10.1186/1471-2105-9-45
Song J, Tan H, Perry AJ et al (2012) PROSPER: An integrated feature-based tool for predicting protease substrate cleavage sites. PLoS ONE. https://doi.org/10.1371/journal.pone.0050300
Wang Y, Song J, Marquez-lago TT et al (2017) Knowledge-transfer learning for prediction of matrix metalloprotease substrate-cleavage sites. Scientific Reports 7:5755. https://doi.org/10.1038/s41598-017-06219-7
Lu J, Behbood V, Hao P et al (2015) Transfer learning using computational intelligence: a survey. Knowl-Based Syst 80:14–23. https://doi.org/10.1016/j.knosys.2015.01.010
Glorot X, Bordes A, Bengio Y (2011) Domain adaptation for large-scale sentiment classification: a deep learning approach. In: Proceedings of the 28th international conference on machine learning, pp 513–520
Iqbal M, Xue B, Al-Sahaf H, Zhang M (2017) Cross-domain reuse of extracted knowledge in genetic programming for image classification. IEEE Trans Evol Comput 21:4. https://doi.org/10.1109/TEVC.2017.2657556
Mei S, Fei W, Zhou S (2011) Gene ontology based transfer learning for protein subcellular localization. BMC Bioinforma 12:44. https://doi.org/10.1186/1471-2105-12-44
Liu Q, Xu Q, Zheng VW et al (2010) Multi-task learning for cross-platform siRNA efficacy prediction: an in-silico study. BMC Bioinforma 11:17–26. https://doi.org/10.1186/1471-2105-11-181
Widmer C, Toussaint NC, Altun Y, Rätsch G (2010) Inferring latent task structure for multitask learning by multiple kernel learning. BMC Bioinforma 11:S5. https://doi.org/10.1186/1471-2105-11-S8-S5
Widmer C, Toussaint NC, Altun Y et al (2010) Novel machine learning methods for MHC class I binding prediction. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 6282 LNBI: pp 98–109. https://doi.org/10.1007/978-3-642-16001-19
Schweikert G, Widmer C, Schölkopf B, Rätsch G (2009) An empirical analysis of domain adaptation algorithms for genomic sequence analysis. In: Advances in neural information processing systems, pp 1433–1440
Zamani M, Kremer SC (2011) Amino acid encoding schemes for machine learning methods. In: 2011 IEEE international conference on bioinformatics and biomedicine workshops, BIBMW 2011, pp 327–333. https://doi.org/10.1109/BIBMW.2011.6112394
Henikoff S, Henikoff JG (1992) Amino acid substitution matrices from protein blocks. Proc Natl Acad Sci USA 89:10915–10919. https://doi.org/10.1073/pnas.89.22.10915
Gök M, Özcerit A T (2012) OETMAP: a new feature encoding scheme for MHC class i binding prediction. Mol Cell Biochem 359:67–72. https://doi.org/10.1007/s11010-011-1000-5
Wu CH, Whitson GM, Montllor GJ (1990) PROCANS?: A protein classification system using a neural network*. In: IJCNN international joint conference on neural network. IEEE, pp 91–96
Zvelebil MJ, Barton GJ, Taylor WR, Sternberg MJE (1987) Prediction of protein secondary structure and active sites using the alignment of homologous sequences. J Mol Biol 195:957–961. https://doi.org/10.1016/0022-2836(87)90501-8
Deb K, Agrawal RB (1994) Simulated binary crossover for continuous search space. Compl Syst 9:1–34. https://doi.org/10.1.1.26.8485Cached
Blake CL, Merz CJ (1998) UCI repository of machine learning databases. University of California. http://archive.ics.uci.edu/ml/
Schilling O, Overall CM (2008) Proteome-derived, database-searchable peptide libraries for identifying protease cleavage sites. Nat Biotechnol 26:685–694
Long M, Wang J, Ding G et al (2014) Adaptation regularization: a general framework for transfer learning. IEEE Trans Knowl Data Eng 26:1076–1089. https://doi.org/10.1109/TKDE.2013.111
Sinno-Jialin-Pan (2011) Domain adaptation via transfer component analysis. IEEE Trans Neural Netw 22:199–210. https://doi.org/10.1109/TNN.2010.2091281
Long M, Wang J, Sun J, Yu PS (2015) Domain invariant transfer kernel learning. IEEE Trans Knowl Data Eng 27:1519–1532. https://doi.org/10.1109/TKDE.2014.2373376
Long M, Wang J, Ding G et al (2013) Transfer feature learning with joint distribution adaptation. In: Proceedings of the IEEE international conference on computer vision, pp 2200–2207. https://doi.org/10.1109/ICCV.2013.274
Gong B, Shi Y, Sha F, Grauman K (2012) Geodesic flow kernel for unsupervised domain adaptation. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, pp 2066–2073. https://doi.org/10.1109/CVPR.2012.6247911
Jiang M, Huang W, Huang Z, Yen GG (2017) Integration of global and local metrics for domain adaptation learning via dimensionality reduction. IEEE Trans Cybern 47:1–14. https://doi.org/10.1109/TCYB.2015.2502483
O’Shea JP, Chou MF, Quader SA et al (2013) PLogo: a probabilistic approach to visualizing sequence motifs. Nat Methods 10:1211–1212. https://doi.org/10.1038/nmeth.2646
Wang J, Shen X, Pan W (2005) On transductive support vector machines. Prediction and discovery. https://doi.org/10.3724/SP.J.1087.2008.01642
Melacci S, Belkin M (2011) Laplacian support vector machines trained in the primal. J Mach Learn Res 12:1149–1184
Yang J, Yan R, Hauptmann AG (2007) Cross-domain video concept detection using adaptive svms. In: ACM international conference on multimedia, p 188
Dai W, Yang Q, Xue G-R, Yu Y (2007) Boosting for transfer learning. In: Proceedings of the 24th international conference on machine learning - ICML ’07, pp 193–200. https://doi.org/10.1145/1273496.1273521
Al-Stouhi S, Reddy CK (2011) Adaptive boosting for transfer learning using dynamic updates. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 6911 LNAI, pp 60–75. https://doi.org/10.1007/978-3-642-23780-514
Daumé H III (2007) Frustratingly easy domain adaptation. Association for computational linguistic (ACL)s, pp 256–263. https://doi.org/10.1.1.110.2062
Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning. Elements 1:337–387. https://doi.org/10.1007/b94608
Benavoli A, Corani G, Mangili F (2016) Should we really use post-hoc tests based on mean-ranks? J Mach Learn Res 17:1– 10
Hochberg Y (1988) A sharper bonferroni procedure for multiple tests of significance. Biometrika 75:800–802. https://doi.org/10.1093/biomet/75.4.800
Dunn OJ (2018) Multiple comparisons among means. J Am Stat Assoc 56:52–64