AL-ELM: One uncertainty-based active learning algorithm using extreme learning machine

Wang, 2011, Active learning in multimedia annotation and retrieval: a survey, ACM Trans. Intell. Syst. Technol., 2, 10, 10.1145/1899412.1899414 Settles, 2010 D. Lewis, J. Catlett, Heterogeneous uncertainty sampling for supervised learning, in: Proceedings of the International Conference on Machine Learning, Morgan Kaufmann, 1994, pp.148–156. H.S. Seung, M. Opper, H. Sompolinsky, Query by committee, in: Proceedings of the ACM Workshop on Computational Learning Theory, ACM Press, 1992, pp. 287–294. Schein, 2007, Active learning for logistic regression: an evaluation, Mach. Learn., 68, 235, 10.1007/s10994-007-5019-5 S. Tong, D. Koller, Support vector machine active learning with applications to text classification, in: Proceedings of the International Conference on Machine Learning, Morgan Kaufmann, 2000, pp. 999–1006. Lindenbaum, 2004, Selective sampling for nearest neighbor classifiers, Mach. Learn., 54, 125, 10.1023/B:MACH.0000011805.60520.fe B. Settles, M. Craven, An analysis of active learning strategies for sequence labeling tasks, in: Proceedings of the Conference on Empirical Methods in Natural Language Processing, ACL Press, 2008, pp. 1069–1078. N. Roy, A. McCallum, Toward optimal active learning through sampling estimation of error reduction, in: Proceedings of the International Conference on Machine Learning, Morgan Kaufmann, 2001, pp.441–448. Y. Guo, R. Greiner, Optimistic active learning using mutual information, in: Proceedings of International Joint Conference on Artificial Intelligence, AAAI Press, 2007, pp.823–829. Wang, 2012, Inconsistency-based active learning for support vector machines, Pattern Recognit., 45, 3751, 10.1016/j.patcog.2012.03.022 Lughofer, 2012, Hybrid active learning for reducing the annotation effort of operators in classification systems, Pattern Recognit., 45, 884, 10.1016/j.patcog.2011.08.009 A. Mccallum, K. Nigram, Employing EM in pool-based active learning for text classification, in: Proceedings of the International Conference on Machine Learning, Morgan Kaufmann, 1998, pp.350–358. Cheng, 2007, Active learning for image retrieval with CO-SVM, Pattern Recognit., 40, 330, 10.1016/j.patcog.2006.06.005 Niu, 2013, Asymmetric propagation based batch mode active learning for image retrieval, Signal Process., 93, 1639, 10.1016/j.sigpro.2012.07.018 Yu, 2010, Active learning and semi-supervised learning for speech recognition: a unified framework using the global entropy reduction maximization criterion, Comput. Speech Lang., 24, 433, 10.1016/j.csl.2009.03.004 Chakraborty, 2013, Generalized batch mode active learning for face- based biometric recognition, Pattern Recognit., 46, 497, 10.1016/j.patcog.2012.07.025 N. Seliya, T.M. Khoshgoftaar, Active learning with neural networks for intrusion detection, in: Proceedings of IEEE International Conference on Information Reuse and Integration, IEEE Press, 2010, pp.49–54. Chen, 2013, Applying active learning to high-throughput phenotyping algorithms for electronic health records data, J. Am. Med. Inform. Assoc., 20, e253, 10.1136/amiajnl-2013-001945 Mohamed, 2010, Active learning for human protein-protein interaction prediction, BMC Bioinforma., 11, S57, 10.1186/1471-2105-11-S1-S57 Zhu, 2010, Confidence-based stopping criteria for active learning for data annotation, ACM Trans. Speech Lang. Process., 6, 3, 10.1145/1753783.1753784 Zhu, 2010, Active learning from stream data using optimal weight classifier ensemble, IEEE Trans. Syst., Man, Cybern., Part B: Cybern., 40, 1607, 10.1109/TSMCB.2010.2042445 Hoi, 2009, Batch mode active learning with applications to text categorization and image retrieval, IEEE Trans. Knowl. Data Eng., 21, 1233, 10.1109/TKDE.2009.60 Joshi, 2012, Scalable active learning for multiclass image classification, IEEE Trans. Pattern Anal. Mach. Intell., 34, 2259, 10.1109/TPAMI.2012.21 Huang, 2006, Extreme learning machine: theory and applications, Neurocomputing, 70, 489, 10.1016/j.neucom.2005.12.126 Huang, 2011, Extreme learning machine: a survey, Int. J. Mach. Learn. Cybern., 2, 107, 10.1007/s13042-011-0019-y Rumelhart, 1986, Learning representations by back-propagation errors, Nature, 323, 533, 10.1038/323533a0 Huang, 2012, Extreme learning machine for regression and multiclass classification, IEEE Trans. Syst., Man, Cybern., Part B: Cybern., 42, 513, 10.1109/TSMCB.2011.2168604 Li, 2005, Fully complex extreme learning machine, Neurocomputing, 68, 306, 10.1016/j.neucom.2005.03.002 Liang, 2006, A fast and accurate on-line sequential learning algorithm for feedforward networks, IEEE Trans. Neural Netw., 17, 1411, 10.1109/TNN.2006.880583 Zong, 2013, Weighted extreme learning machine for imbalance learning, Neurocomputing, 101, 229, 10.1016/j.neucom.2012.08.010 Huang, 2008, Enhanced random search based incremental extreme learning machine, Neurocomputing, 71, 3460, 10.1016/j.neucom.2007.10.008 Sun, 2008, Sales forecasting using extreme learning machine with applications in fashion retailing, Decis. Support. Syst., 46, 411, 10.1016/j.dss.2008.07.009 Choi, 2011, Realtime training on mobile devices for face recognition applications, Pattern Recognit., 44, 386, 10.1016/j.patcog.2010.08.009 Minhas, 2010, Human action recognition using extreme learning machine based on visual vocabularies, Neurocomputing, 73, 1906, 10.1016/j.neucom.2010.01.020 Chen, 2011, Sales forecasting system based on gray extreme learning machine with Taguchi method in retail industry, Expert Syst. Appl., 38, 1336, 10.1016/j.eswa.2010.07.014 F.C. Li, P.K. Wang, G.E. Wang, Comparison of the primitive classifiers with extreme learning machine in credit scoring, in: Proceedings of International Conference on Industrial Engineering and Engineering Management, IEEE Press, 2009, pp. 685–688. Li, 2012, A computer aided diagnosis system for thyroid disease using extreme learning machine, J. Med. Syst., 36, 3327, 10.1007/s10916-012-9825-3 Ruck, 1990, The multilayer perceptron as an approximation to a Bayes optimal discriminant function, IEEE Trans. Neural Netw., 1, 296, 10.1109/72.80266 Wan, 1990, Neural network classification: a Bayesian interpretation, IEEE Trans. Neural Netw., 1, 303, 10.1109/72.80269 Pan, 2012, Color image segmentation by fixation-based active learning with ELM, Soft Comput., 16, 1569, 10.1007/s00500-012-0830-8 H.T. Nguyen, A.W.M. Smeulders, Active learning using pre-clustering, in: Proceedings of International Conference on Machine Learning, Morgan Kaufmann, 2004, pp. 623–630. S. Dasgupta, D. Hsu, Hierarchical sampling for active learning, in: Proceedings of International Conference on Machine Learning, Morgan Kaufmann, 2008, pp. 208–215. S. Hoi, R. Jin, M. Lyu, Large-scale text categorization by batch mode active learning, in: Proceedings of the International Conference on the World Wide Web, ACM Press, 2006, pp. 633–642. T. Scheffer, C. Decomain, S..Wrobel, Active hidden Markov models for information extraction, in: Proceedings of the International Conference on Advances in Intelligent Data Analysis, Springer, 2001, pp. 309–318. Hsu, 2002, A comparison of methods for multiclass support vector machines, IEEE Trans. Neural Netw., 13, 415, 10.1109/72.991427 Bartlett, 1998, The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network, IEEE Trans. Inf. Theory, 44, 525, 10.1109/18.661502 Fletcher, 1981, vol. 2 Platt, 2000 Alcalá-Fdez, 2011, KEEL Data-Mining Software Tool: data set repository, integration of algorithms and experimental analysis framework, J. Multiple-Valued Log. Soft Comput., 17, 255 A.J. Joshi, F. Porikli, N. Papanikolopoulos, Multi-class active learning for image classification, in: Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition, IEEE Press, 2009, pp. 2372–2379. Chang, 2011, LIBSVM: a library for support vector machines, ACM Trans. Intell. Syst. Technol., 2, 27, 10.1145/1961189.1961199 I. Guyon, G. Gawley, G. Dror, V. Lemaire, Results of Active Learning Challenge, JMLR: Workshop Conf. Proc., vol. 16, 2011, pp. 19–45.