Optimization of stacking ensemble configurations through Artificial Bee Colony algorithm

Polikar, 2006, Ensemble based systems in decision making, IEEE Circuits and Systems Magazine, 6, 21, 10.1109/MCAS.2006.1688199 Kuncheva, 2005 Wolpert, 2002, Stacked generalization, Neural Networks, 5, 241, 10.1016/S0893-6080(05)80023-1 Ting, 1999, Issues in stacked generalization, Journal of Artificial Intelligence Research, 10, 271, 10.1613/jair.594 G. Tsoumakas, I. Partalas, I. Vlahavas, A taxonomy and short review of ensemble selection, in: Proceedings of the Workshop on Supervised and Unsupervised Ensemble Methods and Their Applications, 2008, pp. 41–46. Y. Chen, M.L. Wong, An ant colony optimization approach for stacking ensemble, in: Proceedings of IEEE Second World Congress on Nature and Biologically Inspired Computing, 2010, pp. 146–151. Ivan, 2013, Application of GA optimization for solving precedent relationship problem in project scheduling, Mathematical and Computer Modelling, 57, 2067, 10.1016/j.mcm.2011.06.022 Dorigo, 1996, Ant system: optimization by a colony of co-operating agents, IEEE Transactions on Systems, Man, and Cybernetics, Part B, 26, 29, 10.1109/3477.484436 Y.F. Liu, S.Y. Liu, A hybrid discrete artificial bee colony algorithm for permutation flowshop scheduling problem, Applied Soft Computing 13(3) (2013) 1459-1463 R. Zhang, S. Song, C. Wu, A hybrid artificial bee colony algorithm for the job shop scheduling problem, International Journal of Production Economics 141(1) (2013) 167–178 Sha, 2010, A multi-objective PSO for job-shop scheduling problems, Expert Systems With Applications, 37, 1065, 10.1016/j.eswa.2009.06.041 Tasgetiren, 2010, An ensemble of discrete differential evolution algorithms for solving the generalized traveling salesman problem, Applied Mathematics and Computation, 215, 3356, 10.1016/j.amc.2009.10.027 Yu, 2010, Ensemble of niching algorithms, Information Sciences, 180, 2815, 10.1016/j.ins.2010.04.008 Mallipeddi, 2010, Ensemble strategies with adaptive evolutionary programming, Information Sciences, 180, 1571, 10.1016/j.ins.2010.01.007 Mallipeddi, 2010, Ensemble of constraint handling techniques, IEEE Transactions on Evolutionary Computation, 14, 561, 10.1109/TEVC.2009.2033582 Zhao, 2010, Multi-objective evolutionary algorithm with ensemble of external archives, International Journal of Innovative Computing, Information and Control, 6, 1713 Karaboga, 2005, An Idea Based on Honey Bee Swarm for Numerical Optimization M. El-Abd, A cooperative approach to the artificial bee colony algorithm, in: Proceedings of IEEE Congress on Evolutionary Computation, 2010, pp. 1–5. Karaboga, 2009, A comparative study of artificial bee colony algorithm, Applied Mathematics and Computation, 214, 108, 10.1016/j.amc.2009.03.090 Karaboga, 2008, On the performance of Artificial Bee Colony (ABC) algorithm, Applied Soft Computing, 8, 687, 10.1016/j.asoc.2007.05.007 L. Bao, J.C. Zeng, Comparison and analysis of the selection mechanism in the artificial bee colony algorithm, in: Proceedings of IEEE Ninth International Conference on Hybrid Intelligent Systems, 2009, pp. 411–416. F.J. Ordonez, A. Ledezma, A. Sanchis, Genetic approach for optimizing ensembles of classifiers, in: Proceedings of the Twenty-First International FLAIRS Conference, 2008, pp. 89–94. A. Ledezma, R. Aler, A. Sanchis, D. Borrajo, Empirical evaluation of optimized stacking configurations, in: Proceedings of 16th IEEE International Conference on Tools with Artificial Intelligence, 2004, pp. 49–55. Chen, 2011, Optimizing stacking ensemble by an ant colony optimization approach, ACM Proceedings of Genetic and Evolutionary Computation, 7 Michael, 2009, Learn++.NC: combining ensemble of classifiers with dynamically weighted consult-and-vote for efficient incremental learning of new classes, IEEE Transactions on Neural Networks, 20, 152, 10.1109/TNN.2008.2008326 Witten, 2005 D. Karaboga, B. Basturk, Artificial Bee Colony (ABC) Optimization Algorithm for Solving Constrained Optimization Problems, LNCS: Advances in Soft Computing: Foundations of Fuzzy Logic and Soft Computing, Vol: 4529/2007, pp: 789-798, Springer- Verlag, 2007, IFSA 2007 Karaboga, 2007, A powerful and efficient algorithm for numerical function optimization: Artificial Bee Colony (ABC) algorithm, Journal of Global Optimization, 39, 459, 10.1007/s10898-007-9149-x Akbari, 2012, A multi-objective artificial bee colony algorithm, Swarm and Evolutionary Computation, 2, 39, 10.1016/j.swevo.2011.08.001 Xu, 2010, Chaotic artificial bee colony approach to Uninhabited Combat Air Vehicle (UCAV) path planning, Aerospace Science and Technology, 14, 535, 10.1016/j.ast.2010.04.008 Safarzadeh, 2011, Loading pattern optimization of PWR reactors using artificial bee colony, Annals of Nuclear Energy, 38, 2218, 10.1016/j.anucene.2011.06.008 Omkar, 2011, Gopalakrishnan, Artificial Bee Colony (ABC) for multi-objective design optimization of composite structures, Applied Soft Computing, 11, 489, 10.1016/j.asoc.2009.12.008 W. Zou, Y. Zhu, H. Chen, Z. Zhu, Cooperative approaches to artificial bee colony algorithm, in: Proceedings of IEEE International Conference on Computer Application and System Modeling, vol. 9, 2010, pp. 44–48. S. Dzeroski, B. Zenko, Stacking with multi-response model trees, in: Proceedings of the International Workshop on Multiple Classifier Systems, vol. 2364, 2002, pp. 201–211. A.K. Seewald, How to make stacking better and faster while also taking care of unknown weakness, in: Proceedings of the Nineteenth International Conference of Machine Learning, 2002, pp. 554–561. Rokach, 2009, Taxonomy for characterizing ensemble methods in classification tasks: a review and annotated bibliography, Computational Statistics and Data Analysis, 53, 4046, 10.1016/j.csda.2009.07.017 Merz, 1999, Using correspondence analysis to combine classifiers, Machine Learning, 36, 33, 10.1023/A:1007559205422 A. Seewald, J. Furnkranz, An evaluation of grading classifiers, in: Proceedings of Fourth International Conference on Advances in Intelligent Data Analysis, Springer-Verlag, 2001, pp. 115–124. L. Todorovski, S. Dzeroski, Combining multiple models with meta decision trees, in: Proceedings of the 4th European Conference on Principles of Data Mining and Knowledge Discovery, 2000, pp. 54–64. Dzeroski, 2004, Is combining classifier better than selecting the best one?, Machine Learning, 54, 255, 10.1023/B:MACH.0000015881.36452.6e A. Ledezma, R. Aler, D. Borrajo, Heuristic search based stacking of classifiers, chapter Heuristic and Optimization for Knowledge Discovery (2002) 54-67, Idea Group Publishing Ledezma, 2010, GA-stacking: evolutionary stacked generalization, Intelligent Data Analysis, 14, 89, 10.3233/IDA-2010-0410 WEKA, A Java Machine Learning Package. Available: 〈http://www.cs.waikato.ac.nz/˜ml/weka/〉 (online). A. Frank, A. Asuncion, UCI Machine Learning Repository, School of Information and Computer Science, University of California, Irvine, CA, 2010, Available: 〈http://archive.ics.uci.edu/ml〉 (online). Hall, 2009, The WEKA data mining software: an update, SIGKDD Explorations, 11, 10, 10.1145/1656274.1656278 Sun, 2001, Hierarchical text classification and evaluation, Proceedings of IEEE ICDM, 521 Freitas, 2007, A tutorial on hierarchical classification with applications in bioinformatics, Research and Trends in Data Mining Technologies and Applications, 99, 175, 10.4018/978-1-59904-271-8.ch007 M.E. Basiri, N. Ghasem-Aghaee, M.H. Aghdam, Using ant colony optimization-based selected features for predicting post-synaptic activity in proteins, in: Proceedings of EvoBIO, Springer, 2008, pp. 12–23 (LNCS 4973). Kabir, 2008, A new hybrid ant colony optimization algorithm for feature selection, Applied Soft Computing, 8, 687 Indira, 2010, Minimum sample size determination of vibration signals in machine learning approach to fault diagnosis using power analysis, Expert Systems with Applications, 37, 8650, 10.1016/j.eswa.2010.06.068 Breiman, 2001, Random forest, Machine Learning, 45, 5, 10.1023/A:1010933404324 Penga, 2011, An empirical study of classification algorithm evaluation for financial risk prediction, Applied Soft Computing, 11, 2906, 10.1016/j.asoc.2010.11.028