Decision templates for multiple classifier fusion: an experimental comparison

Pattern Recognition - Tập 34 - Trang 299-314 - 2001
Ludmila I. Kuncheva1, James C. Bezdek2, Robert P.W. Duin3
1School of Mathematics, University of Wales, Bangor, Gwynedd LL57 1UT, UK
2Department of Computer Science, University of West Florida, Pensacola, FL 32514, USA
3Faculty of Applied Sciences, Delft University of Technology, P.O. Box 5046, 2600 GA Delft, The Netherlands

Tài liệu tham khảo

Lam, 1995, Optimal combination of pattern classifiers, Pattern Recognition Lett., 16, 945, 10.1016/0167-8655(95)00050-Q Rogova, 1994, Combining the results of several neural network classifiers, Neural Networks, 7, 777, 10.1016/0893-6080(94)90099-X Woods, 1997, Combination of multiple classifiers using local accuracy estimates, IEEE Trans. Pattern Anal. Mach. Intell., 19, 405, 10.1109/34.588027 Xu, 1992, Methods of combining multiple classifiers and their application to handwriting recognition, IEEE Trans. Systems Man Cybernet., 22, 418, 10.1109/21.155943 Kittler, 1998, On combining classifiers, IEEE Trans. Pattern Anal. Mach. Intell., 20, 226, 10.1109/34.667881 Cho, 1995, Combining multiple neural networks by fuzzy integral and robust classification, IEEE Trans. Systems Man Cybernet., 25, 380, 10.1109/21.364825 Gader, 1996, Fusion of handwritten word classifiers, Pattern Recognition Lett., 17, 577, 10.1016/0167-8655(96)00021-9 M. Grabisch, F. Dispot, A comparison of some for fuzzy classification on real data, Proceedings of the Second International Conference on Fuzzy Logic and Neural Networks, Iizuka, Japan, 1992, pp. 659–662. Keller, 1994, Advances in fuzzy integration for pattern recognition, Fuzzy Sets and Systems, 65, 273, 10.1016/0165-0114(94)90024-8 Bloch, 1996, Information combination operators for data fusion: a comparative review with classification, IEEE Trans. Systems Man Cybernet. — Part A: Systems Humans, 26, 52, 10.1109/3468.477860 Jacobs, 1991, Adaptive mixtures of local experts, Neural Comput., 3, 79, 10.1162/neco.1991.3.1.79 Jacobs, 1995, Methods for combining experts’ probability assessments, Neural Comput., 7, 867, 10.1162/neco.1995.7.5.867 Jordan, 1995, Convergence results for the EM approach to mixtures of experts architectures, Neural Networks, 8, 1409, 10.1016/0893-6080(95)00014-3 S.J. Nowlan, G.E. Hinton, Evaluation of adaptive mixtures of competing experts, in: R.P. Lippmann, J.E. Moody, D.S. Touretzky (Eds.), Advances in Neural Information Processing Systems, Vol. 3, 1991, pp. 774–780. Bishop, 1995 Drucker, 1994, Boosting and other ensemble methods, Neural Comput., 6, 1289, 10.1162/neco.1994.6.6.1289 Benediktsson, 1992, Consenus theoretic classification methods, IEEE Trans. Systems Man Cybernet., 22, 688, 10.1109/21.156582 Ng, 1992, Consensus diagnosis, IEEE Trans. Systems Man Cybernet., 22, 916, 10.1109/21.179832 Benediktsson, 1997, Multistage classifiers optimized by neural networks and genetic algorithms, Nonlinear Anal. Theory Methods Appl., 30, 1323, 10.1016/S0362-546X(97)00222-8 Battiti, 1994, Democracy in neural nets, Neural Networks, 7, 691, 10.1016/0893-6080(94)90046-9 Dasarathy, 1978, A composite classifier system design, Proc. IEEE, 67, 708, 10.1109/PROC.1979.11321 E. Filippi, M. Costa, E. Pasero, Multi-layer perceptron ensembles for increased performance and fault-tolerance in pattern recognition tasks, IEEE International Conference on Neural Networks, Orlando, FL, 1994, pp. 2901–2906. C.-C. Chiang, H.-C. Fu, A divide-and-conquer methodology for modular supervised neural network design, IEEE International Conference on Neural Networks, Orlando, FL, 1994, pp. 119–124. Smieja, 1996, The pandemonium system of reflective agents, IEEE Trans. Neural Networks, 7, 97, 10.1109/72.478395 Kuncheva, 1993, Change-glasses approach in pattern recognition, Pattern Recognition Lett., 14, 619, 10.1016/0167-8655(93)90046-G L.A. Rastrigin, R.H. Erenstein, Method of Collective Recognition, Energoizdat, Moscow, 1982 (in Russian). Alpaydin, 1996, Local linear perceptrons for classification, IEEE Trans. Neural Networks, 7, 788, 10.1109/72.501737 R.P.W. Duin, D.M.J. Tax, Classifier-conditional posterior probabilities in: A. Amin, D. Dori, P. Pudil, H. Freeman (Eds.), Advances in Pattern Recognition, Lecture Notes in Computer Science, Vol. 1451, Springer, Berlin, 1998, pp. 611–619. Cho, 1995, Multiple network fusion using fuzzy logic, IEEE Trans. Neural Networks, 6, 497, 10.1109/72.363487 Grabisch, 1994, Classification by fuzzy integral, Fuzzy Sets and Systems, 65, 255, 10.1016/0165-0114(94)90023-X Wang, 1998, Use of fuzzy-logic-inspired features to improve bacterial recognition through classifier fusion, IEEE Trans. Systems Man Cybernet., 28B, 583, 10.1109/3477.704297 Lu, 1996, Knowledge integration in a multiple classifier system, Appl. Intell., 6, 75, 10.1007/BF00117809 Duda, 1973 J.C. Bezdek, J.M Keller, R. Krishnapuram, N.R. Pal, Fuzzy Models and Algorithms for Pattern Recognition and Image Processing, Kluwer, Dordrecht, 1999, in Press. Lam, 1997, Application of majority voting to pattern recognition: an analysis of its behavior and performance, IEEE Trans. Systems Man Cybernet., 27, 553, 10.1109/3468.618255 Huang, 1995, A method of combining multiple experts for the recognition of unconstrained handwritten numerals, IEEE Trans. Pattern Anal. Mach. Intell., 17, 90, 10.1109/34.368145 Kuncheva, 1997, An application of OWA operators to the aggregation of multiple classification decisions, 330 M. van Breukelen, R.P.W. Duin, D.M.J. Tax, J.E. den Hartog, Combining classifiers for the recognition of handwritten digits, Proceedings of the First IAPR TC1 Workshop on Statistical Techniques in Pattern Recognition, Prague, Czech Republic, 1997, pp. 13–18. L.I. Kuncheva, On combining multiple classifiers, Proceedings of the Seventh International Conference on Information Processing and Management of Uncertainty (IPMU’98), Paris, France, 1998, pp. 1890–1891. Tax, 1997 S. Hashem, B. Schmeiser, Y. Yih, Optimal linear combinations of neural networks: an overview, IEEE International Conference on Neural Networks, Orlando, FL, 1994, pp. 1507–1512. Hashem, 1997, Optimal linear combinations of neural networks, Neural Networks, 10, 599, 10.1016/S0893-6080(96)00098-6 Tresp, 1995, Combining estimators using non-constant weighting functions Y.S. Huang, C.Y. Suen, A method of combining multiple classifiers — a neural network approach, Proceedings of the 12th International Conference on Pattern Recognition, Jerusalem, Israel, 1994, pp. 473–475. Dubois, 1980 Bordley, 1982, A multiplicative formula for aggregating probability assessments, Management Sci., 28, 1137, 10.1287/mnsc.28.10.1137 Anderson, 1982, Logistic discrimination, 169 Raudys, 1998, On expected classification error of the fisher linear classifier with pseudo-inverse covariance matrix, Pattern Recognition Lett., 19, 385, 10.1016/S0167-8655(98)00016-6 Duin, 1997 L.I. Kuncheva, R.K. Kounchev, R.Z. Zlatev, Aggregation of multiple classification decisions by fuzzy templates, Proceedings of the Third European Congress on Intelligent Technologies and Soft Computing EUFIT’95, Aachen, Germany, August 1995, pp. 1470–1474.