An integration of rule induction and exemplar-based learning for graded concepts
Tóm tắt
This paper presents a method for learninggraded concepts. Our method uses a hybrid concept representation that integrates numeric weights and thresholds with rules and combines rules with exemplars. Concepts are learned by constructing general descriptions to represent common cases. These general descriptions are in the form of decision rules with weights on conditions, interpreted by a similarity measure and numeric thresholds. The exceptional cases are represented as exemplars. This method was implemented in the Flexible Concept Learning System (FCLS) and tested on a variety of problems. The testing problems included practical concepts, concepts with graded structures, and concepts that can be defined in the classic view. For comparison, a decision tree learning system, an instance-based learning system, and the basic rule learning variant of FCLS were tested on the same problems. The results have shown a statistically meaningful advantage of the proposed method over others both in terms of classification accuracy and description simplicity on several problems.
Tài liệu tham khảo
Aha, D. (1995).An implementation and experiment with the nested generalized exemplars algorithm, Technical Report AIC-95-003, Naval Research Laboratory, Navy Center for Applied Research in Artificial Intelligence.
Aha, D., Kibler, D., & Albert, M. (1991). Instance-based learning algorithm,Machine Learning 6:37–66.
Bareiss, E.R. (1989).An exemplar-based knowledge acquisition, Academic Press.
Barsalou, L. (1985). Ideals, central tendency, and frequency of instantiation as determinants of graded structure in categories,Journal of Experimental Psychology: Learning, Memory and Cognition 11:629–654.
Bergadano, F., Matwin, S., Michalski, R.S., & Zhang, J. (1992). Learning two-tiered descriptions of flexible concepts,Machine Learning 8:5–43.
Clark, P., & Niblett, T. (1989). The CN2 induction algorithm,Machine Learning 3:261–283.
Lebowitz, M. (1987). Experiments with incremental concept formation: UNIMEN,Machine Learning Journal 2:103–138.
Michalski, R.S. (1983). A theory and methodology of inductive learning, in R.S. Michalski, J.G. Carbonell, & T.M. Mitchell (Eds.),Machine Learning: An Artificial Intelligence Approach San Mateo, CA: Morgan Kaufmann.
Michalski, R.S. (1987). How to learn imprecise concepts: a method employing a two-tiered representation for learning,Proceedings of the Fourth International Workshop on Machine Learning (pp. 50–58), Irvine, CA.
Michalski, R.S. (1990). Learning flexible concepts: fundamental ideas and a method Bases on two-tiered representation, in Y. Kodratoff, & R.S. Michalski (Eds.),Machine Learning: An Artificial Intelligence Approach. San Mateo, CA: Morgan Kaufmann.
Michalski, R.S., Mozetic, I., Hong, J., & Lavrac, N. (1986). The multi-purpose incremental learning system AQ15 and its testing application to three medical domains,Proceedings of the Fifth National Conference on Artificial Intelligence (pp. 1041–1045).
Murphy, P.M., & Pazzani, M.J. (1991). ID2-of-3: Constructive Induction ofM-of-N Concepts for Discriminators in Decision Trees,Proceedings of the Eighth International Workshop on Machine Learning (pp. 183–187).
Pagallo, G., & Haussler, D. (1988).Feature discovery in empirical learning Technical Report UCSC-CRL-88-08, University of California at Santa Cruz, Santa Cruz, CA.
Quinlan, J.R. (1986). Induction of decision trees,Machine Learning 1:81–106.
Quinlan, J.R. (1987). Simplifying decision trees,International Journal of Man-Machine Studies 27:221–234.
Quinlan, J.R. (1993).C4.5 Programs for Machine Learning San Mateo, CA: Morgan Kaufmann.
Rosch, E.H., & Mervis, C.B. (1975). Family resemblances: studies in the internal structure of categories.Cognitive Psychology 7:573–605.
Salzberg, S. (1991). A nearest hyperrectangle learning method,Machine Learning 6:251–276.
Schlimmer, J.C. (1987).Concept acquisition through representational adjustment Ph.D. thesis, Department of Information and Computer Science, University of California, Irvine.
Smith, E.E., & Medin, D.L. (1981).Categories and Concepts, Harvard University Press.
Utgoff, P.E. (1989). Incremental Induction of Decision Trees, Machine Learning, 4:161–186.
Zhang, J. (1990).Learning flexible concepts from examples: employing the ideas of two-tiered concept representation, Ph.D. Thesis, Department of Computer Science, University of Illinois at Urbana-Champaign.
Zhang, J. (1991). Learning flexible concepts with integrating symbolic and subsymbolic approaches,Proceedings of International Workshop on Multistrategy Learning (pp. 289–304), George Mason University.
Zhang, J. (1992). Selecting Typical Instances in Instance-Based Learning,Proceedings of the Ninth International Conference on Machine Learning (pp. 470–479), Aberdeen Scotland, Morgan Kaufmann.