Robert A. Jacobs1, Michael I. Jordan1, Steven J. Nowlan2, Geoffrey E. Hinton2
1Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
2Department of Computer Science, University of Toronto, Toronto, Canada M5S 1A4
Tóm tắt
We present a new supervised learning procedure for systems composed of many separate networks, each of which learns to handle a subset of the complete set of training cases. The new procedure can be viewed either as a modular version of a multilayer supervised network, or as an associative version of competitive learning. It therefore provides a new link between these two apparently different approaches. We demonstrate that the learning procedure divides up a vowel discrimination task into appropriate subtasks, each of which can be solved by a very simple expert network.
Từ khóa
Tài liệu tham khảo
Barto A. G., 1985, Human Neurobiol., 4, 229
10.1162/neco.1989.1.2.281
Nowlan S. J., 1990, Advances in Neural Informution Processing System 2, D. S. Touretzky, ed., 574