Adaptive Mixtures of Local Experts

Neural Computation - Tập 3 Số 1 - Trang 79-87 - 1991
Robert A. Jacobs1, Michael I. Jordan1, Steven J. Nowlan2, Geoffrey E. Hinton2
1Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
2Department of Computer Science, University of Toronto, Toronto, Canada M5S 1A4

Tóm tắt

We present a new supervised learning procedure for systems composed of many separate networks, each of which learns to handle a subset of the complete set of training cases. The new procedure can be viewed either as a modular version of a multilayer supervised network, or as an associative version of competitive learning. It therefore provides a new link between these two apparently different approaches. We demonstrate that the learning procedure divides up a vowel discrimination task into appropriate subtasks, each of which can be solved by a very simple expert network.

Từ khóa


Tài liệu tham khảo

Barto A. G., 1985, Human Neurobiol., 4, 229

10.1162/neco.1989.1.2.281

Nowlan S. J., 1990, Advances in Neural Informution Processing System 2, D. S. Touretzky, ed., 574