Competitive Learning: From Interactive Activation to Adaptive Resonance

Cognitive Science - Tập 11 Số 1 - Trang 23-63 - 1987
Stephen Grossberg1
1Boston University

Tóm tắt

Functional and mechanistic comparisons are made between several network models of cognitive processing: competitive learning, interactive activation, adaptive resonance, and back propagation. The starting point of this comparison is the article of Rumelhart and Zipser (1985) on feature discovery through competitive learning. All the models which Rumelhart and Zipser (1985) have described were shown in Grossberg (1976b) to exhibit a type of learning which is temporally unstable. Competitive learning mechanisms can be stabilized in response to an arbitrary input environment by being supplemented with mechanisms for learning top‐down expectancies, or templates; for matching bottom‐up input patterns with the top‐down expectancies; and for releasing orienting reactions in a mismatch situation, thereby updating short‐term memory and searching for another internal representation. Network architectures which embody all of these mechanisms were called adaptive resonance models by Grossberg (1976c). Self‐stabilizing learning models are candidates for use in real‐world applications where unpredictable changes can occur in complex input environments. Competitive learning postulates are inconsistent with the postulates of the interactive activation model of McClelland and Rumelhart (1981), and suggest different levels of processing and interaction rules for the analysis of word recognition. Adaptive resonance models use these alternative levels and interaction rules. The self‐organizing learning of an adaptive resonance model is compared and contrasted with the teacher‐directed learning of a back propagation model. A number of criteria for evaluating real‐time network models of cognitive processing are described and applied.

Từ khóa


Tài liệu tham khảo

Banquet J.‐P. &Grossberg S.(1987).Probing cognitive processes through the structure of event‐related potentials during learning: An experimental and theoretical analysis.Applied Optics.

10.1523/JNEUROSCI.02-01-00032.1982

Carpenter G.A. &Grossberg S.(1986).Associative learning adaptive pattern recognition and cooperative‐competitive decision making by neural networks. InH.Szu(Ed.)Hybrid and Optical Computing. SPIE Proceedings.

Carpenter G.A. &Grossberg S.(1987a).Neural dynamics of category learning and recognition: Attention memory consolidation and amnesia. InJ.Davis R.Newburgh &E.Wegman(Eds.) Brain structure learning and memory. AAAS Symposium Series.

10.1016/S0734-189X(87)80014-2

Carpenter G.A. &Grossberg S.(1987c).Neural dynamics of category learning and recognition: Structural invariants reinforcement and evoked potentials. InM.L.Commons S.M.Kosslyn &R.J.Herrnstein(Eds.) Pattern recognition and concepts in animals people and machines.

Cohen M.A., 1986, Neural dynamics of speech and language coding: Developmental programs, perceptual grouping, and competition for short term memory, Human Neurobiology, 5, 1

Cohen M.A. &Grossberg S.(1987).Masking fields: A massively parallel neural architecture for learning recognizing and predicting multiple groupings of patterned data.Applied Optics.

10.1037/0096-3445.115.2.155

10.1007/BF01007484

10.1007/BF00288784

10.1016/S0074-7742(08)60037-9

10.1007/BF00337422

10.1007/BF00344744

10.1007/BF00344744

10.1016/B978-0-12-543105-7.50013-0

10.1037/0033-295X.87.1.1

10.1007/978-94-009-7758-7

10.1037/0033-295X.89.5.529

Grossberg S., 1982, Competition and cooperation in neural networks, 263

Grossberg S., 1987, Pattern recognition by humans and machines, Vol. 1: Speech perception

Grossberg S., 1987, The adaptive brain, I: Cognition, learning, reinforcement, and rhythm

Grossberg S., 1987, The adaptive brain, II: Vision, speech, language, and motor control

Grossberg S. &Gutowski W.(1987).Neural dynamics of decision making under risk: Affective balance and cognitive‐emotional interactions.Psychological Review.

Grossberg S. &Levine D.S.(1987).Neural dynamics of attentionally modulated Pavlovian conditioning: Blocking inter‐stimulus interval and secondary reinforcement. Submitted for publication.

10.1037/0033-295X.93.1.46

10.3758/BF03202517

10.1073/pnas.79.8.2554

10.1037/0278-7393.10.4.616

Kohonen T., 1984, Self‐organization and associative memory

10.1007/BF00288907

10.1207/s15516709cog0901_6

McClelland J.L., 1981, An interactive activation model of context effects in letter perception, Part I: An account of basic findings, Psychological Review, 88, 375, 10.1037/0033-295X.88.5.375

10.1037/0096-3445.114.2.159

Posner M.I., 1973, Cognition: An introduction

10.1037/h0025953

10.1037/h0028558

Rosenblatt F., 1962, Principles of neurodynamics

Rumelhart D.E., 1985, Institute for Cognitive Science Report 8506

10.1037/0033-295X.89.1.60

10.1207/s15516709cog0901_5

10.1037/0096-3445.114.1.50

10.1037/0096-1523.8.1.91

10.1037/0096-1523.9.2.321

Sejnowski T.J., 1986, NETtalk: A parallel‐network that learns to read aloud

10.1016/0010-0285(70)90005-8

Widrow B., 1962, Self‐organizing systems

Thông tin
Thông tin xuất bản

Cognitive Science

Tập 11 Số 1

23-63

Thông tin tác giả