Avoiding catastrophic forgetting by coupling two reverberating neural networks

Bernard Ans1, Stéphane Rousset1
1Laboratoire de psychologie expérimentale (CNRS EP 617), université Pierre-Mendes-France, BP 47, 38040 Grenoble cedex 9, France

Tài liệu tham khảo

Rumelhart, 1986, Learning internal representations by error propagation, Vol I, 318 McCloskey, 1989, Catastrophic interference in connectionist networks: the sequential learning problem, Vol 24, 109 Ratcliff, 1990, Connectionist models of recognition memory: constraints imposed by learning and forgetting functions, Psychol. Rev., 97, 285, 10.1037/0033-295X.97.2.285 Kortge, 1990, Episodic memory in connectionist networks, 764 French, 1992, Semi-distributed representations and catastrophic forgetting in connectionist networks, Connection Sci., 4, 365, 10.1080/09540099208946624 French, 1994, Dynamically constraining connectionist networks to produce distributed, orthogonal representations to reduce catastrophic interference, 335 Murre, 1992, The effects of pattern presentation on interference in backpropagation networks, 54 McRae, 1993, Catastrophic interference is eliminated in pretrained networks, 723 Lewandowsky, 1994, On the relation between catastrophic interference and generalization in connectionist networks, J. Biol. Systems, 2, 307, 10.1142/S0218339094000192 Lewandowsky, 1995, Catastrophic interference in neural networks. Causes, solutions, and data, 329 McClelland, 1995, Why there are complementary learning systems in the hippocampus and neocortex: insights from the sucesses and failures of connectionist models of learning and memory,, Psychol. Rev., 102, 419, 10.1037/0033-295X.102.3.419 Robins, 1995, Catastrophic forgetting, rehearsal and pseudo-rehearsal, Connection Sci., 7, 123, 10.1080/09540099550039318 Sharkey, 1995, An analysis of catastrophic interference, Connection Sci., 7, 301, 10.1080/09540099550039264 Grossberg, 1987, Competitive learning: from interactive activation to adaptive resonance, Cognitive Sci., 11, 23, 10.1111/j.1551-6708.1987.tb00862.x Hinton, 1989, Connectionist learning procedures, Artificial Intelligence, 40, 185, 10.1016/0004-3702(89)90049-0 Plaut, 1996, Understanding normal and impaired word reading: computational principles in quasi-regular domains, Psychol. Rev., 103, 56, 10.1037/0033-295X.103.1.56 Wang, 1989, Connectionist modelling of a cognitive model of face identification. Simulation of context effects, Vol II, 549 Jordan, 1986, Serial order: A parallel distributed processing approach Elman, 1990, Finding structure in time, Cognitive Sci., 14, 179, 10.1207/s15516709cog1402_1 Ans, 1994, A neural network model for temporal sequence learning and motor programming, Neural Networks, 7, 1461, 10.1016/0893-6080(94)90092-2