Extremely Dilute Modular Neuronal Networks: Neocortical Memory Retrieval Dynamics
Tóm tắt
A model of columnar networks of neocortical association areas is studied. The neuronal network is composed of many Hebbian autoassociators, or modules, each of which interacts with a relatively small number of the others, randomly chosen. Any module encodes and stores a number of elementary percepts, or features. Memory items, or patterns, are peculiar combinations of features sparsely distributed over the multi-modular network. Any feature stored in any module can be involved in several of the stored patterns; feature-sharing is in fact source of local ambiguities and, consequently, a potential cause of erroneous memory retrieval spreading through the model network in pattern completion tasks. The memory retrieval dynamics of the large modular autoassociator is investigated by combining mathematical analysis and numerical simulations. An oscillatory retrieval process is proposed that is very efficient in overcoming feature-sharing drawbacks; it requires a mechanism that modulates the robustness of local attractors to noise, and neuronal activity sparseness such that quiescent and active modules are about equally noisy to any post-synaptic module. Moreover, it is shown that statistical correlation between ‘kinds’ of features across the set of memory patterns can be exploited to obtain a more efficient achievement of memory retrieval capabilities. It is also shown that some spots of the network cannot be reached by retrieval activity spread if they are not directly cued by the stimulus. The locations of these activity isles depend on the pattern to retrieve, while their extension only depends (in large networks) on statistics of inter-modular connections and stored patterns. The existence of activity isles determines an upper-bound to retrieval quality that does not depend on the specific retrieval dynamics adopted, nor on whether feature-sharing is permitted. The oscillatory retrieval process nearly saturates this bound.
Từ khóa
Tài liệu tham khảo
Bollobás B (1985) Random Graphs. Academic Press, London.
Braitenberg V (1978) Cortical architectonics: General and areal. In: Brazier M, Petsche H, eds. Architectonics of the Cerebral Cortex, Raven Press, New York, pp. 443-465.
BraitenbergV, Schüz A (1991) Anatomy of the Cortex: Statistics and Geometry. Springer-Verlag, Berlin Heidelberg.
Brown AS (1991) A review of the tip-of-the-tongue experience. Psychol. Bull. 109: 204-223.
Crick F, Mitchison G (1983) The function of dream sleep. Nature 304: 111-114.
Crick F, Mitchison G (1995) REM sleep and neural nets. Behav. Brain. Res. 69: 147-155.
Derrida B, Gardner E, Zippelius A (1987) An exactly solvable asymmetric neural network model. Europhys. Lett. 4: 167.
Durstewitz D, Seamans JK, Sejnowski TJ (2000) Dopaminemediated stabilization of delay-period activity in a network model of prefrontal cortex. J. Neurophysiol. 83: 1733-1750.
Erdös P, Rényi A (1960) On the evolution of random graphs. Publ. Math. Inst. Hung. Acad. Sci. 5: 17-61.
Friedman HR, Goldman-Rakic PS (1994) Coactivation of prefrontal cortex and inferior parietal cortex in working memory tasks revealed by 2DG functional mapping in the rhesus monkey. J. Neurosci. 14: 2775-2788.
Fujita I, Tanaka K, Ito M, Cheng K (1992) Columns for visual features of objects in monkey inferotemporal cortex. Nature 360: 343-346.
Fulvi Mari C (2000) Random fields and probability distributions with given marginals on randomly correlated systems: A general method and a problem from theoretical neuroscience. J. Phys. A: Math. Gen. 33: 23-38.
Fulvi Mari C, Treves A (1998) Modeling neocortical areas with a modular neural network. Biosystems 48: 47-55.
Funahashi S, Bruce CJ, Goldman-Rakic PS (1989) Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J. Neurophysiol. 61: 331-349.
Fuster JM (1997) Network memory. Trends in Neuroscience 20: 451-459.
Fuster JM (1998) Distributed memory for both short and long term. Neurobiol. Learn. Mem. 70: 268-274.
Fuster JM (1999) Memory in the Cerebral Cortex: An Empirical Approach to Neural Networks in the Human and Nonhuman Primate. M.I.T. Press, Cambridge MA.
Fuster JM, Jervey JP (1982) Neuronal firing in the inferotemporal cortex of the monkey in a visual memory task. J. Neurosci. 2: 361-375.
Goldman-Rakic PS (1988) Changing concepts of cortical connectivity: Parallel distributed cortical networks. In: Rakic P, Singer W, eds. Neurobiology of Neocortex. John Wiley, pp. 177-202.
Hasegawa I, Fukushima T, Ihara T, Miyashita Y (1998) Callosal window between prefrontal cortices: Cognitive interaction to retrieve long-term memory. Science 281: 814-818.
Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc. Nat. Acad. Sci. USA 79: 2554-2558.
Hopfield JJ, Feinstein DI, Palmer RG (1983)'Unlearning' has a stabilizing effect in collective memories. Nature 304: 158-159.
Ishai A, Ungerleider LG, Martin A, Schouten JL, Haxby JV (1999) Distributed representation of objects in the human ventral visual pathway. Proc. Natl. Acad. Sci. USA 96: 9379-9384.
Kaas JH (1987) The organization of neocortex in mammals: Implications for theories of brain function. Ann. Rev. Psychol. 38: 129-151.
Koriat A (1993) How do we know that we know-the accessibility model of the feeling of knowing. Psychol. Review 100: 609-639.
Lauro-Grotto R, Reich S, Virasoro MA (1997) The computational role of conscious processing in a model of semantic memory. In: Ito M, Miyashita Y, Rolls ET, eds. Cognition, Computation and Consciousness. Oxford University Press, Oxford, UK.
Little WA (1974) The existence of persistent states in the brain. Math. Biosci. 19: 101-120.
Martin A, Chao LL (2001) Semantic memory and the brain: Structure and processes. Curr. Opin. Neurob. 11: 194-201.
Miyashita Y (1988) Neuronal correlate of visual associative longterm memory in the primate temporal cortex. Nature 335: 817-820.
Miyashita Y, Chang HS (1988) Neuronal correlate of pictorial shortterm memory in the primate temporal cortex. Nature 331: 68-70.
Mountcastle VB (1977) An organizing principle for cerebral function: The unit module and the distributed system. In: Schmitt F, Worden F, eds. The Neurosciences: Fourth Study Program. Addison Wesley, pp. 21-42.
Mountcastle VB (1995) The parietal system and some higher brain functions. Cerebral Cortex 5: 377-390.
Mountcastle VB (1997) The columnar organization of the neocortex. Brain 120: 701-722.
Mountcastle VB, Lynch JC, Georgopoulos A, Sakata H, Acuna C (1975) Posterior parietal association cortex of the monkey: Command functions for operations within extrapersonal space. J. Neurophysiol. 38: 871-908.
Naya Y, Yoshida M, Miyashita Y (2001) Backward spreading of memory-retrieval signal in the primate temporal cortex. Science 291: 661-664.
O'Kane D, and Treves A (1992) Short-and long-range connections in autoassociative memory. J. Phys. A: Math. Gen. 25: 5055-5069.
Renart A, Parga N, Rolls ET (1999a) Associative memory properties of multiple cortical modules. Network: Comput. Neural Syst. 10: 237-255.
Renart A, Parga N, Rolls ET (1999b) Backward projections in the cerebral cortex: Implication for memory storage. Neural Comp. 11: 1349-1388.
Romanski LM, Tian B, Fritz J, Mishkin M, Goldman-Rakic PS, Rauschecker JP (1999) Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex. Nature Neuroscience 2: 1131-1136.
Selemon LD, Goldman-Rakic PS (1988) Common cortical and subcortical targets of the dorsolateral prefrontal and posterior parietal cortices in the rhesus monkey: Evidence for a distributed neural network subserving spatially guided behavior. J. Neurosci. 8: 4049-4068.
Shallice T (1988) From Neuropsychology to Mental Structure. Cambridge University Press, New York.
Tanaka K (1996) Representation of visual features of objects in the inferotemporal cortex. Neural Networks 9: 1459-1475.
Tomita H, Ohbayashi M, Nakahara K, Hasegawa I, Miyashita Y (1999) Top-downsignal from prefrontal cortex in executive control of memory retrieval. Nature 401: 699-703.
Tsodyks MV, Feigel'man MV (1988) The enhanced storage capacity in neural networks with low activity level. Europhys. Lett. 6: 101-105.
Warrington E, Shallice T (1979) Semantic access dyslexia. Brain 102: 43-63.