Encoding certainty in bump attractors
Tóm tắt
Persistent activity in neuronal populations has been shown to represent the spatial position of remembered stimuli. Networks that support bump attractors are often used to model such persistent activity. Such models usually exhibit translational symmetry. Thus activity bumps are neutrally stable, and perturbations in position do not decay away. We extend previous work on bump attractors by constructing model networks capable of encoding the certainty or salience of a stimulus stored in memory. Such networks support bumps that are not only neutrally stable to perturbations in position, but also perturbations in amplitude. Possible bump solutions then lie on a two-dimensional attractor, determined by a continuum of positions and amplitudes. Such an attractor requires precisely balancing the strength of recurrent synaptic connections. The amplitude of activity bumps represents certainty, and is determined by the initial input to the system. Moreover, bumps with larger amplitudes are more robust to noise, and over time provide a more faithful representation of the stored stimulus. In networks with separate excitatory and inhibitory populations, generating bumps with a continuum of possible amplitudes, requires tuning the strength of inhibition to precisely cancel background excitation.
Tài liệu tham khảo
Amari, S. (1977) Dynamics of pattern formation in lateral-inhibition type neural fields. Biological Cybernetics, 27(2), 77–87.
Armero, J., Casademunt J., Ramirez-Piscina, L., Sancho, J.M. (1998) Ballistic and diffusive corrections to front propagation in the presence of multiplicative noise. Physical Review E, 58, 5494–5500.
Basso, M.A., Wurtz, R.H. (1997) Modulation of neuronal activity by target uncertainty. Nature, 389(6646), 66–69.
Beck, J.M., Ma, W.J., Kiani, R., Hanks, T., Churchland, A.K., Roitman, J., Shadlen, M.N., Latham, P.E., Pouget, A. (2008) Probabilistic population codes for bayesian decision making. Neuron, 60(6), 1142–1152.
Ben-Yishai, R., Bar-Or, R.L., Sompolinsky, H. (1995) Theory of orientation tuning in visual cortex. Proceedings of the National Academy of Sciences of the United States of America, 92(9), 3844–3848.
Bogacz, R., Brown, E., Moehlis, J., Holmes, P., Cohen, J.D. (2006) The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychological Review, 113(4), 700–765.
Bressloff, P.C. (2001) Traveling fronts and wave propagation failure in an inhomogeneous neural network. Physica D, 155(1–2), 83–100.
Bressloff, P.C. (2009) Stochastic neural field theory and the system-size expansion. SIAM Journal of Applied Mathematics, 70(5), 1488–1521.
Bressloff, P.C. (2012) Spatiotemporal dynamics of continuum neural fields. Journal of Physics A: Mathematical and Theoretical, 45(3), 033,001.
Bressloff, P.C., Webber, M.A. (2012) Front propagation in stochastic neural fields. SIAM Journal on Applied Dynamical Systems, 11(2), 708–740.
Brody, C.D., Romo, R., Kepecs, A. (2003) Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamic representations. Current Opinion in Neurobiology, 13(2), 204–211.
Brunel, N., Wang, X.J. (2003) What determines the frequency of fast network oscillations with irregular neural discharges? I. synaptic dynamics and excitation-inhibition balance. Journal of Neurophysiology, 90(1), 415–430.
Camperi, M., Wang, X.J. (1998) A model of visuospatial working memory in prefrontal cortex: recurrent network and cellular bistability. Journal of Computational Neuroscience, 5(4), 383–405.
Churchland, A.K., Kiani, R., Shadlen, M.N. (2008) Decision-making with multiple alternatives. Nature Neuroscience, 11(6), 693–702.
Compte, A., Brunel, N., Goldman-Rakic, P.S., Wang, X.J. (2000) Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. Cerebral Cortex, 10(9), 910–923.
Constantinidis, C., Wang, X.J. (2004) A neural circuit basis for spatial working memory. Neuroscientist, 10(6), 553–565.
Coombes, S., Owen, M.R. (2004) Evans functions for integral neural field equations with heaviside firing rate function. SIAM Journal on Applied Dynamical Systems, 3(4), 574–600.
Curtis, C.E. (2006) Prefrontal and parietal contributions to spatial working memory. Neuroscience, 139(1), 173–180.
Durstewitz, D., Seamans, J.K., Sejnowski, T.J. (2000) Neurocomputational models of working memory. Nature Neuroscience, 3 Supplement, 1184–1191.
El Boustani, S., Destexhe, A. (2009) A master equation formalism for macroscopic modeling of asynchronous irregular activity states. Neural Computation, 21(1), 46–100.
Ermentrout, B. (1998) Neural networks as spatio-temporal pattern-forming systems. Reports on Progress in Physics, 61(4), 353.
Faisal, A., Selen, L., Wolpert, D. (2008) Noise in the nervous system. Nature Reviews Neuroscience, 9(4), 292–303.
Folias, S.E., Bressloff, P.C. (2004) Breathing pulses in an excitatory neural network. SIAM Journal on Applied Dynamical Systems, 3(3), 378–407.
Funahashi, S., Bruce, C.J., Goldman-Rakic, P.S. (1989) Mnemonic coding of visual space in the monkey’s dorsolateral prefrontal cortex. Journal of Neurophysiology, 61(2), 331–349.
Ginzburg, I., Sompolinsky. (1994) Theory of correlations in stochastic neural networks. Physical Review E, 50(4), 3171–3191.
Gold, J.I., Shadlen, M.N. (2002) Banburismus and the brain: decoding the relationship between sensory stimuli, decisions, and reward. Neuron, 36(2), 299–308.
Goldman, M.S., Levine, J.H., Major, G., Tank, D.W., Seung, H.S. (2003) Robust persistent neural activity in a model integrator with multiple hysteretic dendrites per neuron. Cerebral Cortex, 13(11), 1185–1195.
Goldman-Rakic, P.S. (1995) Cellular basis of working memory. Neuron, 14(3), 477–485.
Gutkin, B., Laing, C., Colby, C., Chow, C., Ermentrout, G. (2001) Turning on and off with excitation: The role of spike-timing asynchrony and synchrony in sustained neural activity. Journal of Computational Neuroscience, 11(2), 121–134.
Haider, B., Duque, A., Hasenstaub, A.R., McCormick, D.A. (2006) Neocortical network activity in vivo is generated through a dynamic balance of excitation and inhibition. Journal of Neuroscience, 26(17), 4535–4545.
Hansel, D., Mato, G. (2013) Short-term plasticity explains irregular persistent activity in working memory tasks. Journal of Neuroscience, 33(1), 133–149.
Hansel, D., Sompolinsky, H. (1998) Modeling feature selectivity in local cortical circuits. In C. Koch, & I. Segev (Eds.) Methods in neuronal modeling: From ions to networks (pp. 499–567). Cambridge: MIT, chap 13.
Hansel, D., van Vreeswijk, C. (2012) The mechanism of orientation selectivity in primary visual cortex without a functional map. Journal of Neuroscience, 32(12), 4049–4064. doi: 10.1523/JNEUROSCI.6284-11.2012.
Hutt, A., Longtin, A., Schimansky-Geier, L. (2008) Additive noise-induced turing transitions in spatial systems with application to neural fields and the swift–hohenberg equation. Physica D, 237(6), 755–773.
Itskov, V., Hansel, D., Tsodyks, M. (2011) Short-term facilitation may stabilize parametric working memory trace. Frontiers in Computational Neuroscience, 5, 40.
Kiani, R., Shadlen, M.N. (2009) Representation of confidence associated with a decision by neurons in the parietal cortex. Science, 324(5928), 759–764.
Kilpatrick, Z.P., Bressloff, P.C. (2010) Effects of adaptation and synaptic depression on spatiotemporal dynamics of an excitatory neuronal network. Physica D, 239, 547–560.
Kilpatrick, Z.P., Ermentrout, B, (2013) Wandering bumps in stochastic neural fields. SIAM Journal on Applied Dynamical Systems, 12, 61–94.
Kilpatrick, Z.P., Ermentrout, B. Doiron, B. (2013) Optimizing working memory with heterogeneity of recurrent cortical excitation. Journal of Neuroscience, in press.
Laing, C.R., Chow, C.C. (2001) Stationary bumps in networks of spiking neurons. Neural Computation, 13(7), 1473–1494.
Machens, C., Romo, R., Brody, C. (2005) Flexible control of mutual inhibition: a neural model of two-interval discrimination. Science, 307(5712), 1121–1124.
Meyer, T., Qi, X.L., Stanford, T.R., Constantinidis, C. (2011) Stimulus selectivity in dorsal and ventral prefrontal cortex after training in working memory tasks. Journal of Neuroscience, 31(17), 6266–6276.
Miller, E.K., Erickson, C.A., Desimone, R. (1996) Neural mechanisms of visual working memory in prefrontal cortex of the macaque. Journal of Neuroscience, 16(16), 5154–5167.
Pesaran, B., Pezaris, J.S., Sahani, M., Mitra, P.P., Andersen, R.A. (2002) Temporal structure in neuronal activity during working memory in macaque parietal cortex. Nature Neuroscience, 5(8), 805–811.
Pinto, D.J., Ermentrout, G.B. (2001a) Spatially structured activity in synaptically coupled neuronal networks: I. Traveling fronts and pulses. SIAM Journal of Applied Mathematics, 62(1), 206–225.
Pinto, D.J., Ermentrout, G.B. (2001b) Spatially structured activity in synaptically coupled neuronal networks: Ii. lateral inhibition and standing pulses. SIAM Journal of Applied Mathematics, 62(1), 226–243.
Ploner, C.J., Gaymard, B., Rivaud, S., Agid, Y., Pierrot-Deseilligny, C. (1998) Temporal limits of spatial working memory in humans. European Journal Neuroscience, 10(2), 794–797.
Polk, A., Litwin-Kumar, A., Doiron, B. (2012) Correlated neural variability in persistent state networks. Proceedings of the National Academy of Sciences of the United States of America, 109(16), 6295–6300.
Rao, S.G., Williams, G.V., Goldman-Rakic, P.S. (2000) Destruction and creation of spatial tuning by disinhibition: GABA(A) blockade of prefrontal cortical neurons engaged by working memory. Journal of Neuroscience, 20(1), 485–494.
Renart, A ., Song, P., Wang, X.J. (2003) Robust spatial working memory through homeostatic synaptic scaling in heterogeneous cortical networks. Neuron, 38(3), 473–485.
Renart, A., de la Rocha, J., Bartho, P., Hollender, L., Parga, N., Reyes, A., Harris, K.D. (2010) The asynchronous state in cortical circuits. Science, 327(5965), 587–590. doi:10.1126/science.1179850.
Sandstede, B. (2002) Stability of travelling waves. Handbook of dynamical systems, 2, 983–1055.
Seung, H.S. (1996) How the brain keeps the eyes still. Proceedings of the National Academy of Sciences of the United States of America, 13(23), 13,339–13,344.
Shadlen, M.N., Newsome, W.T. (1998) The variable discharge of cortical neurons: implications for connectivity, computation, and information coding. Journal of Neuroscience, 18(10), 3870– 3896.
Shew, W.L., Yang, H., Petermann, T., Roy, R., Plenz, D. (2009) Neuronal avalanches imply maximum dynamic range in cortical networks at criticality. Journal of Neuroscience, 15(49), 595–600.
Softky, W.R., Koch, C. (1993) The highly irregular firing of cortical cells is inconsistent with temporal integration of random epsps. Journal of Neuroscience, 13(1), 334–350.
Somogyi, P., Tamás, G., Lujan, R., Buhl, E.H. (1998) Salient features of synaptic organisation in the cerebral cortex. Brain Research. Brain Research Reviews, 26(2–3), 113–135.
Veltz, R., Faugeras, O. (2010) Local/global analysis of the stationary solutions of some neural field equations. SIAM Journal on Applied Dynamical Systems, 9, 954–998.
Vijayraghavan, S., Wang, M., Birnbaum, S.G., Williams, G.V., Arnsten, A.F.T. (2007) Inverted-u dopamine d1 receptor actions on prefrontal neurons engaged in working memory. Nature Neuroscience, 10(3), 376–384.
van Vreeswijk, C., Sompolinsky, H. (1996) Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science, 274(5293), 1724–1726.
Wang, X.J. (2001) Synaptic reverberation underlying mnemonic persistent activity. Trends in Neurosciences, 24(8), 455–463.
Wang, X.J. (2002) Probabilistic decision making by slow reverberation in cortical circuits. Neuron, 36(5), 955–968.
White, J.A., Rubinstein, J.T., Kay, A.R. (2000) Channel noise in neurons. Trends in Neurosciences, 23(3), 131–137.
White, J.M., Sparks, D.L., Stanford, T.R. (1994) Saccades to remembered target locations: an analysis of systematic and variable errors. Vision Research, 34(1), 79–92.
Wilson, H.R., Cowan, J.D. (1973) A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Biological Cybernetics, 13(2), 55–80.
Yizhar, O., Fenno, L.E., Prigge, M., Schneider, F., Davidson, T.J., O’Shea, D.J., Sohal, V.S., Goshen, I., Finkelstein, J., Paz, J.T., Stehfest, K., Fudim, R., Ramakrishnan, C., Huguenard, J.R., Hegemann, P., Deisseroth, K. (2011) Neocortical excitation/inhibition balance in information processing and social dysfunction. Nature, 477(7363), 171–178.
Zemel, R.S., Dayan, P., Pouget, A. (1998) Probabilistic interpretation of population codes. Neural Computation, 10(2), 403–430.