Canonical Microcircuits for Predictive Coding

Alink, 2010, Stimulus predictability reduces responses in primary visual cortex, J. Neurosci., 30, 2960, 10.1523/JNEUROSCI.3730-10.2010 Alitto, 2008, Origin and dynamics of extraclassical suppression in the lateral geniculate nucleus of the macaque monkey, Neuron, 57, 135, 10.1016/j.neuron.2007.11.019 Alonso, 2002, Neural connections and receptive field properties in the primary visual cortex, Neuroscientist, 8, 443, 10.1177/107385802236967 Alonso, 1998, Functional connectivity between simple cells and complex cells in cat striate cortex, Nat. Neurosci., 1, 395, 10.1038/1609 Anderson, 2006, Synaptic connection from cortical area V4 to V2 in macaque monkey, J. Comp. Neurol., 495, 709, 10.1002/cne.20914 Anderson, 2011, Pathways of attention: synaptic relationships of frontal eye field to V4, lateral intraparietal cortex, and area 46 in macaque monkey, J. Neurosci., 31, 10872, 10.1523/JNEUROSCI.0622-11.2011 Armstrong, 2012, Attention and action in the frontal eye field, 151 Arnal, 2011, Transitions in neural oscillations reflect prediction errors generated in audiovisual speech, Nat. Neurosci., 14, 797, 10.1038/nn.2810 Atick, 2011, Could information theory provide an ecological theory of sensory processing?, Network, 22, 4, 10.3109/0954898X.2011.638888 Attneave, 1954, Some informational aspects of visual perception, Psychol. Rev., 61, 183, 10.1037/h0054663 Bair, 2003, Time course and time-distance relationships for surround suppression in macaque V1 neurons, J. Neurosci., 23, 7690, 10.1523/JNEUROSCI.23-20-07690.2003 Barceló, 2000, Prefrontal modulation of visual processing in humans, Nat. Neurosci., 3, 399, 10.1038/73975 Barlow, 1961, Possible principles underlying the transformations of sensory messages, 217 Barone, 2000, Laminar distribution of neurons in extrastriate areas projecting to visual areas V1 and V4 correlates with the hierarchical rank and indicates the operation of a distance rule, J. Neurosci., 20, 3263, 10.1523/JNEUROSCI.20-09-03263.2000 Berkes, 2011, Spontaneous cortical activity reveals hallmarks of an optimal internal model of the environment, Science, 331, 83, 10.1126/science.1195870 Bollimunta, 2011, Neuronal mechanisms and attentional modulation of corticothalamic α oscillations, J. Neurosci., 31, 4935, 10.1523/JNEUROSCI.5580-10.2011 Bosman, 2012, Attentional stimulus selection through selective synchronization between monkey visual areas, Neuron, 75, 875, 10.1016/j.neuron.2012.06.037 Briggs, 2005, Laminar patterns of local excitatory input to layer 5 neurons in macaque primary visual cortex, Cereb. Cortex, 15, 479, 10.1093/cercor/bhh154 Briggs, 2009, Parallel processing in the corticogeniculate pathway of the macaque monkey, Neuron, 62, 135, 10.1016/j.neuron.2009.02.024 Buchsbaum, 1983, Trichromacy, opponent colours coding and optimum colour information transmission in the retina, Proc. R. Soc. Lond. B Biol. Sci., 220, 89, 10.1098/rspb.1983.0090 Buffalo, 2011, Laminar differences in gamma and alpha coherence in the ventral stream, Proc. Natl. Acad. Sci. USA, 108, 11262, 10.1073/pnas.1011284108 Bullier, 1980, Ordinal position and afferent input of neurons in monkey striate cortex, J. Comp. Neurol., 193, 913, 10.1002/cne.901930407 Bullier, 1996, Functional interactions between areas V1 and V2 in the monkey, J. Physiol. Paris, 90, 217, 10.1016/S0928-4257(97)81426-X Buschman, 2007, Top-down versus bottom-up control of attention in the prefrontal and posterior parietal cortices, Science, 315, 1860, 10.1126/science.1138071 Buzsáki, 2010, Neural syntax: cell assemblies, synapsembles, and readers, Neuron, 68, 362, 10.1016/j.neuron.2010.09.023 Callaway, 1998, Local circuits in primary visual cortex of the macaque monkey, Annu. Rev. Neurosci., 21, 47, 10.1146/annurev.neuro.21.1.47 Callaway, 1996, Contributions of individual layer 2-5 spiny neurons to local circuits in macaque primary visual cortex, Vis. Neurosci., 13, 907, 10.1017/S0952523800009159 Canolty, 2010, Oscillatory phase coupling coordinates anatomically dispersed functional cell assemblies, Proc. Natl. Acad. Sci. USA, 107, 17356, 10.1073/pnas.1008306107 Chu, 2003, Synaptic interactions of late-spiking neocortical neurons in layer 1, J. Neurosci., 23, 96, 10.1523/JNEUROSCI.23-01-00096.2003 Covic, 2011, Synaptic properties of connections between the primary and secondary auditory cortices in mice, Cereb. Cortex, 21, 2425, 10.1093/cercor/bhr029 Crick, 1984, Function of the thalamic reticular complex: the searchlight hypothesis, Proc. Natl. Acad. Sci. USA, 81, 4586, 10.1073/pnas.81.14.4586 Crick, 1998, Constraints on cortical and thalamic projections: the no-strong-loops hypothesis, Nature, 391, 245, 10.1038/34584 Dan, 1996, Efficient coding of natural scenes in the lateral geniculate nucleus: experimental test of a computational theory, J. Neurosci., 16, 3351, 10.1523/JNEUROSCI.16-10-03351.1996 David, 2006, Dynamic causal modeling of evoked responses in EEG and MEG, Neuroimage, 30, 1255, 10.1016/j.neuroimage.2005.10.045 Dayan, 1995, The Helmholtz machine, Neural Comput., 7, 889, 10.1162/neco.1995.7.5.889 de Kock, 2007, Layer- and cell-type-specific suprathreshold stimulus representation in rat primary somatosensory cortex, J. Physiol., 581, 139, 10.1113/jphysiol.2006.124321 de No, 1949, Cerebral cortex: architecture, intracortical connections, motor projections, 288 De Pasquale, 2011, Synaptic properties of corticocortical connections between the primary and secondary visual cortical areas in the mouse, J. Neurosci., 31, 16494, 10.1523/JNEUROSCI.3664-11.2011 Desimone, 1996, Neural mechanisms for visual memory and their role in attention, Proc. Natl. Acad. Sci. USA, 93, 13494, 10.1073/pnas.93.24.13494 Douglas, 1991, A functional microcircuit for cat visual cortex, J. Physiol., 440, 735, 10.1113/jphysiol.1991.sp018733 Douglas, 2004, Neuronal circuits of the neocortex, Annu. Rev. Neurosci., 27, 419, 10.1146/annurev.neuro.27.070203.144152 Douglas, 1989, A canonical microcircuit for neocortex, Neural Comput., 1, 480, 10.1162/neco.1989.1.4.480 Engbert, 2011, PNAS Plus: An integrated model of fixational eye movements and microsaccades, Proc. Natl. Acad. Sci. USA, 108, E765, 10.1073/pnas.1102730108 Engel, 2010, Coordination in behavior and cognition, 267 Feldman, 2010, Attention, uncertainty, and free-energy, Front Hum Neurosci, 4, 215, 10.3389/fnhum.2010.00215 Felleman, 1991, Distributed hierarchical processing in the primate cerebral cortex, Cereb. Cortex, 1, 1, 10.1093/cercor/1.1.1 Fitzpatrick, 1994, The sublaminar organization of corticogeniculate neurons in layer 6 of macaque striate cortex, Vis. Neurosci., 11, 307, 10.1017/S0952523800001656 Fries, 2005, A mechanism for cognitive dynamics: neuronal communication through neuronal coherence, Trends Cogn. Sci., 9, 474, 10.1016/j.tics.2005.08.011 Fries, 2001, Modulation of oscillatory neuronal synchronization by selective visual attention, Science, 291, 1560, 10.1126/science.1055465 Friston, 2008, Hierarchical models in the brain, PLoS Comput. Biol., 4, e1000211, 10.1371/journal.pcbi.1000211 Friston, 2010, The free-energy principle: a unified brain theory?, Nat. Rev. Neurosci., 11, 127, 10.1038/nrn2787 Fujisawa, 2011, A 4 Hz oscillation adaptively synchronizes prefrontal, VTA, and hippocampal activities, Neuron, 72, 153, 10.1016/j.neuron.2011.08.018 Garrido, 2007, Evoked brain responses are generated by feedback loops, Proc. Natl. Acad. Sci. USA, 104, 20961, 10.1073/pnas.0706274105 Garrido, 2009, The mismatch negativity: a review of underlying mechanisms, Clin. Neurophysiol., 120, 453, 10.1016/j.clinph.2008.11.029 Gentet, 2012, Unique functional properties of somatostatin-expressing GABAergic neurons in mouse barrel cortex, Nat. Neurosci., 15, 607, 10.1038/nn.3051 George, 2009, Towards a mathematical theory of cortical micro-circuits, PLoS Comput. Biol., 5, e1000532, 10.1371/journal.pcbi.1000532 Gilbert, 1983, Functional organization of the visual cortex, Prog. Brain Res., 58, 209, 10.1016/S0079-6123(08)60022-9 Girard, 1989, Visual activity in area V2 during reversible inactivation of area 17 in the macaque monkey, J. Neurophysiol., 62, 1287, 10.1152/jn.1989.62.6.1287 Girard, 1991, Visual activity in areas V3a and V3 during reversible inactivation of area V1 in the macaque monkey, J. Neurophysiol., 66, 1493, 10.1152/jn.1991.66.5.1493 Girard, 1991, Visual activity in macaque area V4 depends on area 17 input, Neuroreport, 2, 81, 10.1097/00001756-199102000-00004 Girard, 1992, Response selectivity of neurons in area MT of the macaque monkey during reversible inactivation of area V1, J. Neurophysiol., 67, 1437, 10.1152/jn.1992.67.6.1437 Gray, 1989, Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties, Nature, 338, 334, 10.1038/338334a0 Gregoriou, 2009, High-frequency, long-range coupling between prefrontal and visual cortex during attention, Science, 324, 1207, 10.1126/science.1171402 Gregory, 1968, Perceptual illusions and brain models, Proc. R. Soc. Lond. B Biol. Sci., 171, 279, 10.1098/rspb.1968.0071 Gregory, 1980, Perceptions as hypotheses, Philos. Trans. R. Soc. Lond. B Biol. Sci., 290, 181, 10.1098/rstb.1980.0090 Gwin, 2012, Beta- and gamma-range human lower limb corticomuscular coherence, Front Hum Neurosci, 6, 258, 10.3389/fnhum.2012.00258 Haeusler, 2007, A statistical analysis of information-processing properties of lamina-specific cortical microcircuit models, Cereb. Cortex, 17, 149, 10.1093/cercor/bhj132 Harrison, 2007, Extra-classical receptive field effects measured in striate cortex with fMRI, Neuroimage, 34, 1199, 10.1016/j.neuroimage.2006.10.017 Häusser, 2003, Dendrites: bug or feature?, Curr. Opin. Neurobiol., 13, 372, 10.1016/S0959-4388(03)00075-8 Hebb, 1949 Helmholtz, 1860 Hinton, 1993, Keeping neural networks simple by minimizing the description length of weights, 5 Hinton, 1994, Autoencoders, minimum description length, and helmholtz free energy, 3 Hopfinger, 2000, The neural mechanisms of top-down attentional control, Nat. Neurosci., 3, 284, 10.1038/72999 Horton, 2005, The cortical column: a structure without a function, Philos. Trans. R. Soc. Lond. B Biol. Sci., 360, 837, 10.1098/rstb.2005.1623 Hubel, 1962, Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex, J. Physiol., 160, 106, 10.1113/jphysiol.1962.sp006837 Hubel, 1972, Laminar and columnar distribution of geniculo-cortical fibers in the macaque monkey, J. Comp. Neurol., 146, 421, 10.1002/cne.901460402 Hubel, 1974, Sequence regularity and geometry of orientation columns in the monkey striate cortex, J. Comp. Neurol., 158, 267, 10.1002/cne.901580304 Hupé, 1998, Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons, Nature, 394, 784, 10.1038/29537 Johnson, 1996, Microcircuitry of forward and feedback connections within rat visual cortex, J. Comp. Neurol., 368, 383, 10.1002/(SICI)1096-9861(19960506)368:3<383::AID-CNE5>3.0.CO;2-1 Johnson, 1997, A polysynaptic feedback circuit in rat visual cortex, J. Neurosci., 17, 7129, 10.1523/JNEUROSCI.17-18-07129.1997 Kätzel, 2011, The columnar and laminar organization of inhibitory connections to neocortical excitatory cells, Nat. Neurosci., 14, 100, 10.1038/nn.2687 Kay, 2011, Coherent Infomax as a computational goal for neural systems, Bull. Math. Biol., 73, 344, 10.1007/s11538-010-9564-x Klampfl, 2009, Spiking neurons can learn to solve information bottleneck problems and extract independent components, Neural Comput., 21, 911, 10.1162/neco.2008.01-07-432 Knight, 1984, Decreased response to novel stimuli after prefrontal lesions in man, Electroencephalogr. Clin. Neurophysiol., 59, 9, 10.1016/0168-5597(84)90016-9 Knight, 1989, Prefrontal cortex gating of auditory transmission in humans, Brain Res., 504, 338, 10.1016/0006-8993(89)91381-4 Knill, 2004, The Bayesian brain: the role of uncertainty in neural coding and computation, Trends Neurosci., 27, 712, 10.1016/j.tins.2004.10.007 Kok, 2012, Attention reverses the effect of prediction in silencing sensory signals, Cereb. Cortex, 22, 2197, 10.1093/cercor/bhr310 Lakatos, 2008, Entrainment of neuronal oscillations as a mechanism of attentional selection, Science, 320, 110, 10.1126/science.1154735 Larkum, 2009, Synaptic integration in tuft dendrites of layer 5 pyramidal neurons: a new unifying principle, Science, 325, 756, 10.1126/science.1171958 Lefort, 2009, The excitatory neuronal network of the C2 barrel column in mouse primary somatosensory cortex, Neuron, 61, 301, 10.1016/j.neuron.2008.12.020 Linsker, 1990, Perceptual neural organization: some approaches based on network models and information theory, Annu. Rev. Neurosci., 13, 257, 10.1146/annurev.ne.13.030190.001353 Livingstone, 1996, Oscillatory firing and interneuronal correlations in squirrel monkey striate cortex, J. Neurophysiol., 75, 2467, 10.1152/jn.1996.75.6.2467 London, 2005, Dendritic computation, Annu. Rev. Neurosci., 28, 503, 10.1146/annurev.neuro.28.061604.135703 Lopes-dos-Santos, 2011, Neuronal assembly detection and cell membership specification by principal component analysis, PLoS ONE, 6, e20996, 10.1371/journal.pone.0020996 MacKay, 1956, Automata Studies, 235 Maier, 2010, Distinct superficial and deep laminar domains of activity in the visual cortex during rest and stimulation, Front. Sys. Neurosci., 4, 31 Markov, 2011, Weight consistency specifies regularities of macaque cortical networks, Cereb. Cortex, 21, 1254, 10.1093/cercor/bhq201 Meirovithz, 2012, Spatiotemporal effects of microsaccades on population activity in the visual cortex of monkeys during fixation, Cereb. Cortex, 22, 294, 10.1093/cercor/bhr102 Melzer, 2012, Long-range-projecting GABAergic neurons modulate inhibition in hippocampus and entorhinal cortex, Science, 335, 1506, 10.1126/science.1217139 Meyer, 2011, Statistical learning of visual transitions in monkey inferotemporal cortex, Proc. Natl. Acad. Sci. USA, 108, 19401, 10.1073/pnas.1112895108 Meyer, 2011, Inhibitory interneurons in a cortical column form hot zones of inhibition in layers 2 and 5A, Proc. Natl. Acad. Sci. USA, 108, 16807, 10.1073/pnas.1113648108 Mignard, 1991, Paths of information flow through visual cortex, Science, 251, 1249, 10.1126/science.1848727 Moran, 2008, Bayesian estimation of synaptic physiology from the spectral responses of neural masses, Neuroimage, 42, 272, 10.1016/j.neuroimage.2008.01.025 Moran, 2011, An in vivo assay of synaptic function mediating human cognition, Curr. Biol., 21, 1320, 10.1016/j.cub.2011.06.053 Mountcastle, 1957, Modality and topographic properties of single neurons of cat’s somatic sensory cortex, J. Neurophysiol., 20, 408, 10.1152/jn.1957.20.4.408 Mountcastle, 1997, The columnar organization of the neocortex, Brain, 120, 701, 10.1093/brain/120.4.701 Mumford, 1992, On the computational architecture of the neocortex. II. The role of cortico-cortical loops, Biol. Cybern., 66, 241, 10.1007/BF00198477 Murphy, 1987, Corticofugal feedback influences the generation of length tuning in the visual pathway, Nature, 329, 727, 10.1038/329727a0 Murray, 2002, Shape perception reduces activity in human primary visual cortex, Proc. Natl. Acad. Sci. USA, 99, 15164, 10.1073/pnas.192579399 Murray, 2006, Spatially specific FMRI repetition effects in human visual cortex, J. Neurophysiol., 95, 2439, 10.1152/jn.01236.2005 Neisser, 1967 Olsen, 2012, Gain control by layer six in cortical circuits of vision, Nature, 483, 47, 10.1038/nature10835 Raizada, 2003, Towards a theory of the laminar architecture of cerebral cortex: computational clues from the visual system, Cereb. Cortex, 13, 100, 10.1093/cercor/13.1.100 Rao, 1999, Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects, Nat. Neurosci., 2, 79, 10.1038/4580 Roopun, 2008, Period concatenation underlies interactions between gamma and beta rhythms in neocortex, Front. Cell Neurosci., 2, 1, 10.3389/neuro.03.001.2008 Roopun, 2006, A beta2-frequency (20-30 Hz) oscillation in nonsynaptic networks of somatosensory cortex, Proc. Natl. Acad. Sci. USA, 103, 15646, 10.1073/pnas.0607443103 Saalmann, 2007, Neural mechanisms of visual attention: how top-down feedback highlights relevant locations, Science, 316, 1612, 10.1126/science.1139140 Saalmann, 2012, The pulvinar regulates information transmission between cortical areas based on attention demands, Science, 337, 753, 10.1126/science.1223082 Sakata, 2009, Laminar structure of spontaneous and sensory-evoked population activity in auditory cortex, Neuron, 64, 404, 10.1016/j.neuron.2009.09.020 Salin, 1995, Corticocortical connections in the visual system: structure and function, Physiol. Rev., 75, 107, 10.1152/physrev.1995.75.1.107 Sandell, 1982, Effect of cooling area 18 on striate cortex cells in the squirrel monkey, J. Neurophysiol., 48, 38, 10.1152/jn.1982.48.1.38 Sherman, 1998, On the actions that one nerve cell can have on another: distinguishing “drivers” from “modulators”, Proc. Natl. Acad. Sci. USA, 95, 7121, 10.1073/pnas.95.12.7121 Sherman, 2011, Distinct functions for direct and transthalamic corticocortical connections, J. Neurophysiol., 106, 1068, 10.1152/jn.00429.2011 Shipp, 2007, Structure and function of the cerebral cortex, Curr. Biol., 17, R443, 10.1016/j.cub.2007.03.044 Shlosberg, 2006, Time-dependent, layer-specific modulation of sensory responses mediated by neocortical layer 1, J. Neurophysiol., 96, 3170, 10.1152/jn.00520.2006 Sillito, 1993, Orientation sensitive elements in the corticofugal influence on centre-surround interactions in the dorsal lateral geniculate nucleus, Exp. Brain Res., 93, 6, 10.1007/BF00227775 Sincich, 2005, The circuitry of V1 and V2: integration of color, form, and motion, Annu. Rev. Neurosci., 28, 303, 10.1146/annurev.neuro.28.061604.135731 Singer, 1999, Neuronal synchrony: a versatile code for the definition of relations?, Neuron, 24, 49, 10.1016/S0896-6273(00)80821-1 Singer, 1997, Neuronal assemblies: necessity, signature and detectability, Trends Cogn. Sci., 1, 252, 10.1016/S1364-6613(97)01079-6 Spratling, 2008, Reconciling predictive coding and biased competition models of cortical function, Front. Comput. Neurosci., 2, 4, 10.3389/neuro.10.004.2008 Srinivasan, 1982, Predictive coding: a fresh view of inhibition in the retina, Proc. R. Soc. Lond. B Biol. Sci., 216, 427, 10.1098/rspb.1982.0085 Summerfield, 2008, Neural repetition suppression reflects fulfilled perceptual expectations, Nat. Neurosci., 11, 1004, 10.1038/nn.2163 Summerfield, 2011, Human scalp electroencephalography reveals that repetition suppression varies with expectation, Front Hum Neurosci, 5, 67, 10.3389/fnhum.2011.00067 Theyel, 2010, The corticothalamocortical circuit drives higher-order cortex in the mouse, Nat. Neurosci., 13, 84, 10.1038/nn.2449 Thomson, 2003, Interlaminar connections in the neocortex, Cereb. Cortex, 13, 5, 10.1093/cercor/13.1.5 Thomson, 2002, Synaptic connections and small circuits involving excitatory and inhibitory neurons in layers 2-5 of adult rat and cat neocortex: triple intracellular recordings and biocytin labelling in vitro, Cereb. Cortex, 12, 936, 10.1093/cercor/12.9.936 Todorovic, 2011, Prior expectation mediates neural adaptation to repeated sounds in the auditory cortex: an MEG study, J. Neurosci., 31, 9118, 10.1523/JNEUROSCI.1425-11.2011 Ullman, 1995, Sequence seeking and counter streams: a computational model for bidirectional information flow in the visual cortex, Cereb. Cortex, 5, 1, 10.1093/cercor/5.1.1 Usrey, 1996, Specificity in the axonal connections of layer VI neurons in tree shrew striate cortex: evidence for distinct granular and supragranular systems, J. Neurosci., 16, 1203, 10.1523/JNEUROSCI.16-03-01203.1996 Varela, 2001, The brainweb: phase synchronization and large-scale integration, Nat. Rev. Neurosci., 2, 229, 10.1038/35067550 Vezoli, 2004, Quantitative analysis of connectivity in the visual cortex: extracting function from structure, Neuroscientist, 10, 476, 10.1177/1073858404268478 Vicente, 2008, Dynamical relaying can yield zero time lag neuronal synchrony despite long conduction delays, Proc. Natl. Acad. Sci. USA, 105, 17157, 10.1073/pnas.0809353105 Wacongne, 2011, Evidence for a hierarchy of predictions and prediction errors in human cortex, Proc. Natl. Acad. Sci. USA, 108, 20754, 10.1073/pnas.1117807108 Wang, 2010, Neurophysiological and computational principles of cortical rhythms in cognition, Physiol. Rev., 90, 1195, 10.1152/physrev.00035.2008 Weiler, 2008, Top-down laminar organization of the excitatory network in motor cortex, Nat. Neurosci., 11, 360, 10.1038/nn2049 Wozny, 2011, Specificity of synaptic connectivity between layer 1 inhibitory interneurons and layer 2/3 pyramidal neurons in the rat neocortex, Cereb. Cortex, 21, 1818, 10.1093/cercor/bhq257 Wurtz, 2011, Thalamic pathways for active vision, Trends Cogn. Sci. (Regul. Ed.), 15, 177, 10.1016/j.tics.2011.02.004 Wyart, 2012, Dissociable prior influences of signal probability and relevance on visual contrast sensitivity, Proc. Natl. Acad. Sci. USA, 109, 3593, 10.1073/pnas.1120118109 Yamaguchi, 1990, Gating of somatosensory input by human prefrontal cortex, Brain Res., 521, 281, 10.1016/0006-8993(90)91553-S Yoshimura, 2005, Fine-scale specificity of cortical networks depends on inhibitory cell type and connectivity, Nat. Neurosci., 8, 1552, 10.1038/nn1565 Yuille, 2006, Vision as Bayesian inference: analysis by synthesis?, Trends Cogn. Sci., 10, 301, 10.1016/j.tics.2006.05.002 Zeki, 1978, The cortical projections of foveal striate cortex in the rhesus monkey, J. Physiol., 277, 227, 10.1113/jphysiol.1978.sp012270 Zeki, 1988, The functional logic of cortical connections, Nature, 335, 311, 10.1038/335311a0