Nonlinear circuits for naturalistic visual motion estimation

eLife - Tập 4
James E. Fitzgerald1, Damon A. Clark2,3
1Center for Brain Science, Harvard University, Cambridge, United States;
2Department of Molecular, Cellular and Developmental Biology, Yale University, New Haven, United States;
3Department of Physics, Yale University, New Haven, United States

Tóm tắt

Many animals use visual signals to estimate motion. Canonical models suppose that animals estimate motion by cross-correlating pairs of spatiotemporally separated visual signals, but recent experiments indicate that humans and flies perceive motion from higher-order correlations that signify motion in natural environments. Here we show how biologically plausible processing motifs in neural circuits could be tuned to extract this information. We emphasize how known aspects of Drosophila's visual circuitry could embody this tuning and predict fly behavior. We find that segregating motion signals into ON/OFF channels can enhance estimation accuracy by accounting for natural light/dark asymmetries. Furthermore, a diversity of inputs to motion detecting neurons can provide access to more complex higher-order correlations. Collectively, these results illustrate how non-canonical computations improve motion estimation with naturalistic inputs. This argues that the complexity of the fly's motion computations, implemented in its elaborate circuits, represents a valuable feature of its visual motion estimator.

Từ khóa


Tài liệu tham khảo

Adelson, 1985, Spatiotemporal energy models for the perception of motion, Journal of the Optical Society of America. A, Optics and Image Science, 2, 284, 10.1364/JOSAA.2.000284

Ammer, 2015, Functional specialization of neural input elements to the Drosophila ON motion detector, Current Biology, 25, 2247, 10.1016/j.cub.2015.07.014

Barlow, 1963, Selective sensitivity to direction of movement in ganglion cells of the rabbit retina, Science, 139, 412, 10.1126/science.139.3553.412

Behnia, 2014, Processing properties of ON and OFF pathways for Drosophila motion detection, Nature, 512, 427, 10.1038/nature13427

Bell, 1997, The “independent components” of natural scenes are edge filters, Vision Research, 37, 3327, 10.1016/S0042-6989(97)00121-1

Borst, 2005, Adaptation without parameter change: dynamic gain control in motion detection, Proceedings of the National Academy of Sciences of USA, 102, 6172, 10.1073/pnas.0500491102

Brinkworth, 2009, Robust models for optic flow coding in natural scenes inspired by insect biology, PLOS Computational Biology, 5, e1000555, 10.1371/journal.pcbi.1000555

Britten, 1992, The analysis of visual motion: a comparison of neuronal and psychophysical performance, The Journal of Neuroscience, 12, 4745, 10.1523/JNEUROSCI.12-12-04745.1992

Buchner, 1976, Elementary movement detectors in an insect visual system, Biological Cybernetics, 24, 85, 10.1007/BF00360648

Card, 2008, Visually mediated motor planning in the escape response of Drosophila, Current Biology, 18, 1300, 10.1016/j.cub.2008.07.094

Chubb, 1988, Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception, Journal of the Optical Society of America. A, Optics and Image Science, 5, 1986, 10.1364/JOSAA.5.001986

Clark, 2011, Defining the computational structure of the motion detector in Drosophila, Neuron, 70, 1165, 10.1016/j.neuron.2011.05.023

Clark, 2014, Flies and humans share a motion estimation strategy that exploits natural scene statistics, Nature Neuroscience, 17, 296, 10.1038/nn.3600

DeCarlo, 1997, On the meaning and use of kurtosis, Psychological Methods, 2, 292, 10.1037/1082-989X.2.3.292

Dror, 2001, Accuracy of velocity estimation by Reichardt correlates, Journal of the Optical Society of America. A, Optics and Image Science, 18, 241, 10.1364/JOSAA.18.000241

Egelhaaf, 1989, Transient and steady-state response properties of movement detectors, Journal of the Optical Society of America. A, Optics and Image Science, 6, 116, 10.1364/JOSAA.6.000116

Egelhaaf, 1989, Computational structure of a biological motion-detection system as revealed by local detector analysis in the fly's nervous system, Journal of the Optical Society of America. A, Optics and Image Science, 6, 1070, 10.1364/JOSAA.6.001070

Eichner, 2011, Internal structure of the fly elementary motion detector, Neuron, 70, 1155, 10.1016/j.neuron.2011.03.028

Fitzgerald, 2011, Symmetries in stimulus statistics shape the form of visual motion estimators, Proceedings of the National Academy of Sciences of USA, 108, 12909, 10.1073/pnas.1015680108

Franz, 2000, Wide-field, motion-sensitive neurons and matched filters for optic flow fields, Biological Cybernetics, 83, 185, 10.1007/s004220000163

Gabbiani, 1999, Computation of object approach by a wide-field, motion-sensitive neuron, The Journal of Neuroscience, 19, 1122, 10.1523/JNEUROSCI.19-03-01122.1999

Geisler, 2008, Visual perception and the statistical properties of natural scenes, Annual Review of Psychology, 59, 167, 10.1146/annurev.psych.58.110405.085632

Götz, 1968, Flight control in Drosophila by visual perception of motion, Biological Cybernetics, 4, 199

Götz, 1973, Visual control of locomotion in the walking fruitfly Drosophila, Journal of Comparative Physiology. A, Sensory, Neural, and Behavioral Physiology, 85, 235, 10.1007/BF00694232

Haag, 2004, Fly motion vision is based on Reichardt detectors regardless of the signal-to-noise ratio, Proceedings of the National Academy of Sciences of USA, 101, 16333, 10.1073/pnas.0407368101

Hassenstein, 1956, Systemtheoretische Analyse der Zeit-, Reihenfolgen-und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus, Zeitschrift für Naturforschung B, 11, 513, 10.1515/znb-1956-9-1004

Hermundstad, 2014, Variance predicts salience in central sensory processing, eLife, 3, e03722, 10.7554/eLife.03722

Hu, 2010, A set of high-order spatiotemporal stimuli that elicit motion and reverse-phi percepts, Journal of Vision, 10, 10.1167/10.3.9

Hubel, 1962, Receptive fields, binocular interaction and functional architecture in the cat's visual cortex, The Journal of Physiology, 160, 106, 10.1113/jphysiol.1962.sp006837

Joesch, 2010, ON and OFF pathways in Drosophila motion vision, Nature, 468, 300, 10.1038/nature09545

Joesch, 2013, Functional specialization of parallel motion detection circuits in the fly, The Journal of Neuroscience, 33, 902, 10.1523/JNEUROSCI.3374-12.2013

Juusola, 2001, Light adaptation in Drosophila photoreceptors I. Response dynamics and signaling efficiency at 25° C, The Journal of General Physiology, 117, 3, 10.1085/jgp.117.1.3

Juusola, 2001, Light adaptation in Drosophila photoreceptors II. Rising temperature increases the bandwidth of reliable signaling, The Journal of General Physiology, 117, 27, 10.1085/jgp.117.1.27

Kalmus, 1964, Animals as mathematicians, 10.1038/2021156a0

Katsov, 2008, Motion processing streams in Drosophila are behaviorally specialized, Neuron, 59, 322, 10.1016/j.neuron.2008.05.022

Koch, 2004, Biophysics of computation: information processing in single neurons

Kral, 2003, Behavioural–analytical studies of the role of head movements in depth perception in insects, birds and mammals, Behavioural Processes, 64, 1, 10.1016/S0376-6357(03)00054-8

Laughlin, 1981, A simple coding procedure enhances a neuron's information capacity, Zeitschrift für Naturforschung C, 36, 51, 10.1515/znc-1981-9-1040

Laughlin, 1989, The role of sensory adaptation in the retina, The Journal of Experimental Biology, 146, 39, 10.1242/jeb.146.1.39

Maisak, 2013, A directional tuning map of Drosophila elementary motion detectors, Nature, 500, 212, 10.1038/nature12320

Marr, 1976, From understanding computation to understanding neural circuitry

Meier, 2014, Neural circuit components of the Drosophila OFF motion vision pathway, Current Biology, 24, 385, 10.1016/j.cub.2014.01.006

Nitzany, 2014, The statistics of local motion signals in naturalistic movies, Journal of Vision, 14, 10, 10.1167/14.4.10

Nitzany EI, Menda G, Shamble PS, Golden JR, Hoy RR, Victor JD. 2014. Evolutionary convergence in computation of local motion signals in monkey and dragonfly. Computational and Systems Neuroscience (CoSyNe).

Nordström, 2006, Insect detection of small targets moving in visual clutter, PLOS Biology, 4, e54, 10.1371/journal.pbio.0040054

Olshausen, 1996, Emergence of simple-cell receptive field properties by learning a sparse code for natural images, Nature, 381, 607, 10.1038/381607a0

Orger, 2000, Perception of Fourier and non-Fourier motion by larval zebrafish, Nature Neuroscience, 3, 1128, 10.1038/80649

Pick, 2005, Goal-driven behavioral adaptations in gap-climbing Drosophila, Current Biology, 15, 1473, 10.1016/j.cub.2005.07.022

Poggio, 1973, Considerations of models of movement detection, Kybernetik, 13, 223, 10.1007/BF00274887

Poggio, 1980, On the representation of multi-input systems: computational properties of polynomial algorithms, Biological Cybernetics, 37, 167, 10.1007/BF00355455

Potters, 1994, Statistical mechanics and visual signal processing, Journal de Physique I, 4, 1755, 10.1051/jp1:1994219

Quenzer, 1991, Visual detection of paradoxical motion in flies, Journal of Comparative Physiology A, 169, 331, 10.1007/BF00206997

Ratliff, 2010, Retina is structured to process an excess of darkness in natural scenes, Proceedings of the National Academy of Sciences of USA, 107, 17368, 10.1073/pnas.1005846107

Reichardt, 1976, Visual control of orientation behaviour in the fly: part I. A quantitative analysis, Quarterly Reviews of Biophysics, 9, 311, 10.1017/S0033583500002523

Reichardt, 1983, Figure-ground discrimination by relative movement in the visual system of the fly, Biological Cybernetics, 46, 1, 10.1007/BF00595226

Rogers, 1979, Motion parallax as an independent cue for depth perception, Perception, 8, 125, 10.1068/p080125

Ruderman, 1994, Statistics of natural images: scaling in the woods, Physical Review Letters, 73, 814, 10.1103/PhysRevLett.73.814

Rust, 2006, How MT cells analyze the motion of visual patterns, Nature Neuroscience, 9, 1421, 10.1038/nn1786

Schiller, 1992, The ON and OFF channels of the visual system, Trends in Neurosciences, 15, 86, 10.1016/0166-2236(92)90017-3

Sejnowski, 1988, Computational neuroscience, Science, 241, 1299, 10.1126/science.3045969

Silies, 2013, Modular use of peripheral input channels tunes motion-detecting circuitry, Neuron, 79, 111, 10.1016/j.neuron.2013.04.029

Silies, 2014, Motion-detecting circuits in flies: coming into view, Annual Review of Neuroscience, 37, 307, 10.1146/annurev-neuro-071013-013931

Simoncelli, 2001, Natural image statistics and neural representation, Annual Review of Neuroscience, 24, 1193, 10.1146/annurev.neuro.24.1.1193

Sperry, 1950, Neural basis of the spontaneous optokinetic response produced by visual inversion, Journal of Comparative and Physiological Psychology, 43, 482, 10.1037/h0055479

Srinivasan, 1991, Range perception through apparent image speed in freely flying honeybees, Visual Neuroscience, 6, 519, 10.1017/S095252380000136X

Strother, 2014, Direct observation of ON and OFF pathways in the Drosophila visual system, Current Biology, 24, 976, 10.1016/j.cub.2014.03.017

Takemura, 2013, A visual motion detection circuit suggested by Drosophila connectomics, Nature, 500, 175, 10.1038/nature12450

Tammero, 2002, Collision-avoidance and landing responses are mediated by separate pathways in the fruit fly, Drosophila melanogaster, The Journal of Experimental Biology, 205, 2785, 10.1242/jeb.205.18.2785

Tibshirani, 1996, Regression shrinkage and selection via the lasso, Journal of the Royal Statistical Society. Series B (Methodological), 10.1111/j.2517-6161.1996.tb02080.x

Tkačik, 2010, Local statistics in natural scenes predict the saliency of synthetic textures, Proceedings of the National Academy of Sciences of USA, 107, 18149, 10.1073/pnas.0914916107

Tuthill, 2011, Neural correlates of illusory motion perception in Drosophila, Proceedings of the National Academy of Sciences of USA, 108, 9685, 10.1073/pnas.1100062108

van Hateren, 2006, Phototransduction in primate cones and blowfly photoreceptors: different mechanisms, different algorithms, similar response, Journal of Comparative Physiology. A, Neuroethology, Sensory, Neural, and Behavioral Physiology, 192, 187, 10.1007/s00359-005-0060-y

van Hateren, 1998, Independent component filters of natural images compared with simple cells in primary visual cortex, Proceedings of the Royal Society of London. Series B, 265, 359, 10.1098/rspb.1998.0303

van Santen, 1985, Elaborated reichardt detectors, Journal of the Optical Society of America. A, Optics and Image Science, 2, 300, 10.1364/JOSAA.2.000300

Westheimer, 2007, The ON-OFF dichotomy in visual processing: from receptors to perception, Progress in Retinal and Eye Research, 26, 636, 10.1016/j.preteyeres.2007.07.003

Yu, 2015, Visual processing of informative multipoint correlations arises primarily in V2, eLife, 4, e06604, 10.7554/eLife.06604

Zanker, 1993, Theta motion: a paradoxical stimulus to explore higher order motion extraction, Vision Research, 33, 553, 10.1016/0042-6989(93)90258-X

Zhang, 2012, The most numerous ganglion cell type of the mouse retina is a selective feature detector, Proceedings of the National Academy of Sciences of USA, 109, E2391, 10.1073/pnas.1211547109