Cortical Divisive Normalization from Wilson–Cowan Neural Dynamics
Tóm tắt
Divisive Normalization and the Wilson–Cowan equations are well-known influential models of nonlinear neural interaction (Carandini and Heeger in Nat Rev Neurosci 13(1):51, 2012; Wilson and Cowan in Kybernetik 13(2):55, 1973). However, they have been always treated as different approaches and have not been analytically related yet. In this work, we show that Divisive Normalization can be derived from the Wilson–Cowan dynamics. Specifically, assuming that Divisive Normalization is the steady state of the Wilson–Cowan differential equations, we find that the kernel that controls neural interactions in Divisive Normalization depends on the Wilson–Cowan kernel but also depends on the signal. A standard stability analysis of a Wilson–Cowan model with the parameters obtained from our relation shows that the Divisive Normalization solution is a stable node. This stability suggests the appropriateness of our steady state assumption. The proposed theory provides a mechanistic foundation for the suggestions that have been done on the need of signal-dependent Divisive Normalization in Coen-Cagli et al. (PLoS Comput Biol 8(3):e1002405, 2012). Moreover, this theory explains the modifications that had to be introduced ad hoc in Gaussian kernels of Divisive Normalization in Martinez-Garcia et al. (Front Neurosci 13:8, 2019) to reproduce contrast responses in V1 cortex. Finally, the derived relation implies that the Wilson–Cowan dynamics also reproduce visual masking and subjective image distortion, which up to now had been explained mainly via Divisive Normalization.
Tài liệu tham khảo
Amari, S.I.: Dynamics of pattern formation in lateral-inhibition type neural fields. Biol. Cybern. 27(2), 77–87 (1977)
Berardino, A., Laparra, V., Ballé, J., Simoncelli, E.: Eigen-distortions of hierarchical representations. Adv. Neural Inf. Process. Syst. 30, 3533–3542 (2017)
Bertalmio, M.: From image processing to computational neuroscience: a neural model based on histogram equalization. Front. Comput. Neurosci. 8(71), 1–7 (2014)
Bertalmio, M., Cyriac, P., Batard, T., Martinez-Garcia, M., Malo, J.: The Wilson–Cowan model describes contrast response and subjective distortion. J. Vis. 17(10), 657 (2017)
Bertalmío, M., Calatroni, L., Franceschi, V., Franceschiello, B., Gomez Villa, A., Prandi, D.: Visual illusions via neural dynamics: Wilson–Cowan-type models and the efficient representation principle. J. Neurophysiol. 123(5), 1606–1618 (2020)
Bertalmío, M., Gomez-Villa, A., Martín, A., Vazquez-Corral, J., Kane, D., Malo, J.: Evidence for the intrinsically nonlinear nature of receptive fields in vision. Sci. Rep. 10, 16277 (2020). https://doi.org/10.1038/s41598-020-73113-0
Bressloff, P.C., Cowan, J.D.: An amplitude equation approach to contextual effects in visual cortex. Neural Comput. 14(3), 493–525 (2002)
Bressloff, P.C., Cowan, J.D.: The functional geometry of local and horizontal connections in a model of V1. J. Physiol. Paris 97(2), 221–236 (2003)
Bressloff, P., Cowan, J., Golubitsky, M., Thomas, P., Wiener, M.C.: What geometric visual hallucinations tell us about the visual cortex. Neural Comput. 14, 473–491 (2002). https://doi.org/10.1162/089976602317250861
Bressloff, P.C., Cowan, J.D., Golubitsky, M., Thomas, P.J., Wiener, M.C.: What geometric visual hallucinations tell us about the visual cortex. Neural Comput. 14(3), 473–491 (2002)
Campbell, F., Robson, J.: Application of Fourier analysis to the visibility of gratings. J. Physiol. 197, 551–566 (1968)
Camps, G., Gutiérrez, J., Gómez, G., Malo, J.: On the suitable domain for SVM training in image coding. J. Mach. Learn. Res. 9(3), 49–66 (2008)
Carandini, M., Heeger, D.: Summation and division by neurons in visual cortex. Science 264(5163), 1333–1336 (1994)
Carandini, M., Heeger, D.J.: Normalization as a canonical neural computation. Nat. Rev. Neurosci. 13(1), 51–62 (2012)
Cavanaugh, J.R.: Properties of the receptive field surround in macaque primary visual cortex. PhD Thesis, Center for Neural Science, New York Univ. (2000)
Cavanaugh, J.R., Bair, W., Anthony Movshon, J.: Nature and interaction of signals from the receptive field center and surround in Macaque V1 neurons. J. Neurophysiol. 88, 2530–2546 (2002)
Cavanaugh, J.R., Bair, W., Movshon, J.A.: Selectivity and spatial distribution of signals from the receptive field surround in Macaque V1 neurons. J. Neurophysiol. 88(5), 2547–2556 (2002)
Chossat, P., Faugeras, O.: Hyperbolic planforms in relation to visual edges and textures perception. PLoS Comput. Biol. 5, e1000625 (2009)
Chow, C., Karimipanah, Y.: Before and beyond the Wilson–Cowan equations. J. Neurophysiol. 123, 1645–1656 (2020). https://doi.org/10.1152/jn.00404.2019
Coen-Cagli, R., Schwartz, O.: The impact on midlevel vision of statistically optimal divisive normalization in V1. J. Vis. 13(8), 13 (2013)
Coen-Cagli, R., Dayan, P., Schwartz, O.: Cortical surround interactions and perceptual salience via natural scene statistics. PLoS Comput. Biol. 8(3), e1002405 (2012)
Deangelis, G., Freeman, R., Ohzawa, I.: Length and width tuning of neurons in the cat’s primary visual cortex. J. Neurophysiol. 71, 347–374 (1994). https://doi.org/10.1152/jn.1994.71.1.347
Destexhe, A., Sejnowski, T.J.: The Wilson–Cowan model, 36 years later. Biol. Cybern. 101(1), 1–2 (2009)
Foley, J.: Human luminance pattern mechanisms: masking experiments require a new model. J. Opt. Soc. Am. A 11(6), 1710–1719 (1994)
Ghadiyaram, D., Bovik, A.C.: Massive online crowdsourced study of subjective and objective picture quality. IEEE Trans. Image Process. 25(1), 372–387 (2016). https://doi.org/10.1109/TIP.2015.2500021
Gomez-Villa, A., Bertalmio, M., Malo, J.: Visual information flow in Wilson–Cowan networks. J. Neurophysiol. 123, 2249–2268 (2020). https://doi.org/10.1152/jn.00487.2019
Grossberg, S.: Some nonlinear networks capable of learning a spatial pattern of arbitrary complexity. Proc. Natl. Acad. Sci. USA 59, 368–372 (1968). https://doi.org/10.1073/pnas.59.2.368
Grossberg, S.: Nonlinear neural networks: principles, mechanisms, and architectures. Neural Netw. 1, 17–61 (1988). https://doi.org/10.1016/0893-6080(88)90021-4
Hepburn, A., Laparra, V., Malo, J., McConville, R., Santos-Rodriguez, R.: Perceptnet: a human visual system inspired neural network for estimating perceptual distance. In: IEEE ICIP, pp. 121–125 (2020)
Hillis, J.M., Brainard, D.: Do common mechanisms of adaptation mediate color discrimination and appearance? JOSA A 22(10), 2090–2106 (2005)
Kelly, D.: Motion and vision II: stabilized spatio-temporal threshold surface. J. Opt. Soc. Am. 69(10), 1340–1349 (1979)
Laparra, V., Muñoz-Marí, J., Malo, J.: Divisive normalization image quality metric revisited. JOSA A 27(4), 852–864 (2010)
Laparra, V., Jiménez, S., Camps-Valls, G., Malo, J.: Nonlinearities and adaptation of color vision from sequential principal curves analysis. Neural Comput. 24(10), 2751–2788 (2012)
Laparra, V., Berardino, A., Balle, J., Simoncelli, E.: Perceptually optimized image rendering. JOSA A 34(9), 1511–1525 (2017)
Legge, G.: A power law for contrast discrimination. Vis. Res. 18, 68–91 (1981)
Legge, G., Foley, J.: Contrast masking in human vision. J. Opt. Soc. Am. 70, 1458–1471 (1980)
Logan, J.D.: A First Course in Differential Equations, A First Course in Differential Equations, 3rd edn. Springer, Incorporated (2015)
Malo, J.: Spatio-chromatic information available from different neural layers via Gaussianization. J. Math. Neurosci. (2020). https://doi.org/10.1186/s13408-020-00095-8
Malo, J.: Information flow in biological networks for color vision. Entropy 24(10), 1442 (2022). https://doi.org/10.3390/e24101442
Malo, J., Simoncelli, E.: Geometrical and statistical properties of vision models obtained via maximum differentiation. In: SPIE Electronic Imaging. International Society for Optics and Photonics, pp. 93,940L–93,940L (2015)
Malo, J., Laparra, V.: Psychophysically tuned divisive normalization approximately factorizes the PDF of natural images. Neural Comput. 22(12), 3179–3206 (2010)
Malo, J., Ferri, F., Albert, J., Soret, J., Artigas, J.: The role of perceptual contrast non-linearities in image transform quantization. Image Vis. Comput. 18(3), 233–246 (2000)
Malo, J., Epifanio, I., Navarro, R., Simoncelli, E.P.: Nonlinear image representation for efficient perceptual coding. IEEE Trans. Image Process. 15(1), 68–80 (2006)
Martinez-Garcia, M., Cyria, P., Batard, T., Bertalmio, M., Malo, J.: Derivatives and inverse of cascaded linear+nonlinear neural models. PLoS ONE 13(10), e0201326 (2018). https://doi.org/10.1371/journal.pone.0201326
Martinez-Garcia, M., Bertalmío, M., Malo, J.: In praise of artifice reloaded: caution with natural image databases in modeling vision. Front. Neurosci. 13, 8 (2019)
Nelson, J.I., Frost, B.J.: Intracortical facilitation among co-oriented, co-axially aligned simple cells in cat striate cortex. Exp. Brain Res. 61(1), 54–61 (1985)
Olshausen, B., Field, D.: Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 281, 607–609 (1996). https://doi.org/10.1038/381607a0
Ponomarenko, N., Carli, M., Lukin, V., Egiazarian, K., Astola, J., Battisti, F.: Color image database for evaluation of image quality metrics. In: Proceedings of the International Workshop on Multimedia Signal Processing, pp. 403–408 (2008)
Ponomarenko, N., Lukin, V., Zelensky, A., Egiazarian, K., Astola, J., Carli, M., Battisti, F.: TID2008—a database for evaluation of full-reference visual quality assessment metrics. Adv. Mod. Radioelectron. 10, 30–45 (2009)
Saproo, S., Serences, J.T.: Attention improves transfer of motion information between V1 and MT. J. Neurosci. 34(10), 3586–3596 (2014)
Sato, T., Haider, B., Hausser, M., Carandini, M.: An excitatory basis for divisive normalization in visual cortex. Nat. Neurosci. (2016). https://doi.org/10.1038/nn.4249
Schwartz, G., Rieke, F.: Nonlinear spatial encoding by retinal ganglion cells: when 1 + 1 \(\ne \) 2. J. Gen. Physiol. 138(3), 283–290 (2011). https://doi.org/10.1085/jgp.201110629
Schwartz, O., Simoncelli, E.: Natural signal statistics and sensory gain control. Nat. Neurosci. 4(8), 819–825 (2001)
Schwartz, O., Sejnowski, T.J., Dayan, P.: Perceptual organization in the tilt illusion. J. Vis. 9(4), 19 (2009). https://doi.org/10.1167/9.4.19
Simoncelli, E.P., Heeger, D.J.: A model of neuronal responses in visual area MT. Vis. Res. 38(5), 743–761 (1998)
Simoncelli, E.P., Freeman, W.T., Adelson, E.H., Heeger, D.J.: Shiftable multi-scale transforms. IEEE Trans. Inf. Theory 38(2), 587–607 (1992). https://doi.org/10.1109/18.119725
Teo, P., Heeger, D.: Perceptual image distortion. In: IEEE Proceedings of 1st International Conference on Image Processing ICIP94, vol. 2, pp. 982–986 (1994)
Turner, M., Rieke, F.: Synaptic rectification controls nonlinear spatial integration of natural visual inputs. Neuron 90(6), 1257–1271 (2016)
van Hateren, J.H., van der Schaaf, A.: Independent component filters of natural images compared with simple cells in primary visual cortex. Proc. Biol. Sci. 265(1394), 359–366 (1998)
Walker, G.A., Ohzawa, I., Freeman, R.D.: Asymmetric suppression outside the classical receptive field of the visual cortex. J. Neurosci. 19, 10536–10553 (1999)
Watson, A.B., Solomon, J.A.: Model of visual contrast gain control and pattern masking. JOSA A 14(9), 2379–2391 (1997)
Wilson, H., Cowan, J.: Excitatory and inhibitory interactions in localized populations of model neurons. Biophys. J. 12, 1–24 (1972)
Wilson, H.R., Cowan, J.D.: A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetik 13(2), 55–80 (1973)
Wilson, H.R., Humanski, R.: Spatial frequency adaptation and contrast gain control. Vis. Res. 33(8), 1133–1149 (1993)
Zeraati, R., et al.: Intrinsic timescales in the visual cortex change with selective attention and reflect spatial connectivity. Nat. Commun. 14(1), 1858 (2023)