Sparse coding with an overcomplete basis set: A strategy employed by V1?

Vision Research - Tập 37 Số 23 - Trang 3311-3325 - 1997
Bruno A. Olshausen1, David J. Field
1Department of Psychology, Cornell University, Ithaca, NY 14853, USA. [email protected]

Tóm tắt

Từ khóa


Tài liệu tham khảo

Amari, 1996, A new learning algorithm for blind signal separation, Vol. 8

Atick, 1992, Could information theory provide an ecological theory of sensory processing?, Network, 3, 213, 10.1088/0954-898X_3_2_009

Atick, 1990, Towards a theory of early visual processing, Neural Computation, 2, 308, 10.1162/neco.1990.2.3.308

Atick, 1992, What does the retina know about natural scenes?, Neural Computation, 4, 196, 10.1162/neco.1992.4.2.196

Baddeley, 1996, An efficient code in V1?, Nature, 381, 560, 10.1038/381560a0

Barlow, 1961, Possible principles underlying the transformations of sensory messages, 217

Barlow, 1989, Unsupervised learning, Neural Computation, 1, 295, 10.1162/neco.1989.1.3.295

Baum, 1988, Internal representations for associative memory, Biological Cybernetics, 59, 217, 10.1007/BF00332910

Bell, 1995, An information-maximization approach to blind separation and blind deconvolution, Neural Computation, 7, 1129, 10.1162/neco.1995.7.6.1129

Comon, 1994, Independent component analysis, a new concept?, Signal Processing, 36, 287, 10.1016/0165-1684(94)90029-9

Dan, 1996, Efficient coding of natural scenes in the lateral geniculate nucleus: experimental test of a computational theory, Journal of Neuroscience, 16, 3351, 10.1523/JNEUROSCI.16-10-03351.1996

Daugman, 1989, Entropy reduction and decorrelation in visual coding by oriented neural receptive fields, IEEE Transactions on Biomedical Engineering, 36, 107, 10.1109/10.16456

Dayan, 1995, The Helmholtz machine, Neural Computation, 7, 889, 10.1162/neco.1995.7.5.889

De Valois, 1982, Spatial frequency selectivity of cells in macaque visual cortex, Vision Research, 22, 545, 10.1016/0042-6989(82)90113-4

Dong, 1995, Temporal decorrelation: a theory of lagged and non-lagged responses in the lateral geniculate nucleus, Network: Computation in Neural Systems, 6, 159, 10.1088/0954-898X_6_2_003

Field, 1987, Relations between the statistics of natural images and the response properties of cortical cells, Journal of the Optical Society of America A, 4, 2379, 10.1364/JOSAA.4.002379

Field, 1993, Scale-invariance and self-similar “wavelet” transforms: an analysis of natural scenes and mammalian visual systems, 151

Field, 1994, What is the goal of sensory coding?, Neural Computation, 6, 559, 10.1162/neco.1994.6.4.559

Foldiak, 1990, Forming sparse representations by local antiHebbian learning, Biological Cybernetics, 64, 165, 10.1007/BF02331346

Foldiak, 1995, Sparse coding in the primate cortex, 895

Friedman, 1987, Exploratory projection pursuit, Journal of the American Statistical Association, 82, 249, 10.1080/01621459.1987.10478427

Fyfe, 1995, Finding compact and sparsedistributed representations of visual images, Network, 6, 333, 10.1088/0954-898X_6_3_002

Harpur, 1997, Low entropy coding with unsupervised neural networks

Harpur, 1996, Development of low entropy coding in a recurrent network, Network, 7, 277, 10.1088/0954-898X_7_2_007

Hinton, 1997, Generative models for discovering sparse distributed representations, Philosophical Transactions of the Royal Society B, 10.1098/rstb.1997.0101

Intrator, 1992, Feature extraction using an unsupervised neural network, Neural Computation, 4, 98, 10.1162/neco.1992.4.1.98

Kullback, 1959

Law, 1994, Formation of receptive fields in realistic visual environments according to the Bienenstock, Cooper, and Munro (BCM) theory, 91, 7797

Lewicki, 1996, Bayesian unsupervised learning of higher order structure, Vol. 9

Lu, 1996, Independence rejection: an unsupervised learning algorithm for extracting latent source structures from arbitrary image populations

Mallat, 1989, A theory for multiresolution signal decomposition: the wavelet representation, IEEE Transactions on Pattern Analysis and Machine Intelligence, 117, 674, 10.1109/34.192463

Mumford, 1994, Neuronal architectures for pattern-theoretic problems, 125

Olshausen, 1996, Learning linear, sparse, factorial codes

Olshausen, 1994, A model of the spatialfrequency organization in primate striate cortex, 275

Olshausen, 1996, Emergence of simple-cell receptive field properties by learning a sparse code for natural images, Nature, 381, 607, 10.1038/381607a0

Olshausen, 1996, Natural image statistics and efficient coding, Network,, 7, 333, 10.1088/0954-898X_7_2_014

Parker, 1988, Two-dimensional spatial structure of receptive fields in monkey striate cortex, Journal of the Optical Society of America A, 5, 598, 10.1364/JOSAA.5.000598

Pearlmutter, 1996, A context-sensitive generalization of ICA

Press, 1996, Projection pursuit analysis of the statistical structure in natural scenes

Rao, 1997, Dynamic model of visual recognition predicts neural response properties in the visual cortex, Neural Computation, 9, 721, 10.1162/neco.1997.9.4.721

Saund, 1995, A multiple cause mixture model for unsupervised learning, Neural Computation, 7, 51, 10.1162/neco.1995.7.1.51

Simoncelli, 1992, Shiftable multiscale transforms, IEEE Transactions on Information Theory, 382, 587, 10.1109/18.119725

Tadmor, 1989, The effect of threshold on the relationship between the receptive field profile and the spatialfrequency tuning curve in simple cells of the cat's striate cortex, Visual Neuroscience, 3, 445, 10.1017/S0952523800005940

Zemel, 1993, A minimum description length framework for unsupervised learning