On the Gaussian Perceptron at High Temperature

Springer Science and Business Media LLC - Tập 5 - Trang 77-99 - 2002
Michel Talagrand1,2
1Equipe d'Analyse-Tour 46, ESA au CNRS No. 7064, Université Paris VI, Paris Cedex 05, France
2Department of Mathematics, The Ohio State University, Columbus, U.S.A.

Tóm tắt

For σ=(σ i ) i≤N ∈Σ N ={−1,1} N , define $$H\left( \sigma \right) = - \sum\limits_{k \leqslant M} {u\left( {\frac{1}{{\sqrt N }}\sum\limits_{i \leqslant N} {\sigma _i g_i^k } } \right)} ,$$ where (g k i ) i≤N,k≤M are i.i.d. N(0,1), and where u is bounded and Borel measurable. When M is a small proportion α of N, we study the system with random Hamiltonian H, at temperature 1. When α is small enough, we prove that the overlap of two configurations taken independently at random for Gibbs' measure is nearly constant, with a correct estimate of the size of its fluctuations.

Từ khóa


Tài liệu tham khảo

Gardner, E. and Derrida, B.: Optimal storage properties of neural network models, J. Phys. A 21(1) (1988), 271-284.

Hertz, J., Krogh, A. and Palmers, R. C.: Introduction to the Theory of Neural Computation, Addison-Wesley, 1991.

Mézard, M., Parisi, G. and Virasiro, M.: Spin Glass Theory and Beyond, World Scientific, Singapore, 1987.

Talagrand, M.: Huge random structures and mean field models for glasses, In: Proc. Berlin Internat. Congr. Document. Math, Extra Volume I (1988), 507-536.

Talagrand, M.: Intersecting random half spaces: Towards the Derrida-Gardner formula, Ann. Probab. 28 (2001), 725-758.

Talagrand, M.: Mean Field Models for Spin Glasses: A First Course, Saint Flour Summer School in Probability 2000, to appear in Springer Lecture Notes in Math.