Gaussian-width gradient complexity, reverse log-Sobolev inequalities and nonlinear large deviations

Ronen Eldan1
1Incumbent of the Elaine Blond Career Development Chair, Department of Mathematics, Weizmann Institute of Science, Rehovot, Israel

Tóm tắt

We prove structure theorems for measures on the discrete cube and on Gaussian space, which provide sufficient conditions for mean-field behavior. These conditions rely on a new notion of complexity for such measures, namely the Gaussian-width of the gradient of the log-density. On the cube {−1, 1}n, we show that a measure $${\nu}$$ which exhibits low complexity can be written as a mixtureof measures $${\{\nu_\theta\}_{\theta\in\mathcal{I}}}$$ such that: (i) for each $${\theta}$$ , the measure $${\nu_\theta}$$ is a small perturbation of $${\nu}$$ such that log $$\frac{{d \nu_\theta}}{{d \nu}}$$ is a linear function whose gradient is small and, (ii) $${\nu_\theta}$$ is close to some product measure, in Wasserstein distance, for most $${\theta}$$ . Thus, our framework can be used to study the behavior of low-complexity measures beyond approximation of the partition function, showing that those measures are roughly mixtures of product measures whose entropy is close to that of the original measure. In particular, as a corollary of our theorems, we derive a bound for the naïve mean-field approximation of the log-partition function which improves the nonlinear large deviation framework of Chatterjee and Dembo (Adv Math, 319:313–347, 2017. ISSN 0001-8708. https://dx.doi.org/10.1016/j.aim.2017.08.003 ) in several ways: (1) It does not require any bounds on second derivatives. (2) The covering number is replaced by the weaker notion of Gaussian-width. (3) We obtain stronger asymptotics with respect to the dimension. Two other corollaries are decomposition theorems for exponential random graphs and large-degree Ising models. In the Gaussian case, we show that measures of low-complexity exhibit an almost-tight reverse log-Sobolev inequality.

Từ khóa


Tài liệu tham khảo

Basak A., Mukherjee S.: Universality of the mean-field for the Potts model. Probab. Theory Related Fields (3-4), 168 (2017) https://dx.doi.org/10.1007/s00440-016-0718-0. B. B. Bhattacharya, S. Ganguly, X. Shao, and Y. Zhao. Upper tails for arithmetic progressions in a random set. (2016). Bhattacharya B.B., Ganguly S., Lubetzky E., Zhao. Y.: Upper tails and independence polynomials in random graphs. Adv. Math., 319, 313–347 (2017) ISSN 0001-8708. https://dx.doi.org/10.1016/j.aim.2017.08.003. Borell C., Isoperimetry, log-concavity, and elasticity of option prices. In New directions in Mathematical Finance, pages 73–91. Wiley, (2002). Edited by P. Wilmott and H. Rasmussen. S. Chatterjee. Large deviations for random graphs, volume 2197 of Lecture Notes in Mathematics. Springer, Cham (2017). ISBN 978-3-319-65815-5; 978- 3-319-65816-2. URL https://doi.org/10.1007/978-3-319-65816-2. Lecture notes from the 45th Probability Summer School held in Saint-Flour, June 2015, École d’Été de Probabilités de Saint-Flour. [Saint-Flour Probability Summer School]. Chatterjee S., Dembo A.: Nonlinear large deviations. Adv. Math., 299, 396–450 (2016) ISSN 0001-8708. https://dx.doi.org/10.1016/j.aim.2016.05.017. Chatterjee S., Diaconis P.: Estimating and understanding exponential random graph models. Ann. Statist., 41(5), 2428–2461 (2013) ISSN 0090-5364. https://dx.doi.org/10.1214/13-AOS1155. R. Eldan and J. R. Lee. Regularization under diffusion and anti-concentration of temperature. Preprint: arXiv:1410.3887 (2014). R. Eldan and R. Gross. Decomposition of mean-field gibbs distributions into product measures (2017a). Ronen Eldan and Renan Gross. Exponential random graphs behave like mixtures of stochastic block models (2017b). R. Eldan, J. R. Lee, and J. Lehec. Transport-entropy inequalities and curvature in discrete-space markov chains (2016). H. Föllmer. An entropy approach to the time reversal of diffusion processes. In Stochastic differential systems (Marseille–Luminy, 1984), volume 69 of Lecture Notes in Control and Inform. Sci., pages 156–163. Springer, Berlin (1985). https://dx.doi.org/10.1007/BFb0005070. Ledoux M., Talagrand M.: Probability in Banach spaces Classics in Mathematics.. Springer-Verlag, Berlin (2011) ISBN 978-3-642-20211-7. Isoperimetry and processes, Reprint of the 1991 edition. Lehec J.: Representation formula for the entropy and functional inequalities. Ann. Inst. Henri PoincaréProbab. Stat., 49(3), 885–899 (2013) ISSN 0246-0203. E. Lubetzky and Y. Zhao. On the variational problem for upper tails in sparse random graphs (2014). Talagrand M.: Transportation cost for Gaussian and other product measures. Geom. Funct. Anal., 6(3), 587–600 (1996) ISSN 1016-443X. https://dx.doi.org/10.1007/BF02249265.