Abstract
AbstractA class of deep Boltzmann machines is considered in the simplified framework of a quenched system with Gaussian noise and independent entries. The quenched pressure of a K-layers spin glass model is studied allowing interactions only among consecutive layers. A lower bound for the pressure is found in terms of a convex combination of K Sherrington–Kirkpatrick models and used to study the annealed and replica symmetric regimes of the system. A map with a one-dimensional monomer–dimer system is identified and used to rigorously control the annealed region at arbitrary depth K with the methods introduced by Heilmann and Lieb. The compression of this high-noise region displays a remarkable phenomenon of localisation of the processing layers. Furthermore, a replica symmetric lower bound for the limiting quenched pressure of the model is obtained in a suitable region of the parameters and the replica symmetric pressure is proved to have a unique stationary point.
Funder
Università di Bologna
Ministero dell’Istruzione, dell’Università e della Ricerca
Publisher
Springer Science and Business Media LLC
Subject
Mathematical Physics,Nuclear and High Energy Physics,Statistical and Nonlinear Physics
Reference28 articles.
1. Aizenman, M., Lebowitz, J.L., Ruelle, D.: Some rigorous results on the Sherrington–Kirkpatrick spin glass model. Commun. Math. Phys. 112, 3–20 (1987)
2. Alberici, D., Barra, A., Contucci, P., Mingione, E.: Annealing and replica symmetry in deep Boltzmann machines. J. Stat. Phys. 180, 665–677 (2020)
3. Auffinger, A., Chen, W.-K.: The Parisi formula has a unique minimizer. Commun. Math. Phys. 335, 1429–1444 (2015)
4. Auffinger, A., Chen, W.-K.: Free energy and complexity of spherical bipartite models. J. Stat. Phys. 157(1), 40–59 (2014)
5. Baik, J., Lee, J.O.: Free energy of bipartite spherical Sherrington–Kirkpatrick model. arXiv:1711.06364
Cited by
18 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献