34

CLuP practically achieves 1.77\sim 1.77 positive and 0.33\sim 0.33 negative Hopfield model ground state free energy

Main:18 Pages
10 Figures
Bibliography:6 Pages
6 Tables
Appendix:1 Pages
Abstract

We study algorithmic aspects of finding nn-dimensional \emph{positive} and \emph{negative} Hopfield (±\pmHop) model ground state free energies. This corresponds to classical maximization of random positive/negative semi-definite quadratic forms over binary {±1n}n\left \{\pm \frac{1}{\sqrt{n}} \right \}^n vectors. The key algorithmic question is whether these problems can be computationally efficiently approximated within a factor 1\approx 1. Following the introduction and success of \emph{Controlled Loosening-up} (CLuP-SK) algorithms in finding near ground state energies of closely related Sherrington-Kirkpatrick (SK) models [82], we here propose a CLuP±\pmHop counterparts for ±\pmHop models. Fully lifted random duality theory (fl RDT) [78] is utilized to characterize CLuP±\pmHop \emph{typical} dynamics. An excellent agreement between practical performance and theoretical predictions is observed. In particular, for nn as small as few thousands CLuP±\pmHop achieve 1.77\sim 1.77 and 0.33\sim 0.33 as the ground state free energies of the positive and negative Hopfield models. At the same time we obtain on the 6th level of lifting (6-spl RDT) corresponding theoretical thermodynamic (nn\rightarrow\infty) limits 1.7784\approx 1.7784 and 0.3281\approx 0.3281. This positions determining Hopfield models near ground state energies as \emph{typically} easy problems. Moreover, the very same 6th lifting level evaluations allow to uncover a fundamental intrinsic difference between two models: ++Hop's near optimal configurations are \emph{typically close} to each other whereas the -Hop's are \emph{typically far away}.

View on arXiv
Comments on this paper