4.6 Article

Replica symmetry breaking in neural networks: a few steps toward rigorous results

Journal

Publisher

IOP Publishing Ltd
DOI: 10.1088/1751-8121/abaf2c

Keywords

statistical mechanics; disordered systems; replica symmetry breaking; Hopfield model; rigorous methods

Funding

  1. Sapienza University of Rome [RG11715C7CC31E3D]
  2. INFN
  3. PRIN project 'Stochastic Models for Complex Systems' (PRIN 2017) [2017JFFHSH]
  4. Unisalento

Ask authors/readers for more resources

In this paper we adapt thebroken replica interpolationtechnique (developed by Francesco Guerra to deal with the Sherrington-Kirkpatrick model, namely a pairwise mean-field spin-glass whose couplings are i.i.d. standard Gaussian variables) in order to work also with the Hopfield model (i.e. a pairwise mean-field neural-network whose couplings are drawn according to Hebb's learning rule): this is accomplished by grafting Guerra's telescopic averages on the transport equation technique, recently developed by some of the authors. As an overture, we apply the technique to solve the Sherrington-Kirkpatrick model with i.i.d. Gaussian couplings centered atJ(0)and with finite varianceJ; the meanJ(0)provides a ferromagnetic contribution to be detected in a noisy environment tuned byJ, hence making this model a natural test-case to be investigated before addressing the Hopfield model. For both the models, an explicit expression of their quenched free energy in terms of their natural order parameters is obtained at theKth step (Karbitrary, but finite) of replica-symmetry-breaking. In particular, for the Hopfield model, by assuming that the overlaps respect Parisi's decomposition (following theziqqurat ansatz) and that the Mattis magnetization is self-averaging, we recover previous results obtained via replica-trick by Amit, Crisanti and Gutfreund (1RSB) and by Steffan and Kuhn (2RSB).

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available