Replica symmetry breaking and the Kuhn-Tucker cavity method in simple and multilayer perceptrons

Gerl, F. and Krey, Uwe (1997) Replica symmetry breaking and the Kuhn-Tucker cavity method in simple and multilayer perceptrons. JOURNAL DE PHYSIQUE I, 7 (2). pp. 303-327. ISSN 1155-4304

Full text not available from this repository.

Abstract

Within a Kuhn-Tucker cavity method introduced in a former paper, we study optimal stability learning for situations, where in the replica formalism the replica symmetry may be broken, namely (i) the case of a simple perceptron above the critical loading, and (ii) the case of two-layer AND-perceptrons, if one learns with maximal stability. We find that the deviation of our cavity solution from the replica symmetric one in these cases is a clear indication of the necessity of replica symmetry breaking. In any case the cavity solution tends to underestimate the storage capabilities of the networks.

Item Type: Article
Uncontrolled Keywords: NEURAL NETWORKS; STORAGE CAPACITY; SATURATION; ALGORITHM; MODELS; BOUNDS
Subjects: 500 Science > 530 Physics
Divisions: Physics > Institute of Theroretical Physics
Depositing User: Dr. Gernot Deinzer
Date Deposited: 17 May 2023 06:20
Last Modified: 17 May 2023 06:20
URI: https://pred.uni-regensburg.de/id/eprint/51063

Actions (login required)

View Item View Item