Dirscherl, G. and Schottky, B. and Krey, Uwe (1998) Generalizing with perceptrons in the case of structured phase- and pattern-spaces. JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 31 (11). pp. 2519-2540. ISSN 0305-4470
Full text not available from this repository.Abstract
We investigate the influence of different kinds of structures on the learning behaviour of a perceptron performing a classification task defined by a teacher rule. The underlying pattern distribution is permitted to have spatial correlations. The prior distribution for the teacher coupling vectors itself is assumed to be nonuniform. Thus, classification tasks of quite different difficulty are included. As learning algorithms we discuss Hebbian, Gibbs, and Bayesian learning with different priors, using methods from statistics and the replica formalism. We find that the Hebb rule is quite sensitive to the structure of the actual learning problem, failing asymptotically in most cases. In contrast, the behaviour of the more sophisticated methods of Gibbs and Bayes learning is influenced by the spatial correlations only in an intermediate regime of a, where a specifies the size of the training set. In view of the Bayesian case, we show how enhanced prior knowledge improves the performance.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | NEURAL NETWORKS; CORRELATED PATTERNS; STATISTICAL-MECHANICS; STORAGE; ALGORITHM |
| Subjects: | 500 Science > 530 Physics |
| Divisions: | Physics > Institute of Theroretical Physics |
| Depositing User: | Dr. Gernot Deinzer |
| Date Deposited: | 28 Feb 2023 06:40 |
| Last Modified: | 28 Feb 2023 06:40 |
| URI: | https://pred.uni-regensburg.de/id/eprint/50015 |
Actions (login required)
 |
View Item |
