www.uhasselt.be
DSpace

Document Server@UHasselt >
Research >
Research publications >

Please use this identifier to cite or link to this item: http://hdl.handle.net/1942/8183

Title: Statistical physics of learning from examples - a brief introduction
Authors: VAN DEN BROECK, Christian
Issue Date: 1994
Publisher: POLISH ACAD SCIENCES INST PHYSICS
Citation: ACTA PHYSICA POLONICA B, 25(6). p. 903-923
Abstract: The problem of how one can learn from examples is illustrated on the case of a student perceptron trained by the Hebb rule on examples generated by a teacher perceptron. Two basic quantities are calculated : the training error and the generalization error. The obtained results are found to be typical. Other training rules are discussed. For the case of an Ising student with an Ising teacher, the existence of a first order phase transition is shown. Special effects such as dilution, queries, rejection, etc. are discussed and some results for multilayer networks are reviewed. In particular, the properties of a selfsimilar committee machine are derived. Finally, we discuss the statistics of generalization, with a review of the Hoeffding inequality, the Dvoretzky Kiefer Wolfowitz theorem and the Vapnik Chervonenkis theorem.
Notes: VANDENBROECK, C, LIMBURGS UNIV CENTRUM,UNIV CAMPUS,B-3590 DIEPENBEEK,BELGIUM.
URI: http://hdl.handle.net/1942/8183
ISI #: A1994NR85800001
ISSN: 0587-4254
Type: Journal Contribution
Appears in Collections: Research publications

Files in This Item:

There are no files associated with this item.

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.