Theory and application of the supervised learning method based on gradient algorithms Part (2). Training mechanism

Jie Si, Guian Zhou, Han Li, Yingdou Han

Research output: Contribution to journalArticle

4 Scopus citations

Abstract

Based on gradient algorithm and the fundamental approximation of the feedforward network, a new supervised comprehensive training mechanism is put forward. In the realization of learning process, the training mechanism can choose the appropriate parameter set to avoid overfitting and achieve required accuracy with reduced calculation and storage complexity as well as satisfactory validity and generality. The new algorithm (PTNT) can incorporate several aspects of the neural network training in the same process with lessened training process and improved accuracy over the BP algorithm and inherited algorithm. PTNT algorithm converges like LM algorithm, with a storage complexity far less than half of the latter. Simulation results justified the generality of the supervised training mechanism and feedforward network.

Original languageEnglish (US)
Pages (from-to)104-107, 117
JournalQinghua Daxue Xuebao/Journal of Tsinghua University
Volume37
Issue number9
StatePublished - Dec 1 1997
Externally publishedYes

ASJC Scopus subject areas

  • Engineering(all)
  • Computer Science Applications
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Theory and application of the supervised learning method based on gradient algorithms Part (2). Training mechanism'. Together they form a unique fingerprint.

  • Cite this