Estimating hidden unit number for two-layer perceptrons

Mario Gutierrez, Jennifer Wang, Robert Grondin

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    25 Scopus citations

    Abstract

    The authors concentrate on estimating how many hidden units are needed for large nets. The design method is adapted from a more rigorous one developed for smaller nets where all possible input/output relationships are presented in the training vectors. It provides a 'ballpark' estimate of the minimum number of hidden units required by a two-layer perceptron for a provided training subset of the possible input/output pairs. Typically, the number of hidden units is slightly overestimated in this approach. To obtain an estimate of the number of hidden units for a fully connected net with n output units, it is necessary to obtain an estimate of the number of conflicts contained in the individual binary responses that must be learned by each ouput unit. The estimate produced is data dependent, as the number of conflicts for an output unit depends on the specific responses of the output unit to the input vectors contained in the training set.

    Original languageEnglish (US)
    Title of host publicationIJCNN Int Jt Conf Neural Network
    Editors Anon
    Place of PublicationPiscataway, NJ, United States
    PublisherPubl by IEEE
    Pages677-681
    Number of pages5
    StatePublished - 1989
    EventIJCNN International Joint Conference on Neural Networks - Washington, DC, USA
    Duration: Jun 18 1989Jun 22 1989

    Other

    OtherIJCNN International Joint Conference on Neural Networks
    CityWashington, DC, USA
    Period6/18/896/22/89

      Fingerprint

    ASJC Scopus subject areas

    • Engineering(all)

    Cite this

    Gutierrez, M., Wang, J., & Grondin, R. (1989). Estimating hidden unit number for two-layer perceptrons. In Anon (Ed.), IJCNN Int Jt Conf Neural Network (pp. 677-681). Publ by IEEE.