Entropy learning in neural network
In this paper, entropy term is used in the learning phase of a neural network. As learning progresses, more hidden nodes get into saturation. The early creation of such hidden nodes may impair generalisation. Hence entropy approach is proposed to dampen the early creation of such nodes. The entropy...
Saved in:
Main Authors: | Geok, See Ng, Shi, Daming, Abdul Rahman, Abdul Wahab, Singh, H. |
---|---|
Format: | Article |
Language: | English |
Published: |
ASEAN Committee on Science and Technology
2003
|
Subjects: | |
Online Access: | http://irep.iium.edu.my/38199/1/ENTROPY_LEARNING_IN_NEURAL_NETWORK.pdf http://irep.iium.edu.my/38199/ http://astnet.asean.org/index.php?name=Main&file=content&cid=32 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
-
Entropy learning and relevance criteria for neural network pruning
by: Geok, See Ng, et al.
Published: (2003) -
EEG based detection of alcoholics using spectral entropy with neural network classifiers
by: Padma Shri, T. K., et al.
Published: (2012) -
Application of EFUNN for the classification of handwritten digits
by: Geok, See Ng, et al.
Published: (2004) -
Feature extraction for neural-fuzzy inference system
by: Quek, Chai, et al.
Published: (2003) -
Computation of approximate entropy and sample entropy for characterization of respiratory diseases
by: Alexie, Mushikiwabeza, et al.
Published: (2023)