Training process reduction based on potential weights linear analysis to accelerate back propagation network.
Learning is the important property of Back Propagation Network (BPN) and finding the suitable weights and thresholds during training in order to improve training time as well as achieve high accuracy. Currently, data pre-processing such as dimension reduction input values and pre-training are the c...
Saved in:
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English English |
Published: |
IJCSIS Press
2009
|
Online Access: | http://psasir.upm.edu.my/id/eprint/17465/1/Training%20process%20reduction%20based%20on%20potential%20weights%20linear%20analysis%20to%20accelerate%20back%20propagation%20network.pdf http://psasir.upm.edu.my/id/eprint/17465/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.upm.eprints.17465 |
---|---|
record_format |
eprints |
spelling |
my.upm.eprints.174652015-11-16T01:17:45Z http://psasir.upm.edu.my/id/eprint/17465/ Training process reduction based on potential weights linear analysis to accelerate back propagation network. Asadi, Roya Mustapha, Norwati Sulaiman, Md. Nasir Learning is the important property of Back Propagation Network (BPN) and finding the suitable weights and thresholds during training in order to improve training time as well as achieve high accuracy. Currently, data pre-processing such as dimension reduction input values and pre-training are the contributing factors in developing efficient techniques for reducing training time with high accuracy and initialization of the weights is the important issue which is random and creates paradox, and leads to low accuracy with high training time. One good data preprocessing technique for accelerating BPN classification is dimension reduction technique but it has problem of missing data. In this paper, we study current pre-training techniques and new preprocessing technique called Potential Weight Linear Analysis (PWLA) which combines normalization, dimension reduction input values and pre-training. In PWLA, the first data preprocessing is performed for generating normalized input values and then applying them by pre-training technique in order to obtain the potential weights. After these phases, dimension of input values matrix will be reduced by using real potential weights. For experiment results XOR problem and three datasets, which are SPECT Heart, SPECTF Heart and Liver disorders (BUPA) will be evaluated. Our results, however, will show that the new technique of PWLA will change BPN to new Supervised Multi Layer Feed Forward Neural Network (SMFFNN) model with high accuracy in one epoch without training cycle. Also PWLA will be able to have power of non linear supervised and unsupervised dimension reduction property for applying by other supervised multi layer feed forward neural network model in future work. IJCSIS Press 2009-07 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/17465/1/Training%20process%20reduction%20based%20on%20potential%20weights%20linear%20analysis%20to%20accelerate%20back%20propagation%20network.pdf Asadi, Roya and Mustapha, Norwati and Sulaiman, Md. Nasir (2009) Training process reduction based on potential weights linear analysis to accelerate back propagation network. International Journal of Computer Science and Information Security, 3 (1). pp. 229-239. ISSN 1947-5500 English |
institution |
Universiti Putra Malaysia |
building |
UPM Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Putra Malaysia |
content_source |
UPM Institutional Repository |
url_provider |
http://psasir.upm.edu.my/ |
language |
English English |
description |
Learning is the important property of Back Propagation Network (BPN) and finding the suitable weights and
thresholds during training in order to improve training time as well as achieve high accuracy. Currently, data pre-processing such as dimension reduction input values and pre-training are the contributing factors in developing efficient techniques for reducing training time with high accuracy and initialization of the weights is the important issue which is random and creates paradox, and leads to low accuracy with high training time. One good data preprocessing technique for accelerating BPN classification is dimension reduction technique but it has problem
of missing data. In this paper, we study current pre-training techniques and new preprocessing technique called Potential Weight Linear Analysis (PWLA) which combines normalization, dimension reduction input values and pre-training. In PWLA, the first data preprocessing is performed for generating normalized input values and then applying them by pre-training technique in order to obtain the potential weights. After these phases, dimension of input values matrix will be reduced by using real potential weights. For experiment results XOR problem and three datasets, which are SPECT Heart, SPECTF Heart and
Liver disorders (BUPA) will be evaluated. Our results, however, will show that the new technique of PWLA will change BPN to new Supervised Multi Layer Feed Forward Neural Network (SMFFNN) model with high accuracy in one epoch without training cycle. Also PWLA will be able to have power of non linear supervised and unsupervised dimension reduction property for applying by other supervised multi layer feed forward neural network model in future work. |
format |
Article |
author |
Asadi, Roya Mustapha, Norwati Sulaiman, Md. Nasir |
spellingShingle |
Asadi, Roya Mustapha, Norwati Sulaiman, Md. Nasir Training process reduction based on potential weights linear analysis to accelerate back propagation network. |
author_facet |
Asadi, Roya Mustapha, Norwati Sulaiman, Md. Nasir |
author_sort |
Asadi, Roya |
title |
Training process reduction based on potential weights linear analysis to accelerate back propagation network. |
title_short |
Training process reduction based on potential weights linear analysis to accelerate back propagation network. |
title_full |
Training process reduction based on potential weights linear analysis to accelerate back propagation network. |
title_fullStr |
Training process reduction based on potential weights linear analysis to accelerate back propagation network. |
title_full_unstemmed |
Training process reduction based on potential weights linear analysis to accelerate back propagation network. |
title_sort |
training process reduction based on potential weights linear analysis to accelerate back propagation network. |
publisher |
IJCSIS Press |
publishDate |
2009 |
url |
http://psasir.upm.edu.my/id/eprint/17465/1/Training%20process%20reduction%20based%20on%20potential%20weights%20linear%20analysis%20to%20accelerate%20back%20propagation%20network.pdf http://psasir.upm.edu.my/id/eprint/17465/ |
_version_ |
1643826525042114560 |
score |
13.211869 |