The Impact of Normalization Techniques on Performance Backpropagation Networks
Neural networks (NN) are computational models with the capacity to learn, generalize and the most used are multi- layer perceptrons (MLP). Building successful NN applications depends on several aspects such as the process of acquiring, modeling and selecting the appropriate model. The data needs t...
Saved in:
| Main Author: | |
|---|---|
| Format: | Thesis |
| Language: | en en |
| Published: |
2004
|
| Subjects: | |
| Online Access: | https://etd.uum.edu.my/1394/1/NORLIDA_BT._HASSAN.pdf https://etd.uum.edu.my/1394/2/1.NORLIDA_BT._HASSAN.pdf https://etd.uum.edu.my/1394/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1833435649670119424 |
|---|---|
| author | Norlida, Hassan |
| author_facet | Norlida, Hassan |
| author_sort | Norlida, Hassan |
| building | UUM Library |
| collection | Institutional Repository |
| content_provider | Universiti Utara Malaysia |
| content_source | UUM Electronic Theses |
| continent | Asia |
| country | Malaysia |
| description | Neural networks (NN) are computational models with the capacity to learn, generalize and the most used are multi- layer perceptrons (MLP). Building successful NN applications depends on several aspects such as the process of acquiring, modeling and selecting the appropriate model. The data needs to be transformed into a form that is acceptable as input to the MLP network. The transform data often determines the efficiency and possibly the accuracy of result from the network. This study explored several normalization techniques using backpropagation learning. The normalization techniques used in the experiments are Min-Max, Z-Score, Decimal Scaling, Sigmoidal, and Softmax or Logistic technique. To explore the impact of normalization technique on the performance on NN, medical datasets with Boolean target were preprocessed, trained, validated and tested using backpropagation learning algorithm. The criterion of choosing the best model is based on the highest percentage of correct prediction. Three preprocessing phase of building the NN models. The results of each normalization techniques are presented and compared with statistical approach. The results reveal that the utilization of different normalization techniques produces different NN performance. The experiments also indicate that all five normalization techniques of logistic regression achieve lower percentage of correct prediction than the results produced using NN. The findings will not only contribute towards enhancing the performance of backpropagation nets but it will also assist in making decision to the choice of normalization techniques to be applied to a particular dataset. |
| format | Thesis |
| id | my.uum.etd-1394 |
| institution | Universiti Utara Malaysia |
| language | en en |
| publishDate | 2004 |
| record_format | eprints |
| spelling | my.uum.etd-13942013-07-24T12:11:46Z https://etd.uum.edu.my/1394/ The Impact of Normalization Techniques on Performance Backpropagation Networks Norlida, Hassan QA76 Computer software Neural networks (NN) are computational models with the capacity to learn, generalize and the most used are multi- layer perceptrons (MLP). Building successful NN applications depends on several aspects such as the process of acquiring, modeling and selecting the appropriate model. The data needs to be transformed into a form that is acceptable as input to the MLP network. The transform data often determines the efficiency and possibly the accuracy of result from the network. This study explored several normalization techniques using backpropagation learning. The normalization techniques used in the experiments are Min-Max, Z-Score, Decimal Scaling, Sigmoidal, and Softmax or Logistic technique. To explore the impact of normalization technique on the performance on NN, medical datasets with Boolean target were preprocessed, trained, validated and tested using backpropagation learning algorithm. The criterion of choosing the best model is based on the highest percentage of correct prediction. Three preprocessing phase of building the NN models. The results of each normalization techniques are presented and compared with statistical approach. The results reveal that the utilization of different normalization techniques produces different NN performance. The experiments also indicate that all five normalization techniques of logistic regression achieve lower percentage of correct prediction than the results produced using NN. The findings will not only contribute towards enhancing the performance of backpropagation nets but it will also assist in making decision to the choice of normalization techniques to be applied to a particular dataset. 2004 Thesis NonPeerReviewed application/pdf en https://etd.uum.edu.my/1394/1/NORLIDA_BT._HASSAN.pdf application/pdf en https://etd.uum.edu.my/1394/2/1.NORLIDA_BT._HASSAN.pdf Norlida, Hassan (2004) The Impact of Normalization Techniques on Performance Backpropagation Networks. Masters thesis, Universiti Utara Malaysia. |
| spellingShingle | QA76 Computer software Norlida, Hassan The Impact of Normalization Techniques on Performance Backpropagation Networks |
| title | The Impact of Normalization Techniques on Performance Backpropagation Networks |
| title_full | The Impact of Normalization Techniques on Performance Backpropagation Networks |
| title_fullStr | The Impact of Normalization Techniques on Performance Backpropagation Networks |
| title_full_unstemmed | The Impact of Normalization Techniques on Performance Backpropagation Networks |
| title_short | The Impact of Normalization Techniques on Performance Backpropagation Networks |
| title_sort | impact of normalization techniques on performance backpropagation networks |
| topic | QA76 Computer software |
| url | https://etd.uum.edu.my/1394/1/NORLIDA_BT._HASSAN.pdf https://etd.uum.edu.my/1394/2/1.NORLIDA_BT._HASSAN.pdf https://etd.uum.edu.my/1394/ |
| url_provider | http://etd.uum.edu.my/ |