Classification performance of thresholding methods in the Mahalanobis–Taguchi system
The Mahalanobis–Taguchi System (MTS) is a pattern recognition tool employing Maha-lanobis Distance (MD) and Taguchi Robust Engineering philosophy to explore and exploit data in multidimensional systems. The MD metric provides a measurement scale to classify classes of samples (Abnormal vs. Normal) a...
Saved in:
Main Authors: | , , , , , , |
---|---|
Format: | Article |
Published: |
MDPI AG
2021
|
Subjects: | |
Online Access: | http://eprints.utm.my/id/eprint/95196/ http://dx.doi.org/10.3390/app1109390 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.utm.95196 |
---|---|
record_format |
eprints |
spelling |
my.utm.951962022-04-29T22:24:58Z http://eprints.utm.my/id/eprint/95196/ Classification performance of thresholding methods in the Mahalanobis–Taguchi system Ramlie, Faizir Wan Muhamad, Wan Zuki Azman Harudin, Nolia Abu, Mohd. Yazid Yahaya, Haryanti Jamaludin, Khairur Rijal Abdul Talib, Hayati Habibah T Technology (General) The Mahalanobis–Taguchi System (MTS) is a pattern recognition tool employing Maha-lanobis Distance (MD) and Taguchi Robust Engineering philosophy to explore and exploit data in multidimensional systems. The MD metric provides a measurement scale to classify classes of samples (Abnormal vs. Normal) and gives an approach to measuring the level of severity between classes. An accurate classification result depends on a threshold value or a cut-off MD value that can effectively separate the two classes. Obtaining a reliable threshold value is very crucial. An inaccurate threshold value could lead to misclassification and eventually resulting in a misjudgment decision which in some cases caused fatal consequences. Thus, this paper compares the performance of the four most common thresholding methods reported in the literature in minimizing the misclas-sification problem of the MTS namely the Type I–Type II error method, the Probabilistic thresholding method, Receiver Operating Characteristics (ROC) curve method and the Box–Cox transformation method. The motivation of this work is to find the most appropriate thresholding method to be utilized in MTS methodology among the four common methods. The traditional way to obtain a threshold value in MTS is using Taguchi’s Quadratic Loss Function in which the threshold is obtained by minimizing the costs associated with misclassification decision. However, obtaining cost-related data is not easy since monetary related information is considered confidential in many cases. In this study, a total of 20 different datasets were used to evaluate the classification performances of the four different thresholding methods based on classification accuracy. The result indicates that none of the four thresholding methods outperformed one over the others in (if it is not for all) most of the datasets. Nevertheless, the study recommends the use of the Type I–Type II error method due to its less computational complexity as compared to the other three thresholding methods. MDPI AG 2021 Article PeerReviewed Ramlie, Faizir and Wan Muhamad, Wan Zuki Azman and Harudin, Nolia and Abu, Mohd. Yazid and Yahaya, Haryanti and Jamaludin, Khairur Rijal and Abdul Talib, Hayati Habibah (2021) Classification performance of thresholding methods in the Mahalanobis–Taguchi system. Applied Sciences (Switzerland), 11 (9). p. 3906. ISSN 2076-3417 http://dx.doi.org/10.3390/app1109390 |
institution |
Universiti Teknologi Malaysia |
building |
UTM Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Teknologi Malaysia |
content_source |
UTM Institutional Repository |
url_provider |
http://eprints.utm.my/ |
topic |
T Technology (General) |
spellingShingle |
T Technology (General) Ramlie, Faizir Wan Muhamad, Wan Zuki Azman Harudin, Nolia Abu, Mohd. Yazid Yahaya, Haryanti Jamaludin, Khairur Rijal Abdul Talib, Hayati Habibah Classification performance of thresholding methods in the Mahalanobis–Taguchi system |
description |
The Mahalanobis–Taguchi System (MTS) is a pattern recognition tool employing Maha-lanobis Distance (MD) and Taguchi Robust Engineering philosophy to explore and exploit data in multidimensional systems. The MD metric provides a measurement scale to classify classes of samples (Abnormal vs. Normal) and gives an approach to measuring the level of severity between classes. An accurate classification result depends on a threshold value or a cut-off MD value that can effectively separate the two classes. Obtaining a reliable threshold value is very crucial. An inaccurate threshold value could lead to misclassification and eventually resulting in a misjudgment decision which in some cases caused fatal consequences. Thus, this paper compares the performance of the four most common thresholding methods reported in the literature in minimizing the misclas-sification problem of the MTS namely the Type I–Type II error method, the Probabilistic thresholding method, Receiver Operating Characteristics (ROC) curve method and the Box–Cox transformation method. The motivation of this work is to find the most appropriate thresholding method to be utilized in MTS methodology among the four common methods. The traditional way to obtain a threshold value in MTS is using Taguchi’s Quadratic Loss Function in which the threshold is obtained by minimizing the costs associated with misclassification decision. However, obtaining cost-related data is not easy since monetary related information is considered confidential in many cases. In this study, a total of 20 different datasets were used to evaluate the classification performances of the four different thresholding methods based on classification accuracy. The result indicates that none of the four thresholding methods outperformed one over the others in (if it is not for all) most of the datasets. Nevertheless, the study recommends the use of the Type I–Type II error method due to its less computational complexity as compared to the other three thresholding methods. |
format |
Article |
author |
Ramlie, Faizir Wan Muhamad, Wan Zuki Azman Harudin, Nolia Abu, Mohd. Yazid Yahaya, Haryanti Jamaludin, Khairur Rijal Abdul Talib, Hayati Habibah |
author_facet |
Ramlie, Faizir Wan Muhamad, Wan Zuki Azman Harudin, Nolia Abu, Mohd. Yazid Yahaya, Haryanti Jamaludin, Khairur Rijal Abdul Talib, Hayati Habibah |
author_sort |
Ramlie, Faizir |
title |
Classification performance of thresholding methods in the Mahalanobis–Taguchi system |
title_short |
Classification performance of thresholding methods in the Mahalanobis–Taguchi system |
title_full |
Classification performance of thresholding methods in the Mahalanobis–Taguchi system |
title_fullStr |
Classification performance of thresholding methods in the Mahalanobis–Taguchi system |
title_full_unstemmed |
Classification performance of thresholding methods in the Mahalanobis–Taguchi system |
title_sort |
classification performance of thresholding methods in the mahalanobis–taguchi system |
publisher |
MDPI AG |
publishDate |
2021 |
url |
http://eprints.utm.my/id/eprint/95196/ http://dx.doi.org/10.3390/app1109390 |
_version_ |
1732945443819618304 |
score |
13.211869 |