Classification performance of thresholding methods in the Mahalanobis–Taguchi system

The Mahalanobis–Taguchi System (MTS) is a pattern recognition tool employing Maha-lanobis Distance (MD) and Taguchi Robust Engineering philosophy to explore and exploit data in multidimensional systems. The MD metric provides a measurement scale to classify classes of samples (Abnormal vs. Normal) a...

Full description

Saved in:
Bibliographic Details
Main Authors: Ramlie, Faizir, Wan Muhamad, Wan Zuki Azman, Harudin, Nolia, Abu, Mohd. Yazid, Yahaya, Haryanti, Jamaludin, Khairur Rijal, Abdul Talib, Hayati Habibah
Format: Article
Published: MDPI AG 2021
Subjects:
Online Access:http://eprints.utm.my/id/eprint/95196/
http://dx.doi.org/10.3390/app1109390
Tags: Add Tag
No Tags, Be the first to tag this record!
id my.utm.95196
record_format eprints
spelling my.utm.951962022-04-29T22:24:58Z http://eprints.utm.my/id/eprint/95196/ Classification performance of thresholding methods in the Mahalanobis–Taguchi system Ramlie, Faizir Wan Muhamad, Wan Zuki Azman Harudin, Nolia Abu, Mohd. Yazid Yahaya, Haryanti Jamaludin, Khairur Rijal Abdul Talib, Hayati Habibah T Technology (General) The Mahalanobis–Taguchi System (MTS) is a pattern recognition tool employing Maha-lanobis Distance (MD) and Taguchi Robust Engineering philosophy to explore and exploit data in multidimensional systems. The MD metric provides a measurement scale to classify classes of samples (Abnormal vs. Normal) and gives an approach to measuring the level of severity between classes. An accurate classification result depends on a threshold value or a cut-off MD value that can effectively separate the two classes. Obtaining a reliable threshold value is very crucial. An inaccurate threshold value could lead to misclassification and eventually resulting in a misjudgment decision which in some cases caused fatal consequences. Thus, this paper compares the performance of the four most common thresholding methods reported in the literature in minimizing the misclas-sification problem of the MTS namely the Type I–Type II error method, the Probabilistic thresholding method, Receiver Operating Characteristics (ROC) curve method and the Box–Cox transformation method. The motivation of this work is to find the most appropriate thresholding method to be utilized in MTS methodology among the four common methods. The traditional way to obtain a threshold value in MTS is using Taguchi’s Quadratic Loss Function in which the threshold is obtained by minimizing the costs associated with misclassification decision. However, obtaining cost-related data is not easy since monetary related information is considered confidential in many cases. In this study, a total of 20 different datasets were used to evaluate the classification performances of the four different thresholding methods based on classification accuracy. The result indicates that none of the four thresholding methods outperformed one over the others in (if it is not for all) most of the datasets. Nevertheless, the study recommends the use of the Type I–Type II error method due to its less computational complexity as compared to the other three thresholding methods. MDPI AG 2021 Article PeerReviewed Ramlie, Faizir and Wan Muhamad, Wan Zuki Azman and Harudin, Nolia and Abu, Mohd. Yazid and Yahaya, Haryanti and Jamaludin, Khairur Rijal and Abdul Talib, Hayati Habibah (2021) Classification performance of thresholding methods in the Mahalanobis–Taguchi system. Applied Sciences (Switzerland), 11 (9). p. 3906. ISSN 2076-3417 http://dx.doi.org/10.3390/app1109390
institution Universiti Teknologi Malaysia
building UTM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknologi Malaysia
content_source UTM Institutional Repository
url_provider http://eprints.utm.my/
topic T Technology (General)
spellingShingle T Technology (General)
Ramlie, Faizir
Wan Muhamad, Wan Zuki Azman
Harudin, Nolia
Abu, Mohd. Yazid
Yahaya, Haryanti
Jamaludin, Khairur Rijal
Abdul Talib, Hayati Habibah
Classification performance of thresholding methods in the Mahalanobis–Taguchi system
description The Mahalanobis–Taguchi System (MTS) is a pattern recognition tool employing Maha-lanobis Distance (MD) and Taguchi Robust Engineering philosophy to explore and exploit data in multidimensional systems. The MD metric provides a measurement scale to classify classes of samples (Abnormal vs. Normal) and gives an approach to measuring the level of severity between classes. An accurate classification result depends on a threshold value or a cut-off MD value that can effectively separate the two classes. Obtaining a reliable threshold value is very crucial. An inaccurate threshold value could lead to misclassification and eventually resulting in a misjudgment decision which in some cases caused fatal consequences. Thus, this paper compares the performance of the four most common thresholding methods reported in the literature in minimizing the misclas-sification problem of the MTS namely the Type I–Type II error method, the Probabilistic thresholding method, Receiver Operating Characteristics (ROC) curve method and the Box–Cox transformation method. The motivation of this work is to find the most appropriate thresholding method to be utilized in MTS methodology among the four common methods. The traditional way to obtain a threshold value in MTS is using Taguchi’s Quadratic Loss Function in which the threshold is obtained by minimizing the costs associated with misclassification decision. However, obtaining cost-related data is not easy since monetary related information is considered confidential in many cases. In this study, a total of 20 different datasets were used to evaluate the classification performances of the four different thresholding methods based on classification accuracy. The result indicates that none of the four thresholding methods outperformed one over the others in (if it is not for all) most of the datasets. Nevertheless, the study recommends the use of the Type I–Type II error method due to its less computational complexity as compared to the other three thresholding methods.
format Article
author Ramlie, Faizir
Wan Muhamad, Wan Zuki Azman
Harudin, Nolia
Abu, Mohd. Yazid
Yahaya, Haryanti
Jamaludin, Khairur Rijal
Abdul Talib, Hayati Habibah
author_facet Ramlie, Faizir
Wan Muhamad, Wan Zuki Azman
Harudin, Nolia
Abu, Mohd. Yazid
Yahaya, Haryanti
Jamaludin, Khairur Rijal
Abdul Talib, Hayati Habibah
author_sort Ramlie, Faizir
title Classification performance of thresholding methods in the Mahalanobis–Taguchi system
title_short Classification performance of thresholding methods in the Mahalanobis–Taguchi system
title_full Classification performance of thresholding methods in the Mahalanobis–Taguchi system
title_fullStr Classification performance of thresholding methods in the Mahalanobis–Taguchi system
title_full_unstemmed Classification performance of thresholding methods in the Mahalanobis–Taguchi system
title_sort classification performance of thresholding methods in the mahalanobis–taguchi system
publisher MDPI AG
publishDate 2021
url http://eprints.utm.my/id/eprint/95196/
http://dx.doi.org/10.3390/app1109390
_version_ 1732945443819618304
score 13.211869