Solving classification problem using ensemble binarization classifier

Binarization strategy is broadly applied in solving various multi-class classification problems. However, the classifier model learning complexity tends to increase when expanding the number of problems into several replicas. One-Versus-All (OVA) is one of the strategies which transforming the ordin...

Full description

Saved in:
Bibliographic Details
Main Authors: Zainudin, Muhammad Noorazlan Shah, Sulaiman, Md Nasir, Mustapha, Norwati, Perumal, Thinagaran, Mohamed, Raihani
Format: Article
Language:English
Published: Science Publishing Corporation 2018
Online Access:http://psasir.upm.edu.my/id/eprint/73936/1/Solving%20classification%20problem%20using%20ensemble%20binarization%20classifier.pdf
http://psasir.upm.edu.my/id/eprint/73936/
https://www.sciencepubco.com/index.php/ijet/article/view/23381
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Binarization strategy is broadly applied in solving various multi-class classification problems. However, the classifier model learning complexity tends to increase when expanding the number of problems into several replicas. One-Versus-All (OVA) is one of the strategies which transforming the ordinal multi-class classification problems into a series of two-class classification problems. The final output from each classifier model is combined in order to produce the final prediction. This binarization strategy has been proven as superior performance in accuracy than ordinal multi-class classifier model. However, learning model complexity (eg. Random Forest-RF ensemble decision trees) tends to increase when employing a large number of trees. Even though a large number of trees might produce a decent accuracy, generating time of the learning model is significantly longer. Hence, self-tuning tree parameter is introduced to tackle this matter. In such circumstances, a number of trees in the RF classifier are defined according to the number of class problem. In this paper, the OVA with self-tuning is evaluated based on parameter initialization in the context of RF ensemble decision tree. At the same time, the performance has also been compared with two classifier models such J48 and boosting for several well-known datasets.