Combining heterogeneous classifiers via granular prototypes.

Nguyen, Tien Thanh; Nguyen, Mai Phuong; Pham, Xuan Cuong; Liew, Alan Wee-Chung; Pedrycz, Witold

Abstract

In this study, a novel framework to combine multiple classifiers in an ensemble system is introduced. Here we exploit the concept of information granule to construct granular prototypes for each class on the outputs of an ensemble of base classifiers. In the proposed method, uncertainty in the outputs of the base classifiers on training observations is captured by an interval-based representation. To predict the class label for a new observation, we first determine the distances between the output of the base classifiers for this observation and the class prototypes, then the predicted class label is obtained by choosing the label associated with the shortest distance. In the experimental study, we combine several learning algorithms to build the ensemble system and conduct experiments on the UCI, colon cancer, and selected CLEF2009 datasets. The experimental results demonstrate that the proposed framework outperforms several benchmarked algorithms including two trainable combining methods, i.e., Decision Template and Two Stages Ensemble System, AdaBoost, Random Forest, L2-loss Linear Support Vector Machine, and Decision Tree.

Citation

NGUYEN, T.T., NGUYEN, M.P., PHAM, X.C., LIEW, A. W.-C. and PEDRYCZ, W. 2018. Combining heterogeneous classifiers via granular prototypes. Applied soft computing [online], 73, pages 795-815. Available from: https://doi.org/10.1016/j.asoc.2018.09.021

• Journal Article Type: Article
• Acceptance Date: Sep 13, 2018
• Online Publication Date: Sep 28, 2018
• Publication Date: Dec 31, 2018
• Deposit Date: Oct 4, 2018
• Publicly Available Date: Sep 29, 2019
• Journal: Applied Soft Computing
• Print ISSN: 1568-4946
• Electronic ISSN: 1872-9681
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 73
• Pages: 795-815
• DOI: https://doi.org/10.1016/j.asoc.2018.09.021
• Keywords: Ensemble method; Multiple classifiers system; Information granule; Information uncertainty; Supervised learning
• Public URL: http://hdl.handle.net/10059/3160