Skip to main content

Research Repository

See what's under the surface

Ensemble selection based on classifier prediction confidence.

Nguyen, Tien Thanh; Luong, Anh Vu; Dang, Manh Truong; Liew, Alan Wee-Chung; McCall, John

Authors

Tien Thanh Nguyen

Anh Vu Luong

Manh Truong Dang

Alan Wee-Chung Liew

John McCall



Abstract

Ensemble selection is one of the most studied topics in ensemble learning because a selected subset of base classifiers may perform better than the whole ensemble system. In recent years, a great many ensemble selection methods have been introduced. However, many of these lack flexibility: either a fixed subset of classifiers is pre-selected for all test samples (static approach), or the selection of classifiers depends upon the performance of techniques that define the region of competence (dynamic approach). In this paper, we propose an ensemble selection method that takes into account each base classifier's confidence during classification and the overall credibility of the base classifier in the ensemble. In other words, a base classifier is selected to predict for a test sample if the confidence in its prediction is higher than its credibility threshold. The credibility thresholds of the base classifiers are found by minimizing the empirical 0-1 loss on the entire training observations. In this way, our approach integrates both the static and dynamic aspects of ensemble selection. Experiments on 62 datasets demonstrate that the proposed method achieves much better performance in comparison to some ensemble methods.

Journal Article Type Article
Publication Date Apr 30, 2020
Journal Pattern Recognition
Print ISSN 0031-3203
Publisher Elsevier
Peer Reviewed Peer Reviewed
Volume 100
Article Number 107104
Institution Citation NGUYEN, T.T., LUONG, A.V., DANG, M.T., LIEW, A.W.-C. and MCCALL, J. 2020. Ensemble selection based on classifier prediction confidence. Pattern recognition [online], 100, article ID 107104. Available from: https://doi.org/10.1016/j.patcog.2019.107104
DOI https://doi.org/10.1016/j.patcog.2019.107104
Keywords Ensemble method; Multiple classifier system; Ensemble selection; Classifier selection; Artificial bee colony

Files

This file is under embargo until Nov 5, 2020 due to copyright reasons.

Contact publications@rgu.ac.uk to request a copy for personal use.




Downloadable Citations