Dr Thanh Nguyen t.nguyen11@rgu.ac.uk
Senior Research Fellow
Ensemble selection based on classifier prediction confidence.
Nguyen, Tien Thanh; Luong, Anh Vu; Dang, Manh Truong; Liew, Alan Wee-Chung; McCall, John
Authors
Anh Vu Luong
Manh Truong Dang
Alan Wee-Chung Liew
Professor John McCall j.mccall@rgu.ac.uk
Director
Abstract
Ensemble selection is one of the most studied topics in ensemble learning because a selected subset of base classifiers may perform better than the whole ensemble system. In recent years, a great many ensemble selection methods have been introduced. However, many of these lack flexibility: either a fixed subset of classifiers is pre-selected for all test samples (static approach), or the selection of classifiers depends upon the performance of techniques that define the region of competence (dynamic approach). In this paper, we propose an ensemble selection method that takes into account each base classifier's confidence during classification and the overall credibility of the base classifier in the ensemble. In other words, a base classifier is selected to predict for a test sample if the confidence in its prediction is higher than its credibility threshold. The credibility thresholds of the base classifiers are found by minimizing the empirical 0-1 loss on the entire training observations. In this way, our approach integrates both the static and dynamic aspects of ensemble selection. Experiments on 62 datasets demonstrate that the proposed method achieves much better performance in comparison to some ensemble methods.
Citation
NGUYEN, T.T., LUONG, A.V., DANG, M.T., LIEW, A.W.-C. and MCCALL, J. 2020. Ensemble selection based on classifier prediction confidence. Pattern recognition [online], 100, article ID 107104. Available from: https://doi.org/10.1016/j.patcog.2019.107104
Journal Article Type | Article |
---|---|
Acceptance Date | Nov 3, 2019 |
Online Publication Date | Nov 4, 2019 |
Publication Date | Apr 30, 2020 |
Deposit Date | Nov 8, 2019 |
Publicly Available Date | Nov 5, 2020 |
Journal | Pattern recognition |
Print ISSN | 0031-3203 |
Electronic ISSN | 1873-5142 |
Publisher | Elsevier |
Peer Reviewed | Peer Reviewed |
Volume | 100 |
Article Number | 107104 |
DOI | https://doi.org/10.1016/j.patcog.2019.107104 |
Keywords | Ensemble method; Multiple classifier system; Ensemble selection; Classifier selection; Artificial bee colony |
Public URL | https://rgu-repository.worktribe.com/output/744295 |
Files
NGUYEN 2020 Ensemble selection
(2.7 Mb)
PDF
Publisher Licence URL
https://creativecommons.org/licenses/by-nc-nd/4.0/
You might also like
Two-layer ensemble of deep learning models for medical image segmentation. [Article]
(2024)
Journal Article
A weighted ensemble of regression methods for gross error identification problem.
(2023)
Conference Proceeding
A comparative study of anomaly detection methods for gross error detection problems.
(2023)
Journal Article
Ensemble of deep learning models with surrogate-based optimization for medical image segmentation.
(2022)
Conference Proceeding
Downloadable Citations
About OpenAIR@RGU
Administrator e-mail: publications@rgu.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search