Skip to main content

Research Repository

Advanced Search

Simultaneous meta-data and meta-classifier selection in multiple classifier system.

Nguyen, Tien Thanh; Luong, Anh Vu; Nguyen, Thi Minh Van; Ha, Trong Sy; Liew, Alan Wee-Chung; McCall, John

Authors

Anh Vu Luong

Thi Minh Van Nguyen

Trong Sy Ha

Alan Wee-Chung Liew



Contributors

Manuel L�pez-Ib��ez
Editor

Abstract

In ensemble systems, the predictions of base classifiers are aggregated by a combining algorithm (meta-classifier) to achieve better classification accuracy than using a single classifier. Experiments show that the performance of ensembles significantly depends on the choice of meta-classifier. Normally, the classifier selection method applied to an ensemble usually removes all the predictions of a classifier if this classifier is not selected in the final ensemble. Here we present an idea to only remove a subset of each classifier’s prediction thereby introducing a simultaneous meta-data and meta-classifier selection method for ensemble systems. Our approach uses Cross Validation on the training set to generate meta-data as the predictions of base classifiers. We then use Ant Colony Optimization to search for the optimal subset of meta-data and meta-classifier for the data. By considering each column of meta-data, we construct the configuration including a subset of these columns and a meta-classifier. Specifically, the columns are selected according to their corresponding pheromones, and the meta-classifier is chosen at random. The classification accuracy of each configuration is computed based on Cross Validation on meta-data. Experiments on UCI datasets show the advantage of proposed method compared to several classifier and feature selection methods for ensemble systems.

Citation

NGUYEN, T.T., LUONG, A.V., NGUYEN, T.M.V., HA, T.S., LIEW, A.W.-C. and MCCALL, J. 2019. Simultaneous meta-data and meta-classifier selection in multiple classifier system. In López-Ibáñez, M. (ed.) Proceedings of the 2019 Genetic and evolutionary computation conference (GECCO ’19), 13-17 July 2019, Prague, Czech Republic. New York: ACM [online], pages 39-46. Available from: https://doi.org/10.1145/3321707.3321770

Conference Name 2019 Genetic and evolutionary computation conference (GECCO '19)
Conference Location Prague, Czech Republic
Start Date Jul 13, 2019
End Date Jul 17, 2019
Acceptance Date Feb 6, 2019
Online Publication Date Jul 13, 2019
Publication Date Jul 13, 2019
Deposit Date Jul 18, 2019
Publicly Available Date Mar 28, 2024
Publisher Association for Computing Machinery (ACM)
Pages 39-46
Book Title Proceedings of the 2019 Genetic and evolutionary computation conference (GECCO '19)
ISBN 9781450361118
DOI https://doi.org/10.1145/3321707.3321770
Keywords Ensemble method; Multiple classifiers; Classifier fusion; Combining classifiers; Ensemble selection; Classifier selection; Feature selection; Ant colony optimization
Public URL https://rgu-repository.worktribe.com/output/322649

Files




You might also like



Downloadable Citations