Research Repository

See what's under the surface

Simultaneous meta-data and meta-classifier selection in multiple classifier system.

Nguyen, Tien Thanh; Luong, Anh Vu; Nguyen, Thi Minh Van; Ha, Trong Sy; Liew, Alan Wee-Chung; McCall, John

Authors

Tien Thanh Nguyen

Anh Vu Luong

Thi Minh Van Nguyen

Trong Sy Ha

Alan Wee-Chung Liew

John McCall



Contributors

Manuel López-Ibáñez
Editor

Abstract

In ensemble systems, the predictions of base classifiers are aggregated by a combining algorithm (meta-classifier) to achieve better classification accuracy than using a single classifier. Experiments show that the performance of ensembles significantly depends on the choice of meta-classifier. Normally, the classifier selection method applied to an ensemble usually removes all the predictions of a classifier if this classifier is not selected in the final ensemble. Here we present an idea to only remove a subset of each classifier’s prediction thereby introducing a simultaneous meta-data and meta-classifier selection method for ensemble systems. Our approach uses Cross Validation on the training set to generate meta-data as the predictions of base classifiers. We then use Ant Colony Optimization to search for the optimal subset of meta-data and meta-classifier for the data. By considering each column of meta-data, we construct the configuration including a subset of these columns and a meta-classifier. Specifically, the columns are selected according to their corresponding pheromones, and the meta-classifier is chosen at random. The classification accuracy of each configuration is computed based on Cross Validation on meta-data. Experiments on UCI datasets show the advantage of proposed method compared to several classifier and feature selection methods for ensemble systems.

Start Date Jul 13, 2019
Publication Date Jul 13, 2019
Publisher Association for Computing Machinery
Pages 39-46
Book Title Proceedings of the 2019 Genetic and evolutionary computation conference (GECCO '19)
ISBN 9781450361118
Institution Citation NGUYEN, T.T., LUONG, A.V., NGUYEN, T.M.V., HA, T.S., LIEW, A.W.-C. and MCCALL, J. 2019. Simultaneous meta-data and meta-classifier selection in multiple classifier system. In López-Ibáñez, M. (ed.) Proceedings of the 2019 Genetic and evolutionary computation conference (GECCO ’19), 13-17 July 2019, Prague, Czech Republic. New York: ACM [online], pages 39-46. Available from: https://doi.org/10.1145/3321707.3321770
DOI https://doi.org/10.1145/3321707.3321770
Keywords Ensemble method; Multiple classifiers; Classifier fusion; Combining classifiers; Ensemble selection; Classifier selection; Feature selection; Ant colony optimization

Files





Downloadable Citations