Simultaneous meta-data and meta-classifier selection in multiple classifier system.

Nguyen, Tien Thanh; Luong, Anh Vu; Nguyen, Thi Minh Van; Ha, Trong Sy; Liew, Alan Wee-Chung; McCall, John

Abstract

In ensemble systems, the predictions of base classifiers are aggregated by a combining algorithm (meta-classifier) to achieve better classification accuracy than using a single classifier. Experiments show that the performance of ensembles significantly depends on the choice of meta-classifier. Normally, the classifier selection method applied to an ensemble usually removes all the predictions of a classifier if this classifier is not selected in the final ensemble. Here we present an idea to only remove a subset of each classifier’s prediction thereby introducing a simultaneous meta-data and meta-classifier selection method for ensemble systems. Our approach uses Cross Validation on the training set to generate meta-data as the predictions of base classifiers. We then use Ant Colony Optimization to search for the optimal subset of meta-data and meta-classifier for the data. By considering each column of meta-data, we construct the configuration including a subset of these columns and a meta-classifier. Specifically, the columns are selected according to their corresponding pheromones, and the meta-classifier is chosen at random. The classification accuracy of each configuration is computed based on Cross Validation on meta-data. Experiments on UCI datasets show the advantage of proposed method compared to several classifier and feature selection methods for ensemble systems.

Citation

NGUYEN, T.T., LUONG, A.V., NGUYEN, T.M.V., HA, T.S., LIEW, A.W.-C. and MCCALL, J. 2019. Simultaneous meta-data and meta-classifier selection in multiple classifier system. In López-Ibáñez, M. (ed.) Proceedings of the 2019 Genetic and evolutionary computation conference (GECCO ’19), 13-17 July 2019, Prague, Czech Republic. New York: ACM [online], pages 39-46. Available from: https://doi.org/10.1145/3321707.3321770

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 2019 Genetic and evolutionary computation conference (GECCO '19)
• Start Date: Jul 13, 2019
• End Date: Jul 17, 2019
• Acceptance Date: Feb 6, 2019
• Online Publication Date: Jul 13, 2019
• Publication Date: Jul 13, 2019
• Deposit Date: Jul 18, 2019
• Publicly Available Date: Jul 18, 2019
• Publisher: Association for Computing Machinery (ACM)
• Peer Reviewed: Peer Reviewed
• Pages: 39-46
• Book Title: Proceedings of the 2019 Genetic and evolutionary computation conference (GECCO '19)
• ISBN: 9781450361118
• DOI: https://doi.org/10.1145/3321707.3321770
• Keywords: Ensemble method; Multiple classifiers; Classifier fusion; Combining classifiers; Ensemble selection; Classifier selection; Feature selection; Ant colony optimization
• Public URL: https://rgu-repository.worktribe.com/output/322649
• Contract Date: Jul 18, 2019