A weighted multiple classifier framework based on random projection.

Nguyen, Tien Thanh; Dang, Manh Truong; Liew, Alan Wee-Chung; Bezdek, James C.

Abstract

In this paper, we propose a weighted multiple classifier framework based on random projections. Similar to the mechanism of other homogeneous ensemble methods, the base classifiers in our approach are obtained by a learning algorithm on different training sets generated by projecting the original up-space training set to lower dimensional down-spaces. We then apply a Least SquarE−based method to weigh the outputs of the base classifiers so that the contribution of each classifier to the final combined prediction is different. We choose Decision Tree as the learning algorithm in the proposed framework and conduct experiments on a number of real and synthetic datasets. The experimental results indicate that our framework is better than many of the benchmark algorithms, including three homogeneous ensemble methods (Bagging, RotBoost, and Random Subspace), several well-known algorithms (Decision Tree, Random Neural Network, Linear Discriminative Analysis, K Nearest Neighbor, L2-loss Linear Support Vector Machine, and Discriminative Restricted Boltzmann Machine), and random projection-based ensembles with fixed combining rules with regard to both classification error rates and F1 scores.

Citation

NGUYEN, T.T., DANG, M.T., LIEW, A. W.-C. and BEZDEK, J.C. 2019. A weighted multiple classifier framework based on random projection. Information science [online], 490, pages 36-58. Available from: https://doi.org/10.1016/j.ins.2019.03.067

• Journal Article Type: Article
• Acceptance Date: Mar 25, 2019
• Online Publication Date: Mar 26, 2019
• Publication Date: Jul 31, 2019
• Deposit Date: Apr 23, 2019
• Publicly Available Date: Mar 27, 2020
• Journal: Information Sciences
• Print ISSN: 0020-0255
• Electronic ISSN: 1872-6291
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 490
• Pages: 36-58
• DOI: https://doi.org/10.1016/j.ins.2019.03.067
• Keywords: Ensemble method; Random projection; Multiple classifier system; Weighted multiple classifier
• Public URL: https://rgu-repository.worktribe.com/output/238181
• Contract Date: Apr 23, 2019