Skip to main content

Research Repository

Advanced Search

A weighted multiple classifier framework based on random projection.

Nguyen, Tien Thanh; Dang, Manh Truong; Liew, Alan Wee-Chung; Bezdek, James C.


Manh Truong Dang

Alan Wee-Chung Liew

James C. Bezdek


In this paper, we propose a weighted multiple classifier framework based on random projections. Similar to the mechanism of other homogeneous ensemble methods, the base classifiers in our approach are obtained by a learning algorithm on different training sets generated by projecting the original up-space training set to lower dimensional down-spaces. We then apply a Least SquarE−based method to weigh the outputs of the base classifiers so that the contribution of each classifier to the final combined prediction is different. We choose Decision Tree as the learning algorithm in the proposed framework and conduct experiments on a number of real and synthetic datasets. The experimental results indicate that our framework is better than many of the benchmark algorithms, including three homogeneous ensemble methods (Bagging, RotBoost, and Random Subspace), several well-known algorithms (Decision Tree, Random Neural Network, Linear Discriminative Analysis, K Nearest Neighbor, L2-loss Linear Support Vector Machine, and Discriminative Restricted Boltzmann Machine), and random projection-based ensembles with fixed combining rules with regard to both classification error rates and F1 scores.


NGUYEN, T.T., DANG, M.T., LIEW, A. W.-C. and BEZDEK, J.C. 2019. A weighted multiple classifier framework based on random projection. Information science [online], 490, pages 36-58. Available from:

Journal Article Type Article
Acceptance Date Mar 25, 2019
Online Publication Date Mar 26, 2019
Publication Date Jul 31, 2019
Deposit Date Apr 23, 2019
Publicly Available Date Mar 27, 2020
Journal Information Sciences
Print ISSN 0020-0255
Electronic ISSN 1872-6291
Publisher Elsevier
Peer Reviewed Peer Reviewed
Volume 490
Pages 36-58
Keywords Ensemble method; Random projection; Multiple classifier system; Weighted multiple classifier
Public URL


You might also like

Downloadable Citations