Research Repository

See what's under the surface

A weighted multiple classifier framework based on random projection.

Nguyen, Tien Thanh; Dang, Manh Truong; Liew, Alan Wee-Chung; Bezdek, James C.

Authors

Tien Thanh Nguyen

Manh Truong Dang

Alan Wee-Chung Liew

James C. Bezdek

Abstract

In this paper, we propose a weighted multiple classifier framework based on random projections. Similar to the mechanism of other homogeneous ensemble methods, the base classifiers in our approach are obtained by a learning algorithm on different training sets generated by projecting the original up-space training set to lower dimensional down-spaces. We then apply a Least SquarE−based method to weigh the outputs of the base classifiers so that the contribution of each classifier to the final combined prediction is different. We choose Decision Tree as the learning algorithm in the proposed framework and conduct experiments on a number of real and synthetic datasets. The experimental results indicate that our framework is better than many of the benchmark algorithms, including three homogeneous ensemble methods (Bagging, RotBoost, and Random Subspace), several well-known algorithms (Decision Tree, Random Neural Network, Linear Discriminative Analysis, K Nearest Neighbor, L2-loss Linear Support Vector Machine, and Discriminative Restricted Boltzmann Machine), and random projection-based ensembles with fixed combining rules with regard to both classification error rates and F1 scores.

Journal Article Type Article
Publication Date Jul 31, 2019
Journal Information Sciences
Print ISSN 0020-0255
Publisher Elsevier
Peer Reviewed Peer Reviewed
Volume 490
Pages 36-58
Institution Citation NGUYEN, T.T., DANG, M.T., LIEW, A. W.-C. and BEZDEK, J.C. 2019. A weighted multiple classifier framework based on random projection. Information science [online], 490, pages 36-58. Available from: https://doi.org/10.1016/j.ins.2019.03.067
DOI https://doi.org/10.1016/j.ins.2019.03.067
Keywords Ensemble method; Random projection; Multiple classifier system; Weighted multiple classifier

Files

This file is under embargo until Mar 27, 2020 due to copyright reasons.

Contact publications@rgu.ac.uk to request a copy for personal use.



Downloadable Citations