Tien Thanh Nguyen
A weighted multiple classifier framework based on random projection.
Nguyen, Tien Thanh; Dang, Manh Truong; Liew, Alan Wee-Chung; Bezdek, James C.
Manh Truong Dang
Alan Wee-Chung Liew
James C. Bezdek
In this paper, we propose a weighted multiple classifier framework based on random projections. Similar to the mechanism of other homogeneous ensemble methods, the base classifiers in our approach are obtained by a learning algorithm on different training sets generated by projecting the original up-space training set to lower dimensional down-spaces. We then apply a Least SquarE−based method to weigh the outputs of the base classifiers so that the contribution of each classifier to the final combined prediction is different. We choose Decision Tree as the learning algorithm in the proposed framework and conduct experiments on a number of real and synthetic datasets. The experimental results indicate that our framework is better than many of the benchmark algorithms, including three homogeneous ensemble methods (Bagging, RotBoost, and Random Subspace), several well-known algorithms (Decision Tree, Random Neural Network, Linear Discriminative Analysis, K Nearest Neighbor, L2-loss Linear Support Vector Machine, and Discriminative Restricted Boltzmann Machine), and random projection-based ensembles with fixed combining rules with regard to both classification error rates and F1 scores.
|Journal Article Type||Article|
|Publication Date||Jul 31, 2019|
|Peer Reviewed||Peer Reviewed|
|Institution Citation||NGUYEN, T.T., DANG, M.T., LIEW, A. W.-C. and BEZDEK, J.C. 2019. A weighted multiple classifier framework based on random projection. Information science [online], 490, pages 36-58. Available from: https://doi.org/10.1016/j.ins.2019.03.067|
|Keywords||Ensemble method; Random projection; Multiple classifier system; Weighted multiple classifier|
This file is under embargo until Mar 27, 2020 due to copyright reasons.
Contact email@example.com to request a copy for personal use.