Skip to main content

Research Repository

See what's under the surface

A genetic algorithm approach to optimising random forests applied to class engineered data.

Elyan, Eyad; Gaber, Mohamed Medhat

Authors

Eyad Elyan

Mohamed Medhat Gaber



Abstract

In numerous applications and especially in the life science domain, examples are labelled at a higher level of granularity. For example, binary classification is dominant in many of these datasets, with the positive class denoting the existence of a particular disease in medical diagnosis applications. Such labelling does not depict the reality of having different categories of the same disease; a fact evidenced in the continuous research in root causes and variations of symptoms in a number of diseases. In a quest to enhance such diagnosis, datasests were decomposed using clustering of each class to reveal hidden categories. We then apply the widely adopted ensemble classification technique Random Forests. Such class decomposition has two advantages: (1) diversification of the input that enhances the ensemble classification; and (2) improving class separability, easing the follow-up classification process. However, to be able to apply Random Forests on such class decomposed data, three main parameters need to be set: number of trees forming the ensemble, number of features to split on at each node, and a vector representing the number of clusters in each class. The large search space for tuning these parameters has motivated the use of Genetic Algorithm to optimise the solution. A thorough experimental study on 22 real datasets was conducted, predominantly in a variety of life science applications. To prove the applicability of the method to other areas of application, the proposed method was tested on a number of datasets from other domains. Three variations of Random Forests including the proposed method as well as a boosting ensemble classifier were used in the experimental study. The results prove the superiority of the proposed method in boosting up the accuracy.

Journal Article Type Article
Publication Date Apr 1, 2017
Journal Information sciences
Print ISSN 0020-0255
Electronic ISSN 1872-6291
Publisher Elsevier
Peer Reviewed Peer Reviewed
Volume 348
Pages 220-234
Institution Citation ELYAN, E. and GABER, M.M. 2017. A genetic algorithm approach to optimising random forests applied to class engineered data. Information sciences [online], 384, pages 220-234. Available from: https://doi.org/10.1016/j.ins.2016.08.007
DOI https://doi.org/10.1016/j.ins.2016.08.007
Keywords Random forests; Genetic algorithm; Class decomposition; Life science

Files





Downloadable Citations