Skip to main content

Research Repository

Advanced Search

A novel application of machine learning and zero-shot classification methods for automated abstract screening in systematic reviews.

Moreno-Garcia, Carlos Francisco; Jayne, Chrisina; Elyan, Eyad; Aceves-Martins, Magaly

Authors

Chrisina Jayne

Magaly Aceves-Martins



Abstract

Zero-shot classification refers to assigning a label to a text (sentence, paragraph, whole paper) without prior training. This is possible by teaching the system how to codify a question and find its answer in the text. In many domains, especially health sciences, systematic reviews are evidence-based syntheses of information related to a specific topic. Producing them is demanding and time-consuming in terms of collecting, filtering, evaluating and synthesising large volumes of literature, which require significant effort performed by experts. One of its most demanding steps is abstract screening, which requires scientists to sift through various abstracts of relevant papers and include or exclude papers based on pre-established criteria. This process is time-consuming and subjective and requires a consensus between scientists, which may not always be possible. With the recent advances in machine learning and deep learning research, especially in natural language processing, it becomes possible to automate or semi-automate this task. This paper proposes a novel application of traditional machine learning and zero-shot classification methods for automated abstract screening for systematic reviews. Extensive experiments were carried out using seven public datasets. Competitive results were obtained in terms of accuracy, precision and recall across all datasets, which indicate that the burden and the human mistake in the abstract screening process might be reduced.

Citation

MORENO-GARCIA, C.F., JAYNE, C., ELYAN, E. and ACEVES-MARTINS, M. 2023. A novel application of machine learning and zero-shot classification methods for automated abstract screening in systematic reviews. Decision analytics journal [online], 6, article 100162. Available from: https://doi.org/10.1016/j.dajour.2023.100162

Journal Article Type Article
Acceptance Date Jan 7, 2023
Online Publication Date Jan 11, 2023
Publication Date Mar 31, 2023
Deposit Date Jan 12, 2023
Publicly Available Date Mar 29, 2024
Journal Decision analytics journal
Print ISSN 2772-6622
Electronic ISSN 2772-6622
Publisher Elsevier
Peer Reviewed Peer Reviewed
Volume 6
Article Number 100162
DOI https://doi.org/10.1016/j.dajour.2023.100162
Keywords Machine learning; Systematic review; Abstract screening; Class imbalance; Zero-shot classification
Public URL https://rgu-repository.worktribe.com/output/1854366
Additional Information The preprint for this article was posted on SSRN: https://doi.org/10.2139/ssrn.4210704

Files





You might also like



Downloadable Citations