Enhancing systematic reviews: an in-depth analysis on the impact of active learning parameter combinations for biomedical abstract screening.

Ofori-Boateng, Regina; Trujillo-Escobar, Tamy Goretty; Aceves-Martins, Magaly; Wiratunga, Nirmalie; Moreno-Garcia, Carlos Francisco

Abstract

Systematic Review (SR) are foundational to influencing policies and decision-making in healthcare and beyond. SRs thoroughly synthesise primary research on a specific topic while maintaining reproducibility and transparency. However, the rigorous nature of SRs introduces two main challenges: significant time involved and the continuously growing literature, resulting in potential data omission, making most SRs become outmoded even before they are published. As a solution, AI techniques have been leveraged to simplify the SR process, especially the abstract screening phase. Active learning (AL) has emerged as a preferred method among these AI techniques, allowing interactive learning through human input. Several AL software have been proposed for abstract screening. Despite its prowess, how the various parameters involved in AL influence the software’s efficacy is still unclear. This research seeks to demystify this by exploring how different AL strategies, such as initial training set, query strategies etc. impact SR automation. Experimental evaluations were conducted on five complex medical SR datasets, and the GLM model was used to interpret the findings statistically. Some AL variables, such as the feature extractor, initial training size, and classifiers, showed notable observations and practical conclusions were drawn within the context of SR and beyond where AL is deployed.

Citation

OFORI-BOATENG, R., TRUJILLO-ESCOBAR, T.G., ACEVES-MARTINS, M., WIRATUNGA, N. and MORENO-GARCIA, C.F. 2024. Enhancing systematic reviews: an in-depth analysis on the impact of active learning parameter combinations for biomedical abstract screening. Artificial intelligence in medicine [online], 157, article number 102989. Available from: https://doi.org/10.1016/j.artmed.2024.102989

• Journal Article Type: Article
• Acceptance Date: Sep 22, 2024
• Online Publication Date: Sep 26, 2024
• Publication Date: Nov 30, 2024
• Deposit Date: Sep 26, 2024
• Publicly Available Date: Sep 26, 2024
• Journal: Artificial intelligence in medicine
• Print ISSN: 0933-3657
• Electronic ISSN: 1873-2860
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 157
• Article Number: 102989
• DOI: https://doi.org/10.1016/j.artmed.2024.102989
• Keywords: Evidence-based medicine; Systematic reviews; Literature reviews; Research methodologies; Machine learning; Human-in-the-loop
• Public URL: https://rgu-repository.worktribe.com/output/2487383