Skip to main content

Research Repository

Advanced Search

Reviewing the literature, how systematic is systematic?

MacLure, Katie; Paudyal, Vibhu; Stewart, Derek


Katie MacLure

Vibhu Paudyal

Derek Stewart


Introduction Professor Archibald Cochrane, after whom the Cochrane Collaboration is named, was influential in promoting evidence-based clinical practice. He called for 'relevant, valid research' to underpin all aspects of healthcare. Systematic reviews of the literature are regarded as a high quality source of cumulative evidence but it is unclear how truly systematic they, or other review articles, are or ‘how systematic is systematic?’ Today’s evidence-based review industry is a burgeoning mix of specialist terminology, collaborations and foundations, databases, portals, handbooks, tools, criteria and training courses. Aim of the review This study aims to identify uses and types of reviews, key issues in planning, conducting, reporting and critiquing reviews, and factors which limit claims to be systematic. Method A rapid review of review articles published in IJCP. Results This rapid review identified 17 review articles published in IJCP between 2010 and 2015 inclusive. It explored the use of different types of review article, the variation and widely available range of guidelines, checklists and criteria which, through systematic application, aim to promote best practice. It also identified common pitfalls in endeavouring to conduct reviews of the literature systematically. Discussion Although a limited set of IJCP reviews were identified, there is clear evidence of the variation in adoption and application of systematic methods. The burgeoning evidence industry offers the tools and guidelines required to conduct systematic reviews, and other types of review, systematically. This rapid review was limited to the database of one journal over a period of 6years. Although this review was conducted systematically, it is not presented as a systematic review. Conclusion As a research community we have yet to fully engage with readily available guidelines and tools which would help to avoid the common pitfalls. Therefore the question remains, of not just IJCP but potentially all published reviews, ‘how systematic is systematic?’


MACLURE, K., PAUDYAL, V. and STEWART, D. 2016. Reviewing the literature, how systematic is systematic? International journal of clinical pharmacy [online], 38(3), pages 685-694. Available from:

Journal Article Type Article
Acceptance Date Mar 14, 2016
Online Publication Date Apr 5, 2016
Publication Date Jun 30, 2016
Deposit Date Sep 8, 2016
Publicly Available Date Sep 8, 2016
Journal International journal of clinical pharmacy
Print ISSN 2210-7703
Electronic ISSN 2210-7711
Publisher Springer
Peer Reviewed Peer Reviewed
Volume 38
Issue 3
Pages 685-694
Keywords Critical appraisal; Data extraction; Literature; Review; Systematic review
Public URL


You might also like

Downloadable Citations