4.6 Review

Systematic review automation tools improve efficiency but lack of knowledge impedes their adoption: a survey

Journal

JOURNAL OF CLINICAL EPIDEMIOLOGY
Volume 138, Issue -, Pages 80-94

Publisher

ELSEVIER SCIENCE INC
DOI: 10.1016/j.jclinepi.2021.06.030

Keywords

Automation; Automation tools; Systematic review; Systematic review automation; Health technology assessment; Clinical practice guideline

Funding

  1. NHMRC [APP1195676]

Ask authors/readers for more resources

The survey found that the majority of respondents have used systematic review automation tools, primarily during the screening stage. They believed these tools saved time and increased accuracy, but lack of knowledge was identified as the main barrier to tool adoption. Respondents suggested the development of new tools for the searching and data extraction stages.
Objective: We investigated systematic review automation tool use by systematic reviewers, health technology assessors and clinical guideline developerst. Study design and setting: An online, 16-question survey was distributed across several evidence synthesis, health technology assessment and guideline development organizations. We asked the respondents what tools they use and abandon, how often and when do they use the tools, their perceived time savings and accuracy, and desired new tools. Descriptive statistics were used to report the results. Results: A total of 253 respondents completed the survey; 89% have used systematic review automation tools - most frequently whilst screening (79%). Respondents' top 3 tools included: Covidence (45%), RevMan (35%), Rayyan and GRADEPro (both 22%); most commonly abandoned were Rayyan (19%), Covidence (15%), DistillerSR (14%) and RevMan (13%). Tools saved time (80%) and increased accuracy (54%). Respondents taught themselves to how to use the tools (72%); lack of knowledge was the most frequent barrier to tool adoption (51%). New tool development was suggested for the searching and data extraction stages. Conclusion: Automation tools will likely have an increasingly important role in high-quality and timely reviews. Further work is required in training and dissemination of automation tools and ensuring they meet the desirable features of those conducting systematic reviews. (c) 2021 Elsevier Inc. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available