GRADE Guidance: 31. Assessing the certainty across a body of evidence for comparative test accuracy

Objectives: This article provides GRADE guidance on how authors of evidence syntheses and health decision makers, including guideline developers, can rate the certainty across a body of evidence for comparative test accuracy questions. Study design and setting: This guidance extends the previously published GRADE guidance for assessing certainty of evidence for test accuracy to scenarios in which two or more index tests are compared. Through an iterative brainstorm-discussion-feedback process within the GRADE working group, we developed a guidance accompanied by practical examples. Results: Rating the certainty of evidence for comparative test accuracy shares many concepts and ideas with the existing GRADE guidance for test accuracy. The rating in comparisons of test accuracy requires additional considerations, such as the selection of appropriate comparative study designs, additional criteria for judging risk of bias, and the consequences of using comparative measures of test accuracy. Distinct approaches to rating certainty are required for comparative test accuracy studies and between-study (indirect) comparisons. Conclusion: This GRADE guidance will support transparent assessment of the certainty for a body of comparative test accuracy evidence. (c) 2021 The Author(s). Published by Elsevier Inc. This is an open access article under the CC BY license ( http:// creativecommons.org/ licenses/ by/ 4.0/ )

Automated summary

This article provides GRADE guidance on assessing the certainty of evidence for comparative test accuracy questions, extending existing guidance for assessing test accuracy to scenarios with multiple index tests. It highlights additional considerations needed for rating certainty in comparisons of test accuracy and emphasizes the need for distinct approaches for comparative test accuracy studies and indirect comparisons between studies.