Improving grading of recommendations assessment, development, and evaluation evidence tables part 4: a three-arm noninferiority randomized trial demonstrates improved understanding of content in summary of findings tables with a new format

Objectives: To evaluate alternative formats of summary of findings (SoF) tables for single comparison with multiple outcomes. Study Design and Setting: We conducted a three-arm randomized controlled noninferiority trial (RCT) in the following systematic review (SR) users: researchers, clinical practice guideline developers, health care providers, policymakers, and knowledge transfer organi-zations to measure understanding, accessibility, satisfaction, and preference across the current grading of recommendations assessment, development, and evaluation (GRADE) SoF, an alternative GRADE SoF, or an adapted evidence-based practice center (EPC) program SoF table.Results: One Hundred Seventy-Nine participants were randomized, and 129 participants completed the RCT (n = 47 current GRADE, n = 41 alternative GRADE, n = 41 adapted EPC). Understanding the certainty of evidence and treatment effect was comparable across groups. The adapted EPC SoF table was inferior for quantifying risk and RD compared to the alternatives (!35% correct vs. O85% cor-rect). Participants reported increased satisfaction when SoF tables presented number needed to treat (NNT), anticipated absolute effect dif-ferences, and narrative syntheses for evidence that could not be meta-analyzed. Participants reported accessibility to information as significantly better in both GRADE SoF tables, when compared with the adapted EPC SoF table. Participants preferred the alternative GRADE SoF table format.Conclusion: The alternative GRADE SoF table is a promising format for SR users preferring a comprehensive presentation of SR re-sults for single comparisons.(c) 2022 Elsevier Inc. All rights reserved.

Automated summary

This study evaluated different formats of summary of findings (SoF) tables for single comparison with multiple outcomes. The alternative GRADE SoF table was found to be superior in terms of understanding, accessibility, satisfaction, and preference compared to the current GRADE SoF table and the adapted EPC SoF table. Participants reported increased satisfaction when SoF tables included information such as number needed to treat (NNT), anticipated absolute effect differences, and narrative syntheses. The alternative GRADE SoF table format was preferred by participants.