Methodological quality and risk of bias of meta-analyses of pharmacy services: A systematic review

Background: A suboptimal meta-analysis with misleading conclusions, frequently published in the healthcare journals, can compromise decision making in clinical practice. Objective: To evaluate the reporting quality, methodological quality, and risk of bias of meta-analyses of pharmacy services. Methods: Systematic searches to identify all the meta-analyses reporting the effect of pharmacy services were performed in PubMed, Scopus, and Web of Science. The reporting quality, the methodological quality, and the risk of bias of the included meta-analyses were evaluated using PRISMA checklist, R-AMSTAR, and ROBIS, respectively. Results: A total of 109 meta-analyses were eligible for the study. The heterogeneity, the quality of evidence, and the quality analyses were poorly reported on authors' conclusions (14.3%, 14.7%, and 17.4%, respectively). The median scores of PRISMA and R-AMSTAR tolls were 24 (IQR 21.75-25), and 30 (IQR 27-32.5), respectively. Additionally, most of the studies were considered as high risk of bias (n = 83, 76.1%). No association between the date of publication and guideline compliance exists. PRISMA score was higher in studies published in high impact factor journals (rho = 0.313; p = 0.002), in articles that reported the quality of evidence obtained (p = 0.018), and in those that stated the need for future studies in their conclusions (p = 0.011). R-AMSTAR score was higher in studies published in high impact factor journals (rho = 0.338; p = 0.001), in those which reported the quality of evidence (p = 0.002), and in articles that described the quality analyses in their conclusions (p = 0.046). An association between the risk of bias and the recognition of the need for further studies in their conclusions (p = 0.041) was also found. Conclusion: The rapid increase of the meta-analyses of pharmacy services was not associated with higher quality. Mechanistic meta-analyses with poor conclusions are commonly published. Quality of the analyses, strength of evidence, heterogeneity, and absence of confrontation with current guidelines are rarely considered when synthetizing evidence and making recommendations.

Automated summary

The study found that the quality of meta-analyses on pharmacy services is generally low, with poor reporting on key aspects such as heterogeneity and quality of evidence. Publications in high impact factor journals tend to have higher PRISMA and R-AMSTAR scores, but most studies are still considered high risk of bias. Recommendations for future research are often lacking, and there is little consideration for current guidelines in meta-analyses of pharmacy services.