Effect of Peer Benchmarking on Specialist Electronic Consult Performance in a Los Angeles Safety-Net: a Cluster Randomized Trial

BACKGROUND: Since the advent of COVID-19, accelerated adoption of systems that reduce face-to-face encounters has outpaced training and best practices. Electronic consultations (eConsults), structured communications between PCPs and specialists regarding a case, have been effective in reducing face-to-face specialist encounters. As the health system rapidly adapts to multiple new practices and communication tools, new mechanisms tomeasure and improve performance in this context are needed. OBJECTIVE: To test whether feedback comparing physicians to top performing peers using co-specialists' ratings improves performance. DESIGN: Cluster-randomized controlled trial PARTICIPANTS: Eighty facility-specialty clusters and 214 clinicians INTERVENTION: Providers in the feedback arms were sent messages that announced their membership in an elite group of Top Performers or provided actionable recommendations with feedback for providers that were Not Top Performers. MAIN MEASURES: The primary outcomes were changes in peer ratings in the following performance dimensions after feedback was received: (1) elicitation of information from primary care practitioners; (2) adherence to institutional clinical guidelines; (3) agreement with peer's medical decision-making; (4) educational value; (5) relationship building. KEY RESULTS: Specialists showed significant improvements on 3 of the 5 consultation performance dimensions: medical decision-making (odds ratio 1.52, 95% confidence interval 1.08-2.14, p<.05), educational value 1.86, 1.17-2.96) and relationship building (1.63, 1.132.35) (both p<.01). CONCLUSIONS: The pandemic has shed light on clinicians' commitment to professionalism and service as we rapidly adapt to changing paradigms. Interventions that appeal to professional norms can help improve the efficacy of new systems of practice. We show that specialists' performance can be measured and improved with feedback using aspirational norms.

Automated summary

Since the emergence of COVID-19, there has been a rapid shift towards systems reducing face-to-face encounters, such as electronic consultations. A study was conducted to test the effectiveness of feedback comparing physicians to top-performing peers, which showed significant improvements in specialist performance in decision-making, educational value, and relationship building. The findings suggest that interventions appealing to professional norms can enhance the efficacy of new healthcare systems.