Developing the Expected Entrustment Score: Accounting for Variation in Resident Assessment

Background Clinical competency committees (CCCs) and residency program leaders may find it difficult to interpret workplace-based assessment (WBA) ratings knowing that contextual factors and bias play a large role. Objective We describe the development of an expected entrustment score for resident performance within the context of our well-developed Observable Practice Activity (OPA) WBA system. Design Observational study Participants Internal medicine residents Main Measure Entrustment Key Results Each individual resident had observed entrustment scores with a unique relationship to the expected entrustment scores. Many residents' observed scores oscillated closely around the expected scores. However, distinct performance patterns did emerge. Conclusions We used regression modeling and leveraged large numbers of historical WBA data points to produce an expected entrustment score that served as a guidepost for performance interpretation.

Automated summary

This study describes the development of an expected entrustment score within our WBA system, which serves as a guide for interpreting resident performance. Regression modeling and historical data were utilized to generate the expected score.