Fitness-for-purpose of the CanMEDS competencies for workplace-based assessment in General Practitioner's Training: a Delphi study

BackgroundIn view of the exponential use of the CanMEDS framework along with the lack of rigorous evidence about its applicability in workplace-based medical trainings, further exploring is necessary before accepting the framework as accurate and reliable competency outcomes for postgraduate medical trainings. Therefore, this study investigated whether the CanMEDS key competencies could be used, first, as outcome measures for assessing trainees' competence in the workplace, and second, as consistent outcome measures across different training settings and phases in a postgraduate General Practitioner's (GP) Training.MethodsIn a three-round web-based Delphi study, a panel of experts (n = 25-43) was asked to rate on a 5-point Likert scale whether the CanMEDS key competencies were feasible for workplace-based assessment, and whether they could be consistently assessed across different training settings and phases. Comments on each CanMEDS key competency were encouraged. Descriptive statistics of the ratings were calculated, while content analysis was used to analyse panellists' comments.ResultsOut of twenty-seven CanMEDS key competencies, consensus was not reached on six competencies for feasibility of assessment in the workplace, and on eleven for consistency of assessment across training settings and phases. Regarding feasibility, three out of four key competencies under the role Leader, one out of two competencies under the role Health Advocate, one out of four competencies under the role Scholar, and one out of four competencies under the role Professional were deemed as not feasible for assessment in a workplace setting. Regarding consistency, consensus was not achieved for one out of five competencies under Medical Expert, two out of five competencies under Communicator,one out of three competencies under Collaborator, one out of two under Health Advocate, one out of four competencies under Scholar, one out of four competencies under Professional. No competency under the role Leader was deemed to be consistently assessed across training settings and phases.ConclusionsThe findings indicate a mismatch between the initial intent of the CanMEDS framework and its applicability in the context of workplace-based assessment. Although the CanMEDS framework could offer starting points, further contextualization of the framework is required before implementing in workplace-based postgraduate medical trainings.

Automated summary

This study investigated the feasibility and consistency of using the CanMEDS key competencies as outcome measures for workplace-based medical trainings. The findings suggest that some competencies are not feasible for workplace assessment and there is inconsistency in assessing competencies across different training settings and phases. Further contextualization of the CanMEDS framework is needed before it can be implemented in workplace-based postgraduate medical trainings.