Development and implementation of a Web-based evaluation system for an internal medicine residency program

Evaluation and feedback are fundamental components of graduate medical education. Paper-based evaluation systems are inefficient and costly and the evaluation data they provide are difficult to retrieve and analyze. In view of these problems, in 1996-1997, the authors developed and implemented a World Wide Web-based electronic evaluation system for the internal medicine residency program at the University of Minnesota. Residents were evaluated using the American Board of Internal Medicine Resident Evaluation Form. Custom evaluations were created for the assessment of sites, rotations, and faculty. The evaluations were completed by accessing an evaluation Web site from any location using standard computers and Web browsers. The evaluations were submitted electronically and automatically entered into a database. The system tracked compliance and automatically sent out reminders. Other features of the system included extensive reporting capabilities, automatic notification of substandard performance, and the ability to send confidential information to the program director. The total compliance rate ranged between 81% and 92% during the first 12 months of operation, with no significant difference in compliance observed between faculty and residents. The system was easy to use and could quickly and confidentially identify performance problems of residents and faculty from large numbers of evaluations.