Linguistic Biases in Letters of Recommendation for Radiation Oncology Residency Applicants from 2015 to 2019

We aimed to investigate whether implicit linguistic biases exist in letters of recommendation (LORs) for applicants to radiation oncology (RO) residency. LORs (n = 487) written for applicants (n = 125) invited to interview at a single RO residency program from the 2015 to 2019 application cycles were included for analysis. Linguistic Inquiry and Word Count (LIWC) software was used to evaluate LORs for length and a dictionary of predetermined themes. Language was evaluated for gender bias using a publicly available gender bias calculator. Non-parametric tests were used to compare linguistic domain scores. The median number of the LORs per applicant was 4 (range 3-5). No significant differences by applicant gender were detected in LIWC score domains or gender bias calculator (P > 0.05). However, LORs for applicants from racial/ethnic backgrounds underrepresented in medicine were less likely to include standout descriptors (P = 0.008). Male writers were less likely to describe applicant characteristics related to patient care (P < 0.0001) and agentic personality (P = 0.006). LORs written by RO were shorter (P < 0.0001) and included fewer standout descriptors (P = 0.014) but were also more likely to include statements regarding applicant desirability (P = 0.045) and research (P = 0.008). While language was globally male-biased, assistant professors were less likely than associate professors (P = 0.0064) and full professors (P = 0.023) to use male-biased language. Significant linguistic differences were observed in RO residency LORs, suggesting that implicit biases related to both applicants and letter writers may exist. Recognition, and ideally eradication, of such biases are crucial for fair and equitable evaluation of a diverse applicant pool of RO residency candidates.

Automated summary

This study investigated the presence of implicit linguistic biases in letters of recommendation for radiation oncology residency applicants. The findings revealed significant linguistic differences in the letters, implying the existence of implicit biases related to both applicants and letter writers. Recognition and elimination of these biases are crucial for fair and equitable evaluation of a diverse pool of residency candidates.