Practice makes perfect: Commentary on Burnette et al. (2021)

Underrepresented identities have been overlooked in the development of measures assessing eating disorders; therefore, limited normative data exist for these identities. To address this, Burnette et al. sought to provide Eating Disorder Examination-Questionnaire and Eating Attitudes Test-26 norms for transgender adults using Amazon's MTurk. However, they were unable to achieve this goal due to what they perceived as high rates of invalid responses. Instead, they provided recommendations for conducting MTurk research. However, little or no evidence supports the validity of several recommendations, partly because their study was not designed to derive or validate recommendations. By their own admission, their strategies failed to address what they identified as the central problem. We express concern about Burnette et al.'s recommendations because (a) the recommendations are built on assumptions about the problem that may not be true; and (b) the recommendations are not provided within the context of limitations of self-report/online data collection writ large. We detail these concerns and propose that strategies for mitigating inattentive/invalid responding be subjected to validation prior to being recommended to prevent the implementation of procedures that result in the exclusion of the target population, individuals who we historically, and perhaps still, unjustly exclude from research.

Automated summary

The study found that measures assessing eating disorders often overlook underrepresented identities, resulting in limited normative data. Attempts to provide norms for transgender adults were unsuccessful due to high rates of invalid responses, leading to recommendations for conducting research. However, lack of evidence supporting these recommendations and failure to address the central problem were identified as major concerns in the study.