Rigorous Assessment of Social Validity: A Scoping Review of a 40-Year Conversation

For the last 40 years, special education and applied behavior analysis researchers have discussed the notion of social validity, particularly those researchers who conduct single-case research. A substantial part of this discussion has involved critiquing the rigor of methods used to assess social validity. We conducted a scoping literature review focused on describing and integrating different critiques and recommendations about social validity assessment. In a multi-pronged search, we identified 47 articles addressing rigor in social validity assessment. We used inductive content analysis to chart data about specific critiques and identify a framework of seven Key Questions that organize these critiques across theoretical and methodological dimensions. We describe the Key Questions, including examples from the reviewed literature that led to their development. The framework may have practical utility for researchers and reviewers in guiding rigorous social validity assessment in intervention research. Implications are discussed for researchers, reviewers, and journal editors.

Automated summary

Over the past 40 years, researchers in special education and applied behavior analysis have been discussing the concept of social validity, particularly focusing on critiquing the rigor of methods used for assessment. Through a scoping literature review, a framework of seven Key Questions has been developed to guide rigorous social validity assessment in intervention research, which may have practical utility for researchers and reviewers. This framework organizes critiques across theoretical and methodological dimensions and discusses implications for researchers, reviewers, and journal editors.