For the last 40 years, special education and applied behavior analysis researchers have discussed the notion of social validity, particularly those researchers who conduct single-case research. A substantial part of this discussion has involved critiquing the rigor of methods used to assess social validity. We conducted a scoping literature review focused on describing and integrating different critiques and recommendations about social validity assessment. In a multi-pronged search, we identified 47 articles addressing rigor in social validity assessment. We used inductive content analysis to chart data about specific critiques and identify a framework of seven key questions that organize these critiques across theoretical and methodological dimensions. We describe the key questions, including examples from the reviewed literature that led to their development. The framework may have practical utility for researchers and reviewers in guiding rigorous social validity assessment in intervention research. Implications are discussed for researchers, reviewers, and journal editors.