The use of inter-rater reliability (IRR) methods may provide an opportunity to improve the transparency and consistency of qualitative case study data analysis in terms of the rigor of how codes and constructs have been developed from the raw data. Few articles on qualitative research methods in the literature conduct IRR assessments or neglect to…

This paper argues for three aspects of tolerance with respect to QCA research: tolerance with respect to different approaches to QCA; producing QCA research with tolerance (work that is resistant to criticism); and for QCA researchers to be clear about the tolerance of the solutions they present -- especially in terms of calibration and truth…

Single-subjects design has the advantage of providing detailed, individualized analyses of intervention. However, creating a tutorial for single-subject design (SSD) is challenging, and an effective version for online delivery is currently unavailable. Here, we developed an experiential SSD tutorial designed for online delivery and evaluated its…

In the past decade, moderated mediation analysis has been extensively and increasingly employed in social and behavioral sciences. With its widespread use, it is particularly important to ensure the moderated mediation analysis will not bring spurious results. Spurious effects have been studied in both mediation and moderation analysis, but this…

Undergraduate economics programs prepare students for future careers by developing competency working with data, or "data literacy." Our research examined the data literacy components of undergraduate economics programs at R1 and R2 universities in the United States (N = 190). We developed a protocol with core data skills and coded…

This article examines the use of the repertory grid technique as a method to investigate learner perceptions in language education research. An important issue raised in this article concerns how far a researcher's agenda may be unintentionally imposed onto a research study which is investigating learners' perceptions, and how far the ensuing data…

One part of COVID-19's staggering impact on education has been to suspend or fundamentally alter ongoing education research projects. This article addresses how to analyze the simple but fundamental example of a multi-cohort study in which student assessment data for the final cohort are missing because schools were closed, learning was virtual,…

In undergraduate research settings, students are likely to encounter anomalous data, that is, data that do not meet their expectations. Most of the research that directly or indirectly captures the role of anomalous data in research settings uses post-hoc reflective interviews or surveys. These data collection approaches focus on recall of past…

Engaging with primary researchers during qualitative secondary analysis is a practice much recommended but rarely written about. In this article, I reflect on my experience of crossing an imagined boundary between the discrete textual dataset and its creators, of acknowledging and engaging with those researchers who invested in constructing the…