A recent paper proposed an alternative weighting scheme when performing matching-adjusted indirect comparisons. This alternative approach follows the conventional one in matching the covariate means across two studies but differs in that it maximizes the effective sample size when doing so. The appendix of this paper showed, assuming there is one…

It is now half a century since Joey explained to Paul Willis: 'Vandalising […] that's the opposite of boredom -- excitement, defying the law', one of many similar comments subsequently recorded in "Learning to Labour" (34). The book rapidly became an academic best-seller, and has since become an academic 'national treasure'. But, before…

In this article, we pursue two points of discussion. First, a new illustration is presented of the person-oriented tenet according to which it can be hazardous to generalize to the individual results that are based on the analysis of aggregated data. Second, it is illustrated that taking into account serial dependence information can result in not…

This study presents a novel approach contributing to our understanding of the design, development, and implementation AI-based systems for conducting double-blind online randomized controlled trials (RCTs) for higher education research. The process of the entire interaction with the participants (n = 1193) and their allocation to test and control…

The purpose of this paper is to analyze the use of the exemplar methodology (ExM) as a method for selecting exemplars in education research. ExM is a systematic approach to selecting outliers that can be used to education researchers who investigate outliers to better understand phenomena among students, teachers, schools, and communities. While…

In the critical tradition, environmental education discourse interrogates how knowledge constructs experience. But environmental education also emphasises perceiving, understanding and responding to "more-than-human" beings and processes. These two motivations are in tension. One problem is that the epistemological orientation driving…

Researchers need to know what is an appropriate sample size for interview work, but how does one decide upon an acceptable number of people to interview? This question is not relevant to case study work where one would typically interview every member of a case, or in situations where it is both desirable and feasible to interview all target…

Educational research enquiries differ based on philosophical beliefs and assumptions regarding researchers' explicitly stated views. This paper critically explores the most dominant philosophical stances in social research sciences, namely positivism, interpretivism and pragmatism. It begins with an overview of the role of the aforementioned…

By design, randomized experiments (XPs) rule out bias from confounded selection of participants into conditions. Quasi-experiments (QEs) are often considered second-best because they do not share this benefit. However, when results from XPs are used to generalize causal impacts, the benefit from unconfounded selection into conditions may be offset…

Background: Over the past decade, research on the development and assessment of tools to improve the generalizability of experimental findings has grown extensively (Tipton & Olsen, 2018). However, many experimental studies in education are based on small samples, which may include 30-70 schools while inference populations to which…

Single-case research design is a useful methodology for evaluating the presence of a functional relation between an intervention and the mathematical performance of students with a learning disability. However, a functional relation cannot be established with threats to internal validity of the design. External validity is impacted if researchers…

Research has increasingly focused on the intersection between gender diversity and autism. Understanding the foci, methods, and rigor of recent studies could help guide and maximize impact in this accelerating research area. We conducted a scoping review of peer-reviewed literature on this topic published between 2018 and 2023. The search…

The ever-changing nature of online learning foregrounds the limits of separating research from design. In this article, we take the difficulty of making generalizable conclusions about designed environments as a core challenge of studying the educational psychology of online learning environments. We argue that both research and design can…

This guide will help researchers design and implement impact studies in education so that the findings are more generalizable to the study's target population. Guidance is provided on key steps that researchers can take, including defining the target population, selecting a sample of schools--and replacement schools, when needed--managing school…

A broad consensus exists that the use of appropriate methods are important in the Scholarship of Teaching and Learning. However, methodological controversies arise around what constitutes acceptable evidence, if one needs a control group, how generalizable results must be, and other similar issues. Much SoTL work, I argue, asks questions about how…