This article uses the interventionist theory of causation, a counterfactual theory taken from philosophy of science, to strengthen causal analysis in process tracing research. Causal claims from process tracing are re-expressed in terms of so-called hypothetical interventions, and concrete evidential tests are proposed which are shown to…

"Integrative evaluation" is an approach with two main phases: identification of plausible rival hypotheses and integration of rival hypotheses. The first phase may correspond to traditional adversary evaluation, whereas the second phase, that is not included in adversary evaluation, requires integrative thinking which can be applied when…

Previous simulation studies of randomization tests applied in single-case educational intervention research contexts have typically focused on A-to-B phase changes in means/levels. In the present simulation study, we report the results of two multiple-baseline investigations, one targeting between-phase changes in slopes/trends and the other…

This study presents a novel approach contributing to our understanding of the design, development, and implementation AI-based systems for conducting double-blind online randomized controlled trials (RCTs) for higher education research. The process of the entire interaction with the participants (n = 1193) and their allocation to test and control…

Understanding that hypothesis testing is aimed at seeking information rather than producing desirable outcomes is indispensable for designing informative experiments. This study investigated the developmental course of information seeking compared to producing an effect in young children. In a between-subjects design, 4- to 6-year-olds (N = 109)…

BASIE is a framework for interpreting impact estimates from evaluations. It is an alternative to null hypothesis significance testing. This guide walks researchers through the key steps of applying BASIE, including selecting prior evidence, reporting impact estimates, interpreting impact estimates, and conducting sensitivity analyses. The guide…

Bed bugs are on the rise and are increasingly perceived as harmful parasites. Because individuals affected by bed bugs often feel disgust and shame and are stigmatized, bed bugs are an important public health and environmental justice concern and therefore a health education issue as well. In this quasi-experimental study, we examine how different…

The Interface Hypothesis proposes that the pragmatic-discursive interface with syntax is more vulnerable to crosslinguistic influence than the syntactic-semantic interface [Tsimpli, Ianthi, and Antonella Sorace. 2006. "Differentiating Interfaces: L2 Performance in Syntax- Semantics and Syntax-Discourse Phenomena." In Proceedings of the…

Many large-scale, school-based interventions have attempted to improve academic performance through promoting students' growth mindset, defined as the belief that one's intellectual ability can increase with practice and time. However, most have shown weak to no effects. Thus, it is important to examine how growth mindset might affect retention…