In the article "It's Just an Observation," Robinson and Wainer (Educational Psychology Review 35, Robinson, D., & Wainer, H. (2023). It's just an observation. Educational Psychology Review, 35(83), Published online: 14 August, 2023) lamented that educational psychology is moving toward the dark side of the quality continuum, with…

In science in general and in the context of single-case experimental designs, replication of the effects of the intervention within and/or across participants or experiments is crucial for establishing causality and for assessing the generality of the intervention effect. Specific developments and proposals for assessing whether an effect has been…

Despite the increase in federal tiered evidence initiatives that require the use of rigorous evaluation designs, such as randomized experiments, there has been limited guidance in the evaluation literature on practical strategies to implement such studies successfully. This paper provides lessons learned in executing experiments in applied…

Teachers engaging in research has been discussed and carried out under the heuristics and methodologies of action research (Manfra, 2019; Pine, 2009). A typical action research project might involve an individual teacher studying the effectiveness of a specific instructional strategy like having students preview content before receiving direct…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies. The impact estimators are derived using the building blocks of experimental designs with minimal assumptions, and have good statistical properties. The methods apply to randomized controlled trials (RCTs) and…

A new design-based theory has recently been developed to estimate impacts for randomized controlled trials (RCTs) and basic quasi-experimental designs (QEDs) for a wide range of designs used in social policy research (Imbens & Rubin, 2015; Schochet, 2016). These methods use the potential outcomes framework and known features of study designs…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies (Imbens and Rubin, 2015; Schochet, 2015, 2016). The estimators are derived using the building blocks of experimental designs with minimal assumptions, and are unbiased and normally distributed in large samples…

Often, in the case of experimental evaluations of multifaceted interventions, researchers and policymakers alike are interested in asking not only whether a given intervention had an effect but also why. They seek answers to questions such as: What features of the intervention led to the impacts that we have observed, or what was the causal…

Single-case or single-subject experimental designs (SSED) are used to evaluate the effect of one or more treatments on a single case. Although SSED studies are growing in popularity, the results are in theory case-specific. One systematic and statistical approach for combining single-case data within and across studies is multilevel modeling. The…

Debate is occurring about which result interpretation aides focused on examining the experimental effect should be used in single-subject experimental research. In this study, we examined seven nonoverlap methods and compared results using each method to judgments of two visual analysts. The data sources for the present study were 36 studies…

A word-length effect is often described in pure alexia, with reading time proportional to the number of letters in a word. Given the frequent association of right hemianopia with pure alexia, it is uncertain whether and how much of the word-length effect may be attributable to the hemifield loss. To isolate the contribution of the visual field…

Use of multivariate analysis (e.g., multivariate analysis of variance) is common when normally distributed outcomes are collected in intervention research. However, when mixed responses--a set of normal and binary outcomes--are collected, standard multivariate analyses are no longer suitable. While mixed responses are often obtained in…

The aim of this paper is to report on an experiment in the School of Management at the University of Surrey whereby the Scholarship of Teaching and Learning is being promoted through an approach which is organic in nature. The paper argues that the nature of such scholarship means that its promotion is more likely to be successful when the…

Background: Young drivers are overrepresented in road traffic fatalities and collisions. Attempts to address this problem with pre-driver education have not met with unambiguous success. However, there is a lack of research on whether pre-driver education can change psychological antecedents to behaviour. Aims: The framework of the theory of…

Behavioral momentum theory provides a quantitative account of how reinforcers experienced within a discriminative stimulus context govern the persistence of behavior that occurs in that context. The theory suggests that all reinforcers obtained in the presence of a discriminative stimulus increase resistance to change, regardless of whether those…