The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

In an earlier paper, we presented methods for estimating achievement gaps when test scores are coarsened into a small number of ordered categories, preventing fine-grained distinctions between individual scores. We demonstrated that gaps can nonetheless be estimated with minimal bias across a broad range of simulated and real coarsened data…

Three issues need to be decided in the design stage of a longitudinal intervention study: the number of persons, the number of repeated measurements per person, and the duration of the study. The degree to which polynomial effects vary across persons and the drop-out pattern also influence the statistical power to detect intervention effects. This…

Describes the one-sample runs test, which is used to identify a nonrandom pattern in a sequence of dichotomous elements. Demonstrates that this test is incapable of signaling departures from randomness with run lengths of two. Such run lengths generate a unique category of anomaly in the overall performance of the test. (SLD)

Multisite research designs involving cluster randomization are becoming increasingly important in educational and behavioral research. Researchers would like to compute effect size indexes based on the standardized mean difference to compare the results of cluster-randomized studies (and corresponding quasi-experiments) with other studies and to…

Paired-samples experimental designs are appropriate and widely used when there is a natural correspondence or pairing of scores. However, researchers must not fail to consider the implications of undetected correlation between supposedly independent samples in the absence of explicit pairing. (SLD)