Three analyses of pretest and posttest data are considered: (1) posttest only designs; (2) two-way repeated measures of analysis of variance (ANOVA); and (3) one-way analysis of covariance (ANCOVA). Conditions that ensure legitimacy of inferences about the equality of treatment effects on the latent variable theta are discussed. (SLD)

This paper evaluates the logic underlying various criticisms of statistical significance testing and makes specific recommendations for scientific and editorial practice that might better increase the knowledge base. Reliance on the traditional hypothesis testing model has led to a major bias against nonsignificant results and to misinterpretation…

Statistical significance is misused in educational and psychological research when it is applied as a method to establish the reliability of research results. Other techniques have been developed which can be correctly utilized to establish the generalizability of findings. Methods that do provide such estimates are known as invariance or…