We consider estimating the effect of a treatment on a given outcome measured on subjects tested both before and after treatment assignment in observational studies. A vast literature compares the competing approaches of modelling the post-test score conditionally on the pre-test score versus modelling the difference, namely, the gain score. Our…

Pre-tests are a non-graded assessment tool used to determine pre-existing subject knowledge. Typically pre-tests are administered prior to a course to determine knowledge baseline, but here they are used to test students prior to topical material coverage throughout the course. While counterintuitive, the pre-tests cover material the student is…

Growth is estimated most accurately by procedures involving the pretest-posttest difference, and for practical purposes all estimates involving this difference have approximately equal accuracy. In particular, the simple difference between pretest and posttest scores seems about as accurate as any other estimate, easier to compute, and meaningful…

The measurement of change in quasi-experimental educational research was discussed. Problems related to measuring change exist to varying degrees in all research designs; these issues are less troublesome in experimental studies because the investigator can manipulate the interest variables and observe their effects on other variables. Measuring…

The conceptual basis for using individual expectancy scores as a means for determining the success of instruction is presented. An expected gain score is computed for each student, based on a pretest score. The assumption is made that without a change in the learning environment the student will continue to gain at his previous average rate. The…

It is unsafe to estimate achievement test norms for fall testing by linear interpolation between norms for the previous spring testing and norms for the following spring. Second grade students were tested in reading and arithmetic in the fall and in the spring to provide pre-test and post-test data for evaluation of academic growth. Three…

The four main approaches to measuring treatment effects in schools; raw gain, residual gain, covariance, and true scores; were compared. A simulation study showed true score analysis produced a large number of Type-I errors. When corrected for this error, this method showed the least power of the four. This outcome was clearly the result of the…

The role that measurement error plays in the regression effect is discussed with particular reference to the RMC models for evaluating the effects of Elementary Secondary Education Act Title I programs. The norm referenced evaluation model assumes a theory of growth where the relative ranking of students remains the same from pretest to posttest…

An application of evaluation methodology to innovative educational programs through a case study of a Chicago suburban high school program for alternative education is presented. The evaluation methodology encompasses the difficulty in combining comparative programs, individual-diagnostic, and individual developmental measures, the selection of…