We revisit the merits of the retrospective pretest-posttest (RPP) design for repeated-measures research. The underutilized RPP method asks respondents to rate survey items twice during the same posttest measurement occasion from two specific frames of reference: "now" and "then." Individuals first report their current attitudes…

A nonparametric test of the hypothesis of no treatment effect is suggested for a situation where measures of the severity of the condition treated can be obtained and ranked both pre- and post-treatment. The test allows the pre-treatment rank to be used as a concomitant variable. (Author/JKS)

A quantitative method, meta-analysis, is used to integrate research findings from a representative group of 38 coaching studies. Because different studies reported results on different scales, effect size was used to transform all results to a common metric. This meta-analysis showed that there are two distinct literatures on the effectiveness of…

Problems in measuring change abound. For many purposes, a pretest score is best treated as any other measure obtained at the time of the pretest. Where appropriate, regression analyses that treat the pretest no differently from other independent variables, and the posttest as the dependent variable avoid many difficulties introduced by gain…

An evaluation of a school-based drug education program was employed to examine the effect of administration of a preteaching questionnaire on responses. Found pretesting increased the amounts of alcohol reported consumed and reports of drunkenness and marijuana use. (Author)

Concludes that training in the use of dictionary pronunciations as a means of instructing retarded readers might be more effective if combined with oral reading practice. (RW)

The biasing effects of a pretest on subsequent post-test results were investigated in two experimental studies. In general, the results argue for using designs without pretests. (Author/JKS)

The problem of the appropriate comparison group for bereavement studies is discussed. The use of the retrospective pretest design is illustrated through a longitudinal study of bereavement outcome following pregnancy loss, involving 138 bereaved women and a comparison group of 215 currently pregnant women. (SLD)

The evaluation design, which prescribes when and from whom to gather data, is described as significant because it can lend credibility to evaluation results. The objectives of this booklet are to aid the evaluator in: choosing a design; putting it into operation; and analyzing and reporting the data. Examples include both formative and summative…

The effect of an advance organizer on post test performance was studied in a 2 X 2 X 2 factorial design with the effects of the organizer, pretest and mathematics learning passage controlled. An advance organizer of approximately 500 words and a learning passage of approximately 1,000 words were developed. A 41-item multiple choice test based on…

Twelve common errors which can invalidate an otherwise sound evaluation are identified, and ways to avoid them are presented. The hazards are: (1) grade-equivalent scores; (2) inappropriate statistical adjustments with nonequivalent control groups; (3) administering norm-referenced tests at inappropriate times of the school year; (4) inappropriate…

This publication is primarily designed for educational practitioners who possess little or no training in conducting mail surveys or have not kept current on the present state of the art of survey methods and techniques. It is also intended to be a checking and comparing aid to ensure that important research considerations are taken into account.…

The Elementary and Secondary Education Act Title I Evaluation and Reporting System is a method for giving a federally funded project in reading or math an overall score on its cognitive effectiveness. This System introduced the Normal Curve Equivalent (NCE) as an aid in aggregating Title I program scores across states and nationwide regardless of…

When two groups, initially dissimilar, undergo different treatments, can subsequent differences be partitioned in such a way that the difference between the two treatments is unbiased? This is the central problem of this paper, and it is confronted by the examination of two levels of information using a Follow Through Evaluation. The first…

Approximately 6,500 children are enrolled per year in the New York State Experimental Prekindergarten Program (PreK). In 1975-76 a longitudinal study was begun to determine the program's impact on the development of children while enrolled in the program and in the primary grades. Samples from a population of 5,245 four-year-old prekindergarten…