The articles in this special issue discuss efforts to improve academic reading outcomes for students and ways to achieve high implementation fidelity of promising strategies. At times the authors discuss if--and how--strong fidelity is associated with strong outcomes and potentially even impacts (the difference between program and control group…

School program evaluation researchers face a set of overlapping questions concerning our roles in the field: For the sake of "the data" and in quest of "the truth," am I a shrewd researcher before all else? For the sake of community-building and establishing respectful, reciprocal relationships with my school partners, am I first a gracious school…

When causal inferences are to be synthesized across multiple studies, efforts to establish the magnitude of a causal effect should be balanced by an effort to evaluate the generalizability of the effect. The evaluation of generalizability depends on two factors that are given little attention in current syntheses: construct validity and external…

In this article, the authors argue the case for scientific evidenced-based practice in education. They consider what differentiates science from pseudoscience and what sources of information teachers typically regard as reliable. The What Works Clearinghouse is discussed with reference to certain limitations of its current operation. Given the…

Criticizes the research design in "The Small ICF/MR program: Dimensions of Quality and Cost" (Conroy), that found small Intermediate Care Facilities (ICF) for individuals with mental retardation are inferior to other community programs. Discusses the problem in selecting a control group on the basis of pretest matching. (CR)

The Walsh and Carballo evaluation of the effectiveness of transitional bilingual education programs in five Massachusetts communities, has the following flaws: (1) the sample of school districts studied suffered from "self-selection bias"; (2) the sample does not include a single large, urban school district; (3) the student samples…

Describes problems in implementing placebo controls in psychotherapy including the difficulty of ensuring that therapists and their patients will view both the experimental and placebo treatments as comparably credible. Considers six research issues stemming from the definitional requirement that the placebo control for the critical and specific…

An examination of the scientific basis of both control group designs and comparative designs in outcome research reveals that comparative designs generally have fewer threats to validity and provide a more efficient means of control for nonspecific treatment factors suggesting that comparative studies warrant a larger role in the study of…

Is it ethical to select clients at random for a beneficial social service, then deny the benefits to a control group for the sake of science? Participation of control groups in planning, implementation and evaluation of social programs may resolve ethical issues. (Author/CP)

A solution to the problem of specification error due to excluded variables in statistical models of treatment effects in nonrandomized (nonequivalent) control group designs is presented. It involves longitudinal observation with at least two pretests. A maximum likelihood estimation program such as LISREL may provide reasonable estimates of…

This discussion of educational technology and the role of computers is based on the author's experiences with the United Kingdom's National Development Programme in Computer Assisted Learning (NDPCAL). Highlights include curriculum development; teachers' roles; research and development; evaluation; control group experiments; instructional…