Programs that improve teaching effectiveness represent a core strategy to improve student educational outcomes and close student achievement gaps. This article compiles empirical values of intraclass correlations for designing effective and efficient experimental studies evaluating the effects of these programs. The Early Childhood Longitudinal…

Drawing on our five years of experience developing WWC evidence standards and reviewing studies against those standards as well as current literature on the design of impact studies, we highlight in this paper some of the most critical issues and common pitfalls in designing and conducting impact studies in education, and provide practical…

This article examines the power analyses for the first wave of group-randomized trials funded by the Institute of Education Sciences. Specifically, it assesses the precision and technical accuracy of the studies. The authors identified the appropriate experimental design and estimated the minimum detectable standardized effect size (MDES) for each…

The influence of teachers' qualifications on their teaching practice has been subject to debate. Literature reviews do not settle these debates, partly because the literature is uneven and partly because reviews capture only narrow slices of literature. In particular, many reviews eliminate qualitative studies. Yet without examining qualitative…

Discusses reasons randomized experiments in educational research have been so rare and appraises alternatives to experiments that educational evaluators prefer. These alternatives are found wanting whenever a high standard is needed for justifying causal conclusions. (SLD)

A design for evaluation studies of educational programs should provide valid and defensible inferences. Goals of evaluation are the identity of major components of inferences and specific validity concerns. Design problems may be resolved by creatively utilizing features of specific evaluations in designing unique conditions that permit valid…

This paper discusses problems associated with the application of experimental methods to program evaluation, proposes an alternative approach (program-attribute scaling), and reports the procedure and results of a trial application of the alternative approach. (Author)

An outline and example of a field-based program implementation evaluation model and rating scale are described. Teacher, parent, and other influences on the implementation level of the program are discussed. Multiple measures are provided as sources of implementation data. (CM)

This is an introduction to a set of four papers in the field of evaluation research. A main theme in these papers is the recognition that evaluation research is not a pure objective scientific self-standing activity, but one that interacts within a context and is influenced by the interchanges. (LMO)

Meta-analytic techniques were used to study the overall impact of the Title I program on student achievement and to examine the effects of mediating methodological and programmatic factors. Data from 17 Federal studies with 657 effect sizes indicate a modest impact of Title I that increased as the program matured. (SLD)

Utilizing the regression-discontinuity research design, this article explores the effectiveness of a developmental English program in a large, multicampus community college. Routinely collected data were extracted from existing records of a cohort of first-time college students followed for approximately 6 years (N = 1,473). Results are consistent…

The duplex design is proposed for educational assessment within a state school system. For individual students, scaled proficiency measures that are suitable for guidance and certification at various levels of attainment are provided. For classrooms or larger units, the design can supply group level measures for evaluation and research. (SLD)