In this article, the authors Sarah A. Anzia and Terry M. Moe, offer a retort to William S. Koski and Elieen L. Horng's argument that their study of seniority-based transfer rules is narrow and that its findings only apply under limited circumstances. The Koski-Horng's study, by contrast, takes a broad frame--so broad that, as detailed in…

Discusses reasons randomized experiments in educational research have been so rare and appraises alternatives to experiments that educational evaluators prefer. These alternatives are found wanting whenever a high standard is needed for justifying causal conclusions. (SLD)

Concentrates on building a conceptual framework for policy research that would provide more useful information to policymakers. Examines four different policy instruments and specifies key relationships among them. (RB)

This paper presents a case for the use of causal models derived from a substantive knowledge base of theory and research in the evaluation of educational programs. An evaluation of the Adaptive Learning Environments Model (ALEM) illustrates the causal-modeling approach to program evaluation. (BW)

A critical guide is offered regarding ethnographic evaluation data: the analytical descriptions or reconstructions of intact cultural scenes and groups which delineate the shared beliefs, practices, artifacts, folk knowledge, and behaviors of some group of people. (PN)

The design and conduct of a national evaluation study is discussed, demonstrating that a control group may not provide the no-cause baseline information expected. Resolution of this problem requires reexamination of paradigms, research practices, and policies, as well as the underlying real world constraints and views that generate them. (PN)

Improving the validity and reliability of surveys is a critical part of the response to the call for improved rigor of education research, policy analysis and evaluation. Too often we create inquiry tools without validating our measures against how respondents interpret our questions, and therefore collect data of questionable quality. The purpose…

A multilevel analysis strategy developed by Leigh Burstein termed slopes-as-outcomes provides a means to address questions concerning equity in educational research. This potential strategy for studying differences in program implementation relates to differences in program effectiveness across sites. (SLD)

This paper summarizes the main results of a meta-evaluation of innovative education programs in Dutch education. Attention is focused on contextual influences, while a case is made for prudent and feasible ways of "rational reconstruction" and for an acitve evaluation policy aimed at overcoming contextual constraints. (LMO)

This article summarizes the findings of the National Research Council (NRC) report "On Evaluating Curricular Effectiveness" and examines the reviews in middle grades mathematics undertaken by the What Works Clearinghouse (WWC). The NRC report reviewed and assessed 147 key evaluations of 13 National Science Foundation-supported K-12 mathematics…