In this article, the authors Sarah A. Anzia and Terry M. Moe, offer a retort to William S. Koski and Elieen L. Horng's argument that their study of seniority-based transfer rules is narrow and that its findings only apply under limited circumstances. The Koski-Horng's study, by contrast, takes a broad frame--so broad that, as detailed in…

Discusses reasons randomized experiments in educational research have been so rare and appraises alternatives to experiments that educational evaluators prefer. These alternatives are found wanting whenever a high standard is needed for justifying causal conclusions. (SLD)

External and implementation factors and their potential threats to field test validity and the practical realities of the field testing process on results are discussed. External factors include site selection, negotiations, contracts, site monitoring, training, and type of product. Implementation factors include motivation, dependence on local…

A critical guide is offered regarding ethnographic evaluation data: the analytical descriptions or reconstructions of intact cultural scenes and groups which delineate the shared beliefs, practices, artifacts, folk knowledge, and behaviors of some group of people. (PN)

A study of school district uses of evaluation and test data is used to illustrate the variety of ambiguities that can appear in qualitative data. Rules of evidence to distinguish valid and potentially nonvalid testimony are proposed. Uses of testimony in evaluation are discussed. (BS)

Problems that face evaluators, including field based evaluations, are discussed. The author states that open communication, access to data, and an ability to be accepted are paramount; knowledge of randomness, robustness and homoscedasticity may be secondary. (Author/PN)

This paper discusses problems associated with the application of experimental methods to program evaluation, proposes an alternative approach (program-attribute scaling), and reports the procedure and results of a trial application of the alternative approach. (Author)

An outline and example of a field-based program implementation evaluation model and rating scale are described. Teacher, parent, and other influences on the implementation level of the program are discussed. Multiple measures are provided as sources of implementation data. (CM)

A participatory model in evaluation is presented as an extension of the stakeholder-based model focusing on the increased participation of primary users. Twenty-six empirical studies that support an organizational learning justification of the model are reviewed and classified. Requirements for participatory evaluation are discussed. (SLD)

Developed an empirical strategy for studying broad-based educational change using quantitative methods and an extensive database consisting of state policy indicators and data on schools and classrooms from states participating in the National Assessment of Educational Progress. Results of a Rasch analysis indicate that patterns of state policy…

This is an introduction to a set of four papers in the field of evaluation research. A main theme in these papers is the recognition that evaluation research is not a pure objective scientific self-standing activity, but one that interacts within a context and is influenced by the interchanges. (LMO)

The duplex design is proposed for educational assessment within a state school system. For individual students, scaled proficiency measures that are suitable for guidance and certification at various levels of attainment are provided. For classrooms or larger units, the design can supply group level measures for evaluation and research. (SLD)

Highlights lessons learned by a national organization, the Council of Chief State School Officers, in building an education indicator system in cooperation with federal and state education agencies. Issues emphasized are (1) the role of consensus; (2) production of indicators through a cooperative data system; and (3) reporting methods. (SLD)

This article summarizes the findings of the National Research Council (NRC) report "On Evaluating Curricular Effectiveness" and examines the reviews in middle grades mathematics undertaken by the What Works Clearinghouse (WWC). The NRC report reviewed and assessed 147 key evaluations of 13 National Science Foundation-supported K-12 mathematics…