The preceding articles in this issue describe a diverse range of projects which had in common the aim of implementing or improving the practice of formative assessment, and thereby to secure some of the benefits attributed to it. This article attempts to set up a framework within which each of the different studies may be located and…

The formula is simple: Highly effective teachers equal student academic success. Yet, the physics of American education is anything but. Thus, the question facing education reformers is how can teacher effectiveness be accurately measured in order to improve the teacher workforce? Given the demand for objective, quantitative measures of teacher…

Presents a framework to describe typical constraints that program evaluators face. The framework encompasses the usual evaluation costs and other factors that impede data collection or the implementation of strong evaluation designs. These are characterized as internal/substantive or external/political. (SLD)

This chapter discusses current methods of formative evaluation and suggests that these methods themselves need to be subjected to more critical research and evaluation in order to provide them with a more scientific base. Topics addressed include problems and methods associated with data gathering, evaluation designs, number of subjects available,…

The value and limitations of conceptualizing evaluation as a decision-oriented research and appraisal activity is discussed. The decisional contexts of evaluation projects is examined in terms of a comparison between two models of organization decision making. Certain remedies for problems arising from attempts to enhance decisional relevance of…

A sample of 459 American Evaluation Association members was surveyed about ethical challenges they encountered in evaluation work. Respondents report a wide variety of ethical conflicts, with evaluators frequently pressured to compromise their roles as scientists and the evaluation product. A framework is proposed for interpreting these findings.…

Discusses the need for systems of performance indicators (PI) to measure important aspects of university operations. Comparison of three models--production, student development, and systems--makes clear that model choice yields fundamentally different PI systems and, in turn, different contexts of relevance. Suggests a hybrid model, combining the…

Issues concerning students' evaluation of college faculty are discussed. Several views of this process are presented. Having identified relevant variables or paradigms, possible relationships between the variables can be studied (models and theories). The assumptions underlying these paradigms include the following: that students have a right and…

Seven chapters present 31 propositions challenging traditional ideas about the nature and practice of program evaluation. Methods to improve evaluation models and approaches and ways to address intermediate and advanced evaluation issues are explored. The discussion also serves as an introduction to the most analytical and comprehensive of the…

The politics of program evaluation are discussed from the personal perspective of the Director of the General Accounting Office's Program Evaluation and Methodology Division, which has produced reports for committees of the United States Congress. It is concluded that successful evaluations must be useful to others and must understand the…

This paper examines possible explanations for the fact that evaluation results are rarely used. Most explanatory factors for use of results in decision making mentioned in the literature have been clustered in three categories of variables. They concern: (1) the making of decisions about the practical problem; (2) the way in which evaluation is…

Value-added modeling (VAM) to estimate school and teacher effects is currently of considerable interest to researchers and policymakers. Recent reports suggest that VAM demonstrates the importance of teachers as a source of variance in student outcomes. Policymakers see VAM as a possible component of education reform through improved teacher…