Despite growing calls for more accountability of teacher education programs (TEPs), there is little consensus about how to evaluate them. This study investigates the potential for using observational ratings of program completers to evaluate TEPs. Drawing on statewide data on almost 9,500 program completers, representing 44 providers (183…

Discusses reasons randomized experiments in educational research have been so rare and appraises alternatives to experiments that educational evaluators prefer. These alternatives are found wanting whenever a high standard is needed for justifying causal conclusions. (SLD)

Evaluation models have been taken as methodologies for actually conducting evaluations, instead of as persuasions or frameworks within which more specific constructs and methods must be placed. Although evaluation models do not provide methodologies, they do provide a guide for thinking about how an evaluation could be conducted. (Author/LC)

This paper presents a case for the use of causal models derived from a substantive knowledge base of theory and research in the evaluation of educational programs. An evaluation of the Adaptive Learning Environments Model (ALEM) illustrates the causal-modeling approach to program evaluation. (BW)

Meltsner classified evaluators as technicians, politicians, entrepreneurs, or pretenders, based upon differing expectations norms, training, and motivations. This role-perception study of evaluators in a large urban school district supported Meltsner, although few technicians or politicians emerged. (CP)

This paper presents (1) a review of national policy guidelines for the evaluation of vocational education; (2) a description and analysis of the typical responses of state and local agencies of evaluation requirements; (3) some evaluation issues that may be applicable to vocational education evaluation; and (4) suggestions for improving vocational…

In the form of a play, a brief discussion is presented of program evaluation problems at the elementary/secondary education level. (PN)

The Multiattribute Utility Model combines subjective goal definition with objective data analysis. Goals are defined, ranked, and weighted. Subjective opinions about their attainment are assigned against decision alternatives considered by the school. Bayesian analysis of data enables revision of prior opinions about the realization of goals…

The relative utilities of subjectivity and objectivity in educational evaluation are debated. Page supports objectivity, while Stake supports subjectivity. (JKS)

A mixed-method conceptual framework was developed from the literature and refined through an analysis of 57 empirical mixed-method evaluations. Five purposes for mixed-method evaluation are identified (triangulation, complementarity, development, initiation, and expansion) and analyzed using the framework of 7 design characteristics. (TJH)

The design and conduct of a national evaluation study is discussed, demonstrating that a control group may not provide the no-cause baseline information expected. Resolution of this problem requires reexamination of paradigms, research practices, and policies, as well as the underlying real world constraints and views that generate them. (PN)

A successful school program evaluation is re-examined to determine what made it successful. Suggestions for future evaluations include: (1) observe the political context of the program; (2) select a useful research design; (3) be sensitive to the subjects; and (4) discuss preliminary findings and be open to rebuttals. (JKS)

This paper describes eight problems faced by a school district evaluator in evaluating state-funded, compensatory education programs: determining evaluation ownership, determining the major constraints, determining what to evaluate, determining what methods to use, determining participant characteristics, determining instrumentation, determining…

Chelimsky's five-part continuum--a model for the practice of evaluation in a political context--is reviewed. The model's conceptual framework and a question for education are discussed. By focusing on interactions between evaluators and policy actors, this model should prompt debates about unsettled issues in education policy making. (SLD)

After a discussion of the underutilization of cost analysis in education, this article offers several explanations for the relative scarcity of cost-based evaluations in education and considers the potential for greater use of such studies. Developing frameworks to unpack costs may be a way of bringing about greater use of cost-based evaluation.…