Although program evaluations using rigorous quasi-experimental or experimental designs can inform decisions about whether to continue or terminate a given program, they often have limited ability to reveal the mechanisms by which complex interventions achieve their effects. To illuminate these mechanisms, this article analyzes novel text data from…

Evaluation models have been taken as methodologies for actually conducting evaluations, instead of as persuasions or frameworks within which more specific constructs and methods must be placed. Although evaluation models do not provide methodologies, they do provide a guide for thinking about how an evaluation could be conducted. (Author/LC)

The Multiattribute Utility Model combines subjective goal definition with objective data analysis. Goals are defined, ranked, and weighted. Subjective opinions about their attainment are assigned against decision alternatives considered by the school. Bayesian analysis of data enables revision of prior opinions about the realization of goals…

A successful school program evaluation is re-examined to determine what made it successful. Suggestions for future evaluations include: (1) observe the political context of the program; (2) select a useful research design; (3) be sensitive to the subjects; and (4) discuss preliminary findings and be open to rebuttals. (JKS)

Objectives of Title I evaluations are to document: (1) use by local staff and parents; (2) other types of information used by local staff and parents in judging and in improving their program; and (3) implications of these findings for the current Federal Title I evaluation strategy. (Author/RL)

Chelimsky's five-part continuum--a model for the practice of evaluation in a political context--is reviewed. The model's conceptual framework and a question for education are discussed. By focusing on interactions between evaluators and policy actors, this model should prompt debates about unsettled issues in education policy making. (SLD)

Identifies, classifies, and describes the range of cost studies in education and how they may contribute to improved policy analysis. Presents three examples illustrating applications of cost analysis, and reflects on key issues from previous applications in educational policymaking and evaluation. (SLD)

The history of evaluation utilization in policy making and political features of program evaluation are discussed. A five-part continuum describes the evaluation process. Evaluation practice modifications contribute to real growth in evaluation use in congressional policy making as evaluation research improves the quality of information available…

The Judicial Evaluation Method (JEM) is useful for aiding decision-making bodies to formulate policies. Broad public participation in complex issues is provided by JEM. (The conceptualization, policy formulation stages, and participant roles are identified; and the model is applied in two case studies). (MH)

Techniques of cost-effectiveness analysis and their applications to educational policy are discussed. Recommendations are made to increase the capacity of evaluators, policy analysts, and decision makers to use these tools appropriately for resource allocation. (SLD)

An approach for involving beneficiaries in specifying program attributes for evaluators to address is discussed. Methods are outlined for sharing influence among program decision makers and beneficiaries. Application of this approach in the evaluation of a problem-based medical school curriculum is described, with evidence on the enhancement of…

The evaluation design described was used to aid the governing board to reach a policy decision about expanding the California Early Childhood Education program (renamed the School Improvement Program) in the Lafayette School District. Descriptions of procedures, question formats, audiences involved, and results are included. (MH)

Characteristics of evaluative studies used by California state legislators are discussed: specificity in addressing particular policy decisions; factors which contribute to or hinder the accomplishment of educational objectives; balanced studies with a range of indicators; and attention to local concerns, and to fiscal and legal issues. (MH)

The evolution of congressional support for educational programs and the impact of the present trend toward financial restraint are reviewed. Research, evaluation, and policy studies will help influence future decisions, although other factors such as the economy and interest group pressures will affect support. (MH)

Twenty-six congressional staff members dealing with educational legislation were surveyed concerning their sources of information and the relative importance and value of educational inquiry in various stages of the policy process. Conclusions were drawn and recommendations regarding improvement of the process were made. (MH)