Rutman's view of evaluability assessment is reviewed, evaluation planning activities are illustrated via flow diagram for a large educational evaluation designed to increase citizen participation in local school activities, and some of the limitations of Rutman's evaluability procedures are outlined. (RL)

Consequences of the bicultural goal are: (1) failure to review the unreasonable goal critically; (2) prevention of standardized scores from "leaking out" to the public; (3) attempts to "interpret" evaluation results to make them palatable to the schools' critics; and (4) lack of attention to various evaluation techniques. (RL)

Based on experiences of the American Institutes for Research in conducting evaluability assessment (EA), common problems include: finding client programs, balancing standardization and flexibility needs, satisfying two clients, maintaining schedules, and demise of client programs. Their successes include: surmounting bureaucratic complications,…

This paper presents a case for the use of causal models derived from a substantive knowledge base of theory and research in the evaluation of educational programs. An evaluation of the Adaptive Learning Environments Model (ALEM) illustrates the causal-modeling approach to program evaluation. (BW)

The following four integrative data analysis strategies for mixed-method evaluation designs are derived from and illustrated by empirical practice: (1) data transformation; (2) typology development; (3) extreme case analysis; and (4) data consolidation and merging. Use of these methods to realize the full potential of mixed-method approaches is…

A critical guide is offered regarding ethnographic evaluation data: the analytical descriptions or reconstructions of intact cultural scenes and groups which delineate the shared beliefs, practices, artifacts, folk knowledge, and behaviors of some group of people. (PN)

The Multiattribute Utility Model combines subjective goal definition with objective data analysis. Goals are defined, ranked, and weighted. Subjective opinions about their attainment are assigned against decision alternatives considered by the school. Bayesian analysis of data enables revision of prior opinions about the realization of goals…

A mixed-method conceptual framework was developed from the literature and refined through an analysis of 57 empirical mixed-method evaluations. Five purposes for mixed-method evaluation are identified (triangulation, complementarity, development, initiation, and expansion) and analyzed using the framework of 7 design characteristics. (TJH)

This paper focuses on evaluation-related behaviors of school principals. The role of principals as clients of professional evaluation is examined. Research that views principals as evaluators is reported. Concepts drawn from the literature are used to explore ways of studying the rationality that principals employ to make decisions. (Author/JAZ)

Chelimsky's five-part continuum--a model for the practice of evaluation in a political context--is reviewed. The model's conceptual framework and a question for education are discussed. By focusing on interactions between evaluators and policy actors, this model should prompt debates about unsettled issues in education policy making. (SLD)

A set of methods is proposed for the analysis of opportunity to learn (OTL) in relation to achievement in large-scale educational assessments. Methods are illustrated with data from the National Assessment of Educational Progress and the National Education Longitudinal Study. Implications for large-scale educational assessment are discussed. (SLD)

After a discussion of the underutilization of cost analysis in education, this article offers several explanations for the relative scarcity of cost-based evaluations in education and considers the potential for greater use of such studies. Developing frameworks to unpack costs may be a way of bringing about greater use of cost-based evaluation.…

Identifies, classifies, and describes the range of cost studies in education and how they may contribute to improved policy analysis. Presents three examples illustrating applications of cost analysis, and reflects on key issues from previous applications in educational policymaking and evaluation. (SLD)

The history and characteristics of the dominant evaluation model used in teacher education today, the Western Kentucky or Sandefur model, are described and evidence is offered of widespread anomalies in its usage. A new follow-up model that would permit informed decisions about the professional needs of teachers is proposed. (LC)

Validation studies, placement-enrollment comparisons, student surveys, and instructor interviews are discussed as operational methods in a synthesizing approach to undergraduate course placement evaluation. A range of suggested questions is coupled with various data sources in placement evaluation schemes and system procedures. (CM)