The present article considers a fundamental question in evaluation research: "By how much do program effects vary across sites?" The article first presents a theoretical model of cross-site impact variation and a related estimation model with a random treatment coefficient and fixed site-specific intercepts. This approach eliminates…

There are two mainstream curricula for international school students at the junior high level: the International Baccalaureate (IB) Middle Years Programme (MYP) and the Cambridge International General Certificate of Secondary Education (IGCSE). The former was developed in the mid-1990s and is currently being relaunched in a 21st-century approach.…

Wills and Pothos (2012) reviewed approaches to evaluating formal models of categorization, raising a series of worthwhile issues, challenges, and goals. Unfortunately, in discussing these issues and proposing solutions, Wills and Pothos (2012) did not consider Bayesian methods in any detail. This means not only that their review excludes a major…

The Multiattribute Utility Model combines subjective goal definition with objective data analysis. Goals are defined, ranked, and weighted. Subjective opinions about their attainment are assigned against decision alternatives considered by the school. Bayesian analysis of data enables revision of prior opinions about the realization of goals…

In the late 1990s, the Korea Ministry of Education and Human Resources, in response to concern over the relatively low standing of the nation's universities and researchers, launched the Brain Korea 21 program BK21). BK21 seeks to make Korean research universities globally competitive and to produce more high-quality researchers in Korea. It…

Individual differences in response to a given treatment have been a longstanding interest in education. While many evaluation studies focus on average treatment effects (i.e., the effects of treatments on the levels of outcomes of interest), this paper additionally considers estimating the effects of treatments on the dispersion in outcomes.…

Evaluation is discussed as an information-gathering process. Currently popular evaluation programs are reviewed in relation to decision making and various approaches that seem to contribute to the decision utility of evaluation (e.g. classical approaches, Bayesian approaches, adaptive designs, and model-based evaluations) are described. (Author/AL)

This study examined the appropriateness of the use of criterion referenced tests as a means of controlling an individual student's advancement to the next level of instruction or retention in the current unit in the PLATO Air Force Base Computer-Based Education project at Chanute. The study was also concerned with program evaluation, which…

The philosophy and assumptions of the Multi-Attribute Utility-Bayesian Decision Theoretic model (MAUT-Bayesian model) are presented. The evaluator uses the MAUT-Bayesian model along with the knowledge of the decision-maker's, and perhaps the evaluator's own values to decide what data should be collected. Appropriate data are presented to the…

The Multi-Attribute Utilities Theory (MAUT), a model for the evaluation of public postsecondary programs, is presented and is applied to a study of WINNERS (Women's Inner-City Educational Resources Service) with an analysis of the effects of the model on the program. The first chapter provides an overview of the MAUT approach, outlining 16 steps…