Cost-effectiveness analysis is rarely used in education. When it is used, it often fails to meet methodological standards, especially with regard to cost measurement. Although there are occasional criticisms of these failings, we believe that it is useful to provide a listing of the more common concerns and how they might be addressed. Based upon…

The Programme for International Student Assessment (PISA) was designed by the Organization for Economic Cooperation and Development (OECD) to evaluate the quality, equity, and efficiency of school systems around the world. Specifically, the PISA has assessed 15-year-old students' reading, mathematics, and science literacy on a 3-year cycle, since…

Since educational criticism aims to reeducate teachers' perception in order to improve or illuminate educational practices, the audience's role is particularly important. In many ways, the intended audience determines the evidence presented. The evaluator must write the criticism in language which is meaningful to the audience (for example…

Presents a history of the National Assessment of Educational Progress (NAEP), focusing on procedural changes from 1969 to date and questions whether NAEP results should be used for accountability purposes. It recommends that NAEP should be insulated from reform efforts and that NAEP's monitoring of population levels of educational achievement…

Highlights several articles that raise questions about the role of research in educational reform. These articles argue over the use of National Assessment of Educational Progress results for accountability purposes; and the advisability of using cost-benefit analysis in critiquing educational reform proposals, and particularly, in evaluating the…

Unintended effects of evaluation are discussed, with reference to the Hawthorne Effect, where unintended effects overshadow the manipulations controlled by researchers. Unintended effects are categorized as (1) affective reactions; (2) political dimensions; (3) importance of individual differences; and (4) expectations concerning evaluation.…

Examines perspectives of Barbadian teachers on existing methods for evaluating teachers and on recommendations set forth in the literature. Results revealed support for evaluation but much dissatisfaction with existing methods. Points out that primary teachers are more inclined to believe that evaluation is a basis for promotion. (KO)

This chapter discusses the evolution of alumni studies in the United States and how alumni data can be used to inform public policy.

The goal of this research project was to create a guide on the effective use of assessment instruments and methodologies, related resources, and guidelines for measuring adult learners' attainment of basic skills and competencies to document educational gains and demonstrate program quality. The project focused on confirming current use of…

The politics of program evaluation are discussed from the personal perspective of the Director of the General Accounting Office's Program Evaluation and Methodology Division, which has produced reports for committees of the United States Congress. It is concluded that successful evaluations must be useful to others and must understand the…

The history of the African people before slavery and colonization illustrates the ways in which different pictures of reality are created by which data are selected and ignored. The model of inquiry that verifies historical accuracy can help all program evaluators provide greater truth and equity for their clients. (SLD)

Although methodological integrity is not the sole determinant of the value of a program evaluation, decision-makers do have a right, at a minimum, to be able to expect competent work from evaluators. This paper explores five areas where evaluators might improve methodological practices. First, evaluation reports should reflect the limited…