Evaluations are considered of key importance for a well-functioning democracy. Against this background, it is vital to assess whether and how evaluation models approach the role of citizens. This paper is the first in presenting a review of citizen involvement in the main evaluation models which are commonly distinguished in the field. We present…

Imagine a student using an intelligent tutoring system. A researcher records the correctness and time of each of your attempts at solving a math problem, nothing more. With no names, no birth dates, no connections to the school, you would think it impossible to track the answers back to the class. Yet, class sections have been identified with no…

International large-scale student assessments (ILSAs) in education represent a valuable source of information for policy-makers, not only on student achievements, but also on their relationship with different contextual factors. The results are partly described in the official studies' reports; more can be derived from the publicly released data…

The aim of this article is to analyse the direct and indirect effects that PISA generates in the orientation of educational policies and reforms in Spain and the ways in which PISA data and results are used in political discourses, at both national and sub-national levels. The main hypothesis of the article is that PISA results have played a key…

Little research has been done into how the results of the Programme for International Student Assessment (PISA) affect national educational reform and policy-making. This paper examines the normative impact of PISA by investigating how, and the extent to which , national policy actors use PISA in policies and practices, to evaluate and improve…

In this article we provide a critique of the interpretation and utilization of Programme for International Student Assessment (PISA) results by the National Education Authorities in Turkey. First, we define and explain what OECD's PISA is. Second, we make an overview of the media coverage in Turkey of the PISA 2003 and 2006 results. Third, we…

The chapter explores critical roles of internal evaluators in contemporary organizational settings. The need is highlighted for an expanded, reconfigured, unorthodox set of roles and styles of work to meet the needs of the emerging learning organizations effectively. A discussion of major categories of internal evaluator roles emerged from the…

Public organizations charged with coordinating higher education institutions face a complex set of tasks. Whether coordinating institutions within one sector or across sectors, such organizations play vital roles in promoting a state's capacity for policy leadership to meet the growing need for an educated citizenry. National experts have…

Use of decision support systems (DSS) to increase the utilization of management science models and accounting information is discussed. It is argued that application of the conceptual foundations of DSS to evaluation and other forms of applied social research is an effective means of increasing evaluation utilization by policymakers. (TJH)

The relationship between alternative evaluation approaches and the concerns of policy communities is examined. It is assumed that there are certain criteria and methods that are more relevant to particular types of policy discussions. Evaluation methodology should be based on the interests of the policy actors involved. (TJH)

Differing views about the success evaluators have had in improving programs directly are contrasted. It is suggested that evaluation, even when decisions are not based directly on evaluation outcomes, should represent continuing education for program managers, planners, and policy makers with probable impact in the future. (SLD)

The instrumental utilization of evaluation findings to assist in the development of program policy is discussed, drawing examples from an innovative human service program/policy that involves multiple funding ministries and participating agencies. Evaluation practices that enhance utilization, including pre- and postevaluation activities, are…

How policy is developed and how evaluators can participate in the process are discussed, focusing on federal evaluators. The strongest weapon of an evaluator is a short, easy-to-read report with a simple, compelling message. Federal policy evaluators must learn to be content with slow gains. (SLD)

The five chapters of this special issue provide insights into how Scandinavians understand evaluation practice. Although there is no "Scandinavian" perspective on evaluation, theory and practice in the Scandinavian countries unfold against sociocultural and intellectual influences that differ from those of the United States. (SLD)

Six articles on the relationship between policy theory and the practice of policy evaluation are presented. Articles address basic theoretical issues, theories in practice, the epistemological foundations of decision technology, selection of policy analysis instrumentation, utilization of public policy analysis, and justifying policy arguments.…