ERIC Number: EJ1322033
Record Type: Journal
Publication Date: 2021-Nov
Pages: 27
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1744-2648
EISSN: N/A
Available Date: N/A
Does Evaluation Quality Enhance Evaluation Use?
Bundi, Pirmin; Frey, Kathrin; Widmer, Thomas
Evidence & Policy: A Journal of Research, Debate and Practice, v17 n4 p661-687 Nov 2021
Background: Evaluations are a useful tool to learn more about the effectiveness of public measures. In the era of evidence-based policymaking, recent research suggests that quality is an important determinant of the utilisation of evaluations. Despite this claim, hardly any empirical study has investigated whether the quality of an evaluation -- measured by a meta-evaluation -- influences its perceived utilisation by decision makers. Aims and objectives: This article asks how the quality of an evaluation study is related to its perceived use, and investigates the relationship between the quality of an evaluation, assessed through a meta-evaluation, and how the evaluation is perceived and accepted by the parties concerned. Methods: The basis for the empirical analyses were 34 external evaluations, conducted from 2006 to 2014, of upper secondary schools in the canton of Zurich, as well as a standardised survey conducted among 307 representatives of these schools (teachers, administrators, members of quality development teams, and the heads of school oversight commissions). Findings: We conclude that the quality of the evaluation, as assessed in a meta-evaluation, is not particularly associated with the perception of evaluation quality and the perceived use of the evaluation. The perceived quality, however, is related to the perceived impact of an evaluation. Discussion and conclusion: These findings are relevant for evaluation research and practice, since they show that the quality of an evaluation and evaluation use do not necessarily go hand in hand.
Descriptors: Evaluation Utilization, Evaluation Methods, Institutional Evaluation, Secondary Schools, Foreign Countries, Teacher Attitudes, Administrator Attitudes
Policy Press. University of Bristol, 1-9 Old Park Hill, Bristol BS2 8BB, UK. Tel: +44-117-954-5940; e-mail: pp-info@policypress.co.uk; Web site: https://policypress.co.uk/journals/evidence-and-policy
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Switzerland
Grant or Contract Numbers: N/A
Author Affiliations: N/A