Research on the evaluation of large-scale public-sector reforms is rare. This article sets out to fill that gap in the evaluation literature and argues that it is of vital importance since the impact of such reforms is considerable and they change the context in which evaluations of other and more delimited policy areas take place. In our…

Cost-effectiveness analysis is rarely used in education. When it is used, it often fails to meet methodological standards, especially with regard to cost measurement. Although there are occasional criticisms of these failings, we believe that it is useful to provide a listing of the more common concerns and how they might be addressed. Based upon…

The landscape of medical education is continuously evolving, as are the needs of the learner. The appropriate use of research and evaluation is key when assessing the need for change and instituting one's innovative endeavours. This paper demonstrates how research seeks to generate new knowledge, whereas evaluation uses information acquired from…

This paper discusses one of the fundamental issues in education and social program evaluation: the proper role for an evaluator. Based on respective and comparative analysis of five theorists' positions on this fundamental issue, this paper reveals how different perspectives on other fundamental issues in evaluation such as value, methods, use and…

By examining the development of a local school reform that was meant to be teacher-driven, this multiple case study explored the limits on evaluation use in a hierarchical setting in which multiple audiences exist. This study was a comparative analysis of the actions and evaluation philosophies of two district administrators responsible for…

A cross-case analysis of four National Science Foundation (NSF) case studies identified both unique details and common themes related to promoting the use and influence of multisite evaluations. The analysis provided evidence of diverse evaluation use by stakeholders and suggested that people taking part in the multisite evaluations perceived…

Child assessment practices in English and Korean preschools were compared by analysing data from interviews with educators, examples of child assessment, and official documents from each country. Child assessment in England was systematically implemented and characterised by several methodological and procedural strengths, whereas assessment in…

LOCO-Analyst is a learning analytics tool we developed to provide educators with feedback on students learning activities and performance. Evaluation of the first version of the tool led to the enhancement of the tool's data visualization, user interface, and supported feedback types. The second evaluation of the improved tool allowed us to see…

Elementary general music teachers typically teach hundreds of students every week. Each child has individual learning needs due to a variety of factors, such as prior experiences with music, music aptitude, learning style, and personality. The purpose of this qualitative study was to explore ways that experienced teachers used assessments to…

Two forms of naturalistic evaluation have appeared within the past decade: (1) a collection of qualitative techniques that are complimentary with conventional quantitative methods; and (2) an alternative paradigm that emphasizes the negotiation of multiple socially constructed realities, interdependence of facts and values, and the emergent…

This paper examines the current academic and policy literatures concerning school evaluation in primary and secondary education within the OECD countries. First, it provides a typology of the existing systems of school evaluation across the OECD. It encompasses the diverse criteria and instruments commonly used to carry out schools evaluation, as…

A comparative evaluation of two underground coal mines identified the reasons why one was the most productive and the other was the least productive mine operated by the company. The vested interests of contending groups provide a partial explanation. The problem-solving process evolving out of the evaluation is described. (SLD)

The Office of Management and Budget has recommended the termination of numerous federal programs, citing a lack of program results as the primary reason for this decision. In response to this recommendation, several federal agencies have turned to logic modeling to demonstrate that programs are on the path to results accountability. However,…

Among the different types of experimental design are two general categories: true experimental designs and quasi- experimental designs. True experimental designs include more than one purposively created group, common measured outcomes, and random assignment. Quasi-experimental designs are commonly used when random assignment is not practical or…

The political context of evaluation is compared for the United States and developing countries, and a framework is proposed for discussing the political context of evaluation. Significant differences are the role that international donor agencies play in developing countries and the emphasis on stakeholder evaluation in the United States. (SLD)