Automated Essay Scoring (AES) tools aim to improve the efficiency and consistency of essay scoring by using machine learning algorithms. In the existing research work on this topic, most researchers agree that human-automated score agreement remains the benchmark for assessing the accuracy of machine-generated scores. To measure the performance of…

This first-ever look at the national charter school pipeline--what schools are being proposed and by whom--reveals a diverse sector, with a tremendous variety of applicants and school models. Working with Public Impact, National Association of Charter School Authorizers (NACSA) collected and analyzed nearly 3,000 charter school applications…

This essay explores the implications of the zeitgeist that emerged in the United States during the 1960s for the conceptualization of ethical issues in evaluation and community psychology, and how perspectives from the latter field might enhance ethical practice in the former. Special attention is paid to articulations of social justice,…

Continuing professional development (CPD) evaluation in education has been heavily influenced by "level models", deriving from the work of Kirkpatrick and Guskey in particular, which attempt to trace the processes through which CPD interventions achieve outcomes. This paper considers the strengths and limitations of such models, and in…

Measuring the various structural aspects of the organizing framework for this volume and relating them to match quality and relevant developmental outcomes is a critical step toward assessing the framework's utility for practitioners, policymakers, and program evaluators. Nakkula and Harris take a step in that direction by exploring core…

Whether looking at the spread and adoption of an intervention across a community, across multiple units, or within a single unit, an understanding of diffusion theory can help evaluators uncover patterns and impacts that might otherwise be overlooked. The theory alerts evaluators to examine why uptake of an intervention appeared different in…

Transfer is a term used in many fields to describe a change process involving movement of knowledge, skills, or policy from one place to another. The central components of transfer invite the evaluator to conceptualize the change process in terms of a starting point, different understandings of what is being transferred, the medium or mechanism,…

Translation theory originates in the field of applied linguistics and communication. The term knowledge translation has been adopted in health and other fields to refer to the exchange, synthesis, and application of knowledge. The logic model is a circular or iterative loop among various knowledge translation actors (knowledge producers and users)…

Knowledge utilization is a field crossing many sectors, from agriculture, since the 1920s, to health care today. Evaluators have made long-standing contributions to understanding knowledge utilization. Different models or ways to think about knowledge utilization have evolved to reflect different perspectives, contexts, and stages of the process,…

Background: Since the late 1970s participatory approaches have been widely promoted to evaluate international development programs. However, there is no universal agreement of what is meant by participatory evaluation. For some evaluators, participatory evaluations involve the extensive participation of all stakeholder groups (from donor to…

This article describes an evaluation that was judged to be unsuccessful from the point of view of key program stakeholders. This was due to the fact that the evaluation did not support program advocates who had much to gain from positive evaluation findings. We argue that, although the knowledge needs of stakeholders must be taken into account,…

The purpose of this paper is to inform evaluators of a method of evaluating capacity building in educational programs. One definition of capacity building is helping an organization increase its ability to fulfill its mission (Wing, 2004). Evaluators of capacity-building efforts therefore must focus on evidence that the program has helped to build…

Race to the Top represented a new paradigm in federal education. Instead of spreading relatively modest dollars evenly across all jurisdictions through funding formulas--as virtually all federal education funding has been and continues to be spent--a small number of successful states received all of the available funding, and in turn made it…

This article is concerned with the underpinnings of practical participatory evaluation (PPE). Evaluation approaches have long been criticized because their results are often not used. It is believed that PPE addresses this drawback. The article focuses on the mechanisms underlying the links between activities and consequences in PPE. A PPE theory…

This article focuses on ethical issues faced in evaluation practice from the viewpoint of third generation of activity theory, which gives a constructive perspective on how contradictions can be a driving force behind interorganizational learning and development in multiactor networks. The problem field is firstly addressed through an illustration…