This article will focus on the potential role for youth evaluation advisory groups within youth grant-making organizations and networks. The main elements to be discussed include the formation of the network, the training program elements, some specific examples of efforts by young people to create and strengthen evaluation within their YACs…

With the vast array of contextual factors, pedagogical approaches, models of implementation, and purposes of education and training related to online learning, educators, learners, and the general public alike are seeking answers regarding utility and effectiveness of online learning. This article identifies and responds to many of the challenges…

From the 1980s to the present, educational accountability in the United States has grown dramatically. Such accountability in U.S. school districts, although driven primarily by external demands, has internal manifestations as well. The chapter traces the historical development of internal evaluation in American school districts, then highlights…

The value of a program can be understood as referring not only to outcomes, but also to how those outcomes compare to the types and amounts of resources expended to produce the outcomes. Major potential mistakes and biases in assessing the worth of resources consumed, as well as the value of outcomes produced, are explored. Most of these occur…

The authors propose a comprehensive evaluation framework to prepare for evaluating school emergency management programs. This framework involves a logic model that incorporates Government Performance and Results Act (GPRA) measures as a foundation for comprehensive evaluation that complements performance monitoring used by the U.S. Department of…

In contrast to typical National Science Foundation program evaluations, the Utah State Math Science Partnership-Research, Evaluation and Technical Assistance Project (MSP-RETA) provided technical assistance (TA) in two forms: direct TA for up to 10 projects a year, and professional development sessions for a larger number of project staff. Not…

The author, a federal manager who leads development and maintenance of evaluation for specific public health programs at the Centers for Disease Control and Prevention, tells the story of developing an evaluation unit in the Office on Smoking and Health. Lessons about managing evaluation, including his practices and related principles, are…

Critical race theory (CRT) is a relatively new theory that has been little used in evaluation practice. The authors explore an example of critical race evaluation working with James Comer's School Development Program. In this evaluation common tropes associated with CRT were used to construct a counternarrative of school reform. The authors…

Evaluators have written about the need to consider context in conducting evaluations, but most such admonitions are broad. Context is not developed fully. This chapter reviews the evaluation literature on context and discusses the two areas in which context has been more carefully considered by evaluators: the culture of program participants when…

This chapter describes a concrete process that stakeholders can use to make predictions about the future performance of programs in local contexts. Within the field of evaluation, the discussion of validity as it relates to outcome evaluation seems to be focused largely on questions of internal validity (Did it work?) with less emphasis on…

Evaluation of programs or projects is often perceived as a threat. This is to a great extent related to the anticipated use of evaluation for accountability, which is often prioritized at the expense of using evaluation as a learning tool. Frequently it is argued that there is a trade-off between these two evaluation functions. An alternative…

The authors tell about their heterogeneous 91 person research and evaluation unit at an operating foundation in St. Paul, Minnesota. They focus on evaluation for program improvement, one of several purposes of studies they work on. The three authors write from their different manager positions within the unit. Included are the context of the…

Five knowledge-for-action theories are summarized and compared in this chapter for their evaluation implications: knowledge utilization, diffusion, implementation, transfer, and translation. Usually dispersed across multiple fields and disciplines, these theories are gathered here for a common focus on knowledge and change. Knowledge in some form…

Impact evaluations assess the degree to which changes in outcomes can be attributed to an intervention rather than to other factors. Such attribution requires knowing what outcomes would have looked like in the absence of the intervention. This counterfactual world can be inferred only indirectly through evaluation designs that control for…

An external evaluation documented what occurred in an inaugural summer camp to teach high school students how to preserve religious freedom by learning about and acting on the history and current state of church-state separation and other first amendment issues. Camp designers hoped to promote religious diversity values and civic engagement in…