Two case studies are presented to compare and contrast the challenges encountered when attempting to conduct participatory evaluations (P-Es) with tribal programs that represented two extremes of collaboration between the programs and evaluators. In one case, the P-E was successful because the principals were invested in the program, whereas in…

Evaluation researchers and practitioners acknowledge that involving stakeholders in the planning and implementation of an evaluation increases buy-in, understanding, and use. With the recent increase in multi-site evaluations of large federal programs, evaluators must think differently about how to encourage meaningful collaboration by…

Race to the Top represented a new paradigm in federal education. Instead of spreading relatively modest dollars evenly across all jurisdictions through funding formulas--as virtually all federal education funding has been and continues to be spent--a small number of successful states received all of the available funding, and in turn made it…

As the number of large federal programs increases, so, too, does the need for a more complete understanding of how to conduct evaluations of such complex programs. The research literature has documented the benefits of stakeholder participation in smaller-scale program evaluations. However, given the scope and diversity of projects in multi-site…

Multilevel programs--that is, programs with multiple levels of administration, funding, and implementation--present dynamic and challenging environments for the conduct and use of evaluation. The challenges include questions, priorities, audiences, and purposes that vary at each level. This chapter discusses the challenges as well as the…

This article presents an interview with Eric Barela, a K-12 school district internal evaluator who conducted the Title I Best Practices study for the Los Angeles Unified School District (LAUSD), Research and Planning Division (formerly known as the Program Evaluation and Research Branch). In this interview, the author focuses not only on the…

The purpose of this Guide is to provide education officials, program providers, and others seeking to sponsor a rigorous program evaluation with practical advice on finding a capable evaluator. More specifically, this Guide offers practical advice on finding an evaluator to conduct a rigorous evaluation to measure the effect of an educational…

In the past three decades, program evaluation has sought to more fully engage stakeholders in the evaluative process. But little information has been gathered from stakeholders about how they share in evaluation tasks and whether role sharing leads to confusion or tensions between the evaluator and the stakeholders. This article reports findings…

This article focuses on the management of federally funded evaluation research by (1) discussing aspects of building an in-house evaluation team; (2) defining possible contractor/client relationships, and (3) considering contractor/practitioner team rapport. (Author/GK)

The purpose of this Guide is to advise researchers, policymakers, and others on when it is possible to conduct a high-quality randomized controlled trial in education at reduced cost. Well-designed randomized controlled trials are recognized as the gold standard for evaluating the effectiveness of an intervention (i.e., program or practice) in…

How can indigenous evaluators implement culturally competent models in First Nations communities while ensuring that government grant evaluation requirements are met? Through describing the challenges in one tribal community in the United States, this article will discuss how American Indian/Alaska Native substance abuse prevention programs are…

Part of a forum on a Federal offices' search for a strategy to gain better evaluation utilization, this paper discusses the strategy's conception. Three categories of educational evaluations, defined by social and structural characteristics of the program environment, are identified: (1) trial evaluations, whose funding is not guaranteed beyond…

Certain expectations that federal officials have about evaluation researchers are discussed. Included are: (1) presence of a clear understanding of what evaluation means; (2) procedure for carrying out an evaluation; and (3) understanding by the evaluator of how the research relates to the decision-making process. (Author/GK)

Four functions of federal project officers in managing program evaluations with support from contract research firms are described: (1) articulating evaluation requirements; (2) providing for fairness in contract awards; (3) monitoring ongoing studies; and (4) transmitting evaluation results to decision makers. (Author/PN)

Briefly describes the content, organization, and multiple influences on the 4-H program in relation to a national program evaluation. Discusses influences of the sponsors and evaluators on the evaluation and problems encountered because of competing values and perceptions. Reviews evaluation findings and speculates on the utilization of the…