This chapter discusses the impact that four multisite National Science Foundation (NSF) evaluations had on the broader field of science, technology, engineering, and mathematics education and evaluation. Three approaches were used to investigate the broader impact of these evaluations on the field: (a) a citation analysis, (b) an on-line survey,…

A team at the University of Minnesota conducted the Collaboratives for Excellence in Teacher Preparation (CETP) core evaluation between 1999 and 2004. The purpose of the CETP core evaluation was to achieve consensus among CETP project leaders and project evaluators on evaluation questions; to develop, pilot, and field test evaluation instruments…

This paper reviews empirical research on the use of evaluation from 1986 to 2005 using Cousins and Leithwood's 1986 framework for categorizing empirical studies of evaluation use conducted since that time. The literature review located 41 empirical studies of evaluation use conducted between 1986 and 2005 that met minimum quality standards. The…

Meta-evaluations reported in the literature, although rare, often have focused on retrospective assessment of completed evaluations. Conducting a meta-evaluation concurrently with the evaluation modifies this approach. This method provides the opportunity for the meta-evaluators to advise the evaluators and provides the basis for a summative…

As the number of large federal programs increases, so, too, does the need for a more complete understanding of how to conduct evaluations of such complex programs. The research literature has documented the benefits of stakeholder participation in smaller-scale program evaluations. However, given the scope and diversity of projects in multi-site…

Use of evaluation findings is a valued outcome for most evaluators. However, to optimize use, the findings need to be disseminated to potential users in formats that facilitate use of the information. This reflective case narrative uses a national evaluation of a multisite National Science Foundation (NSF) program as the setting for describing the…

In this article, the authors examine evaluation process use in a large multilevel, multisite core evaluation. This case highlights the nature of the evaluation processes of the Collaboratives for Excellence in Teacher Preparation (CETP) core evaluation in terms of four categories: (1) social processing; (2) engagement; (3) involvement; and (4)…

This article presents a brief history of the National Science Foundation's involvement in education evaluation, reviews the program evaluations that NSF's Division of Research, Evaluation, and Communication (REC) has conducted in recent years, and describes future directions. The evaluations have reflected the field-driven nature of NSF's…