Increased demand for accountability has forced Extension educators to evaluate their programs and document program impacts. Due to this situation, some Extension educators may view evaluation simply as the task, imposed on them by administrators, of collecting outcome and impact data for accountability. They do not perceive evaluation as a useful…

Evaluation of programs or projects is often perceived as a threat. This is to a great extent related to the anticipated use of evaluation for accountability, which is often prioritized at the expense of using evaluation as a learning tool. Frequently it is argued that there is a trade-off between these two evaluation functions. An alternative…

What do the findings of four National Science Foundation evaluation case studies suggest to an evaluation scholar who was not part of the research team that created them? This chapter carefully reviews the cases and summarizes their comparative findings. The four Beyond Use case studies add to the literature on levels of evaluation use, with the…

The intervention validity of cognitive assessment batteries is considered within an historical context to identify what the evidence supports (knowns), what cannot be known (unknowables), and what is not yet known (unknowns). Two ways cognitive batteries could inform intervention are identified: a disordinal (i.e., aptitude-treatment interaction)…

Recent legislative and local school accountability efforts have placed a premium on the collection, analysis, and use of student assessment data. Beyond state-based summative student achievement data, schools are searching for in-year information about student performance. As a result, school leaders are searching for the formative assessment…

This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

This new edition is the result of an extensive review of the standards as defined in 1981. Taken as a set, the 30 current standards provide a working philosophy for evaluation. They define the Joint Committee on Standards for Education Evaluation's conception of the principles that should guide and govern program evaluation efforts, and they offer…

Describes a formative evaluation proposal submitted to the Economic and Social Research Council (ESRC) in the United Kingdom to explore the potential impact of the Information Technology in Education Research (InTer) Program. The philosophies of evaluation and of the evaluator role are discussed, and aims and methodology of the evaluation are…

Addresses the need for careful planning and discernment when adopting new educational technology to ensure gains in student performance and to achieve learning goals. Topics include focusing on philosophical commitments and program purposes; challenging claims; testing; reviewing previous experiences; evaluating; and slowing down the purchase and…

Summarizes the creation and results of the 1997 National Assessment of Educational Progress (NAEP) Arts Assessment Report Card. Discusses the creation and the many improvements made to the NAEP Assessment, particularly the Arts Assessment. Discusses the impact of the assessment. (SC)

Evaluation must take into account both executive and legislative politics and their interactions. A five-part continuum evaluation process is suggested for the development of a policy question and its translation into knowledge that is credible, timely, responsive, and usable. Evaluators have a major responsibility in this process. (Author/JAZ)

A reorganized version of standards to be utilized for those who are involved with educational evaluation in Brazil was the result of a critical review of evaluation standards which were originally elaborated by the Joint Committee on Standards for Educational Evaluation. The conceptual framework for the critical review comprised logical…

The Holtzman Project at Northwestern University reviewed educational program evaluations at the federal, state, and local levels of government. This paper focuses on the administration of the project, including constraints on its operations, the strategic decisions that seemed correct at the time, and some decisions that now seem wrong. (BW)

Evaluation activities in China are examined, focusing on housing reform. How evaluation functions in justifying the political initiatives of the Chinese Communist Party is explored, and the possibility that evaluation research can become an academic field in China using Western methodology is discussed. (SLD)

Describes a 1984 report from the Rand Corporation that studied teacher evaluation practices. Problems revealed include lack of resolve and competence in principals, resistance or apathy of teachers, inconsistent evaluation practices between schools, and inadequate training for evaluators. (TE)