It is one thing to produce an innovative, construct-based assessment task; it's another to produce 10 a year that are comparable in difficulty, measure the same competencies, are free of differential item functioning, and can be scaled and equated. These challenges contributed to the failure of the performance (or authentic) assessment movement of…

The preceding articles in this issue describe a diverse range of projects which had in common the aim of implementing or improving the practice of formative assessment, and thereby to secure some of the benefits attributed to it. This article attempts to set up a framework within which each of the different studies may be located and…

Too often, teacher evaluations haven't provided enough information to spur improvement in teaching. The vast majority of teachers in any school, district, or state are rated above--sometimes well above--average. The feedback that teachers do receive is often not specific enough to help them improve. In this article, Morgaen Donaldson explores some…

This article chronicles the evolution of a large research extensive institution's General Education writing assessment efforts from an initial summative focus to a formative, improvement focus. The methods of assessment, which changed as the assessment purpose evolved, are described. As more data were collected, the measurement tool was…

Areas of evaluation are identified in which the formative/summative distinction appears inadequate: (1) knowledge-generating evaluations aimed at conceptual use; (2) developmental evaluation; and (3) use of evaluation to support intervention or empower participants. An argument is also made for the effectiveness of feedback that cannot be…

Critically examines five issues surrounding the use of student evaluations of teaching for summative decisions: current practices, validity concerns, improving the reporting of results, improving the decision-making process, and incorporating validity estimates into the decision-making process. Concludes with a list of recommendations for…

A utilization-focused approach in evaluating a problem-solving skills training program (see TM 510 179) would have placed more emphasis on identifying evaluation users, their information needs, and likely use of findings. Other methods options are also discussed, along with how to prepare decision makers for utilization. (Author/BW)

The dynamic interplay between internal and external evaluation in formative and summative studies of an intervention program aimed at promoting mathematics, science, and technology education was explored. Results emphasize the need to define the roles of formative and summative evaluation and the contributions of internal and external evaluators…

The effects of a school district's testing and evaluation activities cannot be effectively assessed without an understanding of the explicit and implicit goals embedded in the policies and practices of the district. A structured workshop process to elicit a district's intentions related to the effects--uses and impacts--of testing and evaluation…

From 1980 through 1983, 41 articles in selected professional journals dealt with summative evaluation of training and development efforts in business and industry. All of the standard components of program evaluation were addressed either directly or indirectly in them, in varying degree and depth. Although one must contact the primary audience to…

Four forms of evaluation are outlined: (1) evaluation and development; (2) design evaluation; (3) process evaluation; and (4) summative evaluation. Each form is understood through five dimensions (orientation, state, focus, timing, and approach), which are illustrated through evaluation of a community services training program in Australia. (SLD)

The Education Consolidation and Improvement Act (ECIA) Chapter 2 Evaluation Unit provides program evaluation and evaluation technical services for designated ECIA Chapter 2 projects in the District of Columbia Public Schools. This report examines the status of inputs, processes, and outcomes, intended and observed, of the Evaluation Unit during…

Deliberately involving urban education stakeholders in the Cities-in-Schools evaluation study improved the utility of the findings for formative evaluation stakeholders but not for summative evaluation stakeholders. (Author/PN)

This document provides a detailed overview of all data collection, analysis, and reporting aspects of a third-party, independent evaluation conducted in Illinois to determine the impact of the 214 vocational education Quality Assistance Plans funded in fiscal year 1983. The effectiveness of the Impact Assessment Design as a resource in Quality…

The purpose of evaluation in education projects is explored, through examples from English Language Teaching aid projects in developing countries. The distinction between formative and summative evaluation is conceptualized in terms of purpose rather than temporality, and the role of evaluation in program improvement is stressed. (SLD)