The purpose of this study was to test methods that strengthen the comparability claims about annual determinations of student proficiency in English language arts, math, and science (Grades 3-12) in the New Hampshire Performance Assessment of Competency Education (NH PACE) pilot project. First, we examined the literature in order to define…

The engagement of teachers as raters to score constructed response items on assessments of student learning is widely claimed to be a valuable vehicle for professional development. This paper examines the evidence behind those claims from several sources, including research and reports over the past two decades, information from a dozen state…

Provides a general framework for examining the consequences of assessment programs, especially statewide programs that intend to improve student learning by holding schools accountable. The framework is intended for use with programs using performance-based tasks but can be used with programs using traditional item formats as well. (SLD)

Reports on an ongoing evaluation of the Vermont portfolio assessment program. Indicates that the positive news about the instructional effects of the assessment program are in contrast with the empirical findings about the quality of the data the program has yielded. (SLD)

The use of performance assessments in accountability programs is discussed. Performance assessments have the potential to measure important objectives not easily measured by multiple-choice tests. Nevertheless, they are not suitable for every purpose, and their use should not be oversold. Many psychometric issues remain to be resolved. (SLD)

Current successes and failures in U.S. educational measurement are reviewed, focusing on criterion-referenced testing. Pluses and minuses are listed for the following: (1) the move toward authentic assessment; (2) the dominance of criterion-referenced assessment; and (3) item response theory applications. Each area is a double-edged sword. (SLD)

How portfolio-based conclusions about student learning might be used to communicate with audiences outside the classroom is explored. Procedures and criteria for investigating validity in portfolio use are discussed. Ten portfolios from an eighth grade language arts class are used as an example. (SLD)