Researchers have documented the impact of rater effects, or raters' tendencies to give different ratings than would be expected given examinee achievement levels, in performance assessments. However, the degree to which rater effects influence person fit, or the reasonableness of test-takers' achievement estimates given their response patterns,…

Drawing on Glenn Fulcher's extensive work in performance-based language assessment of speaking, this paper explores the assessment of L2 speaking ability in local language testing contexts. For that purpose, I review Fulcher's influential work that highlights the relationship between the speaking construct, the task, the performance, and the…

Identifies fallacies in the logic of performance measurement (PM) and provides examples of the ways in which PM is routinely misused. Also identifies strategies for effective use of PM and shows how PM can be used for monitoring purposes, raising questions, and identifying areas requiring management attention. (SLD)

This article describes the findings of studies conducted on a large-scale, classroom-based performance assessment of literacy for the early grades designed to provide information that is useful for reporting, as well as teaching. Technical studies found the assessment to be a promising instrument that is reliable and valid. Follow-up studies of…

Describes the implementation plans, experience, and results of incorporating performance measurement into the accreditation process of the Joint Commission on the Accreditation of Healthcare Organizations. Traces the evolution of standardized core measures known to be valid and reliable, noting political and technical problems in measure…

This paper reports the results of an analysis of the relationship between scorer behaviors and score variability. Thirty-six essay scorers were interviewed and asked to perform a think-aloud task as they scored 24 essays. Each comment made by a scorer was coded according to its content focus (i.e. appearance, assignment, mechanics, communication,…

Reviews developments in educational assessment and in journals devoted to assessment during the editor's tenure with this journal, with a special focus on the place of performance assessment. Discusses the problem of generalizability in many new forms of assessment. (SLD)

This report describes a program that was implemented to improve student assessment through the use of portfolios. The targeted population consisted of a first and third grade classroom in a suburb of a large Midwestern metropolitan area. The problems related to assessment were documented by state mandated test scores, teacher determined grades,…

The Performance Assessment System (PAS) is a portfolio-assessment mechanism used to evaluate beginning teacher performance as a function of the teacher's approach and effectiveness at increasing student learning. The development, scoring, and use of the PAS are described. (SLD)

To say that assessments must be authentic, dynamic, fluid, and formative is not to say that normative, standardized evaluations have no place in the overall assessment scheme. What is needed is a combination and balance of assessments. The tri-assessment model promotes using traditional assessments along with portfolio and performance assessments.…

This book reviews the assessment movement, from the history of testing to the practical considerations of enhancing classroom experiences for teachers and students. It explores making time for assessment, tailoring assessment to desired outcomes, and scoring and evaluating student performance. The chapters are: (1) "Where We've Been: Standardized…

It is proposed that criteria for evaluating the quality of performance should be defined, at least tentatively, during the initial design of a performance assessment. Six characteristics of sound criteria are (1) significance; (2) fidelity; (3) generalizability; (4) developmental appropriateness; (5) accessibility; and (6) utility. (SLD)

Since the late 1960s, curriculum and instruction have increasingly become "test driven." Research documents the negative effects of standardized testing on instruction, students, and teachers. At their best, tests reflect students' ability to take tests. Research supports the need for change in testing policies. Massive testing must be eliminated,…

The usefulness of authentic assessments as formative tools for teachers is well documented and supported. However, when educational institutions use these assessments as summative tools for evaluating programs and meeting accountability needs, several problems emerge. One set of problems relates to the difficulty of fitting authentic assessments…

This collection of examples of authentic assessments has been compiled to provide a sampling of the many new strategies for evaluating student work and learning that are being developed and used in schools around the country. These strategies are called "authentic" because they require that students demonstrate what they can do as…