Researchers have documented the impact of rater effects, or raters' tendencies to give different ratings than would be expected given examinee achievement levels, in performance assessments. However, the degree to which rater effects influence person fit, or the reasonableness of test-takers' achievement estimates given their response patterns,…

This commentary discusses three essential themes in performance assessment and its scoring. First, scores should mean something. Second, performance scores should permit fair and meaningful comparisons. Third, validity-reducing errors should be minimal. Increased attention to performance assessment may overcome these problems. (SLD)

Describes educational assessment in Singapore and discusses changes planned to focus assessment on more real-life situations while taking into account research on learning and critical thinking. (SLD)

Describes seven topics that should be included in a course for teachers on performance assessment and provides some ideas for teaching them. The topics range from assessment selection to recognizing inappropriate, unethical, or illegal assessment methods and uses. (SLD)

The rise of criterion-referenced measurement from 1970 to 1984 was an important period in test development. Since 1984 there has been less research published on criterion-referenced measurement, but there is ample evidence that the concept remains important, especially in the authentic measurement and performance assessment movements. (SLD)

The implications for educational and employment testing of recent measurement, social, and policy issues are compared and contrasted. Changes are proposed relative to technical conceptualization of assessment, an increased focus on performance-based evaluation, and expanded expectations and uses of assessment. (SLD)

The use of performance assessments in accountability programs is discussed. Performance assessments have the potential to measure important objectives not easily measured by multiple-choice tests. Nevertheless, they are not suitable for every purpose, and their use should not be oversold. Many psychometric issues remain to be resolved. (SLD)

Some unfinished issues relating to achievement test theory that seemed implicit in the basic idea of criterion-referenced testing are reviewed, recognizing their importance in current studies of authentic assessment and performance-based tests. The future of performance-based evaluation is explored. (SLD)

Current successes and failures in U.S. educational measurement are reviewed, focusing on criterion-referenced testing. Pluses and minuses are listed for the following: (1) the move toward authentic assessment; (2) the dominance of criterion-referenced assessment; and (3) item response theory applications. Each area is a double-edged sword. (SLD)

Results are presented from a study of portfolio use for large-scale assessment in the Pittsburgh (Pennsylvania) public schools that are more encouraging for the use of this form of assessment than many other studies have been. Requirements for the psychometric integrity of portfolio assessment are discussed. (SLD)

A quiz is presented that may call the attention of school personnel to regression effects in educational measurement, and clarify the meaning of statistical regression for educators in schools. Ten questions and their answers explore regression in the contexts of classroom testing, grading, and performance assessment. (SLD)

This training module is intended to clarify the notion of portfolio assessment and help users design such assessments. The rationale for assessment alternatives is presented; and portfolio definitions, characteristics, pitfalls, and design considerations are reviewed. The use of portfolios in large-scale assessments is particularly demanding of…

One means of establishing the validity of performance-based assessments is to determine whether the criteria for basic competencies on performance tests are reasonable in relation to expected (nationally normed) age-level performance. Links between performances on three assessments in Michigan and the Comprehensive Tests of Basic Skills illustrate…

The extent to which performance assessments can have unintended and undesirable consequences is not yet clear, but preliminary evidence suggests several issues of bias and fairness. Among these is the sheer difficulty of scoring complex performance assessments, as Vermont's experiences with portfolio assessment illustrate. (SLD)

The effects of performance assessment on student learning were studied in third grades in three suburban schools and matched control schools. Performance measures did not produce clear and immediate improvements in student learning, but some positive changes were seen in mathematics. (SLD)