Researchers have documented the impact of rater effects, or raters' tendencies to give different ratings than would be expected given examinee achievement levels, in performance assessments. However, the degree to which rater effects influence person fit, or the reasonableness of test-takers' achievement estimates given their response patterns,…

Rater training is an important part of developing and conducting large-scale constructed-response assessments. As part of this process, candidate raters have to pass a certification test to confirm that they are able to score consistently and accurately before they begin scoring operationally. Moreover, many assessment programs require raters to…

The focus is on partitioning the evaluation of the consequences of assessment programs among the sponsors, developers, users, and reviewers of tests. Five parties that share responsibility are discussed: (1) the state legislature, (2) the state board of education, (3) the school district, (4) the test publisher, and (5) the measurement profession.…