Scoring procedures for the constructed-response (CR) items in large-scale mixed-format educational assessments often involve checks for rater agreement or rater reliability. Although these analyses are important, researchers have documented rater effects that persist despite rater training and that are not always detected in rater agreement and…

In today's digital age, tests are increasingly being delivered on computers. Many of these computer-based tests (CBTs) have been adapted from paper-based tests (PBTs). However, this change in mode of test administration has the potential to introduce construct-irrelevant variance, affecting the validity of score interpretations. Because of this,…

Instructors can use both "multiple-choice" (MC) and "constructed response" (CR) questions (such as short answer, essay, or problem-solving questions) to evaluate student understanding of course materials and principles. This article begins by discussing the advantages and concerns of using these alternate test formats and…

In two studies, selections of evaluation form items were negatively worded and presented before or after overall student ratings. Ratings of courses and instructors were not significantly affected by wording. Differences in the global assessment of the courses are discussed. (Author/CM)

Claims that in the conventional administration of the Informal Reading Inventory (IRI) comprehension diagnosis is inordinately influenced by the reader's ability to recall information. Suggests that allowing reinspection by the reader restores recall to its proper function and may result in other advantages. (NH)