Existing methods for the analysis of ordinal-level data arising from judge ratings, such as the Multi-Facet Rasch model (MFRM, or the so-called Facets model) have been widely used in assessment in order to render fair examinee ability estimates in situations where the judges vary in their behavior or severity. However, this model makes certain…

Contrasts "mental models" used by automated scoring for the simulation division of the computerized Architect Registration Examination with those used by experienced human graders for 3,613 candidate solutions. Discusses differences in the models used and the potential of automated scoring to enhance the validity evidence of scores. (SLD)

College debaters who go to law school are often surprised by the differences between the processes that take place in the court of reason and the process that takes place in the court of law. The court of reason relies mainly on authoritative testimony, while the court of law relies on direct evidence. Evidence in the court of reason is either…