The documentation of test takers' achievements has been accomplished through large-scale assessments to find general information about students' language ability. To remove subjectivity, Cognitive Diagnostic Assessment (CDA) has recently played a crucial role in perceiving candidates' latent attribute patterns to find multi-diagnostic information…

Rater variation in performance assessment can impact test-takers' scores and compromise assessments' fairness and validity (Crooks, Kane, & Cohen, 1996). Rater variation can also undermine a test's validity and fairness; therefore, it is important to investigate raters' scoring patterns in order to inform rater training. Substantial work has…

The development of an indirect oral proficiency test for foreign languages by the Defense Language Institute is described. The technique uses taped questions to elicit answers, also taped, that are evaluated according to the Foreign Service Institute's oral proficiency rating scale of 0 to 5. Tape recordings are used because of the large numbers…