This paper presents an approach to standard setting that combines the prototype group method (PGM; Eckes, 2012) with a receiver operating characteristic (ROC) analysis. The combined PGM-ROC approach is applied to setting cut scores on a placement test of English as a foreign language (EFL). To implement the PGM, experts first named learners whom…

Surveys the development of language tests toward authenticity and discusses the advantages and disadvantages of indirect and direct (authentic) language tests. Discusses the difficulty of applying appropriate psychometric measures to tests using real-life language, and the large number of tests variables which interfere with the authenticity of…

The present study investigated the effects of reducing the number of options per item on psychometric characteristics of a Japanese EFL university entrance examination. A four-option multiple-choice reading test used for entrance screening at a university in Japan was later converted to a three-option version by eliminating the least frequently…

Compares the empirical performance of C-tests with other representatives of the family of reduced redundancy tests--classical cloze, cloze-elide, multiple-choice cloze--using the Duisburg English Language Test for Advanced Students as the criterion for empirical validity. Findings reveal that the C-Test emerges as the most economical and reliable…