Even though the impact of the position of response options on answers to multiple-choice items has been investigated for decades, it remains debated. Research on this topic is inconclusive, perhaps because too few studies have obtained experimental data from large-sized samples in a real-world context and have manipulated the position of both…

Automatic coding of short text responses opens new doors in assessment. We implemented and integrated baseline methods of natural language processing and statistical modelling by means of software components that are available under open licenses. The accuracy of automatic text coding is demonstrated by using data collected in the "Programme…

The multifaceted structure of sentence-completion test items was analyzed to explain verbal comprehension. The three stimulus constituents were technical, logical-semantic, and associative-contextual. Guttman's facet and order theories and smallest space analysis were used. Results confirmed the multiple skills involved in solving these tasks.…