This article extends multivariate generalizability theory (MGT) to tests with different random-effects designs for each level of a fixed facet. There are numerous situations in which the design of a test and the resulting data structure are not definable by a single design. One example is mixed-format tests that are composed of multiple-choice and…

Two factors, language difficulty and option set convergence, were experimentally manipulated and their effects on item difficulty assessed. Option convergence was found to have a significant effect on item difficulty while the effect of language difficulty was not significant. (Author/BW)

The relation between incorrect option choice and estimated ability level was examined for two widely used aptitude tests, the Scholastic Aptitude Test, and the Graduate Record Examination. Incorrect option choice was found to be related to estimated ability for many items. Implications of these findings are briefly discussed. (Author)