The choice of design parameters (e.g., number of subtests, number of items per subtest, and number of examinees per subtest) can be controlled by the test constructor in a multiple matrix sampling evaluation. The purpose of this study was to determine empirically which combination of the above parameters produces the smallest standard errors of…

When performing large scale evaluations (e.g., on a state-wide or national level) it may not be possible to administer all items in the item universe to all respondents in the subject population. One method which has been proposed to sample both items and respondents is multiple matrix sampling (MMS) in which a sample of the items is administered…

Empirical evidence is presented related to the effects of using a stratified sampling of items in multiple matrix sampling on the accuracy of estimates of the population mean. Data were obtained from a sample of 600 high school students for a 36-item mathematics test and a 40-item vocabulary test, both subtests of the Iowa Tests of Educational…