The choice of design parameters (e.g., number of subtests, number of items per subtest, and number of examinees per subtest) can be controlled by the test constructor in a multiple matrix sampling evaluation. The purpose of this study was to determine empirically which combination of the above parameters produces the smallest standard errors of…

Investigated empirically through post mortem item-examinee sampling was the feasibility of the jackknife as a procedure for approximating standard errors of estimate in multiple matrix sampling. The parameters estimated were the mean test score, second through fourth central moments of the test score distribution, and the variance of the item…

Three statistical problems related to criterion-referenced testing are investigated: estimation of the likelihood of a false-positive or false-negative decision with a mastery test, estimation of true scores in the Compound Binomial Error Model, and comparison of the examinees to a control. Two methods for estimating the likelihood of…