The administrative and political ramifications of a form of multiple matrix sampling where all students in the population are tested on a subtest is discussed in the context of a statewide testing program. The conclusion is drawn that large-scale testing programs will have to adopt a testing framework which samples items from the total item domain…

Results indicate that scale values can be approximated satisfactorily through item-examinee sampling. Defining one observation as the response made by one examinee to one item, the similarity between the estimated scale values and normative scale values increased generally with increases in the number of observations acquired by the sampling plan.…

Described herein are formulas and computational procedures for estimating the mean and second through fourth central moments of universe scores through multiple matrix sampling. Additionally, procedures are given for approximating the standard error associated with each estimate. All procedures are applicable when items are scored either…

A norm distribution consisting of test scores received by 810 college students on a 150 item dichotomously-scored four-alternative multiple-choice test was empirically estimated through several item-examinee sampling procedures. The post mortem item-sampling investigation was specifically designed to manipulate systematically the variables of…

Multiple matrix sampling is a psychometric procedure in which a set of test items is subdivided randomly into subtests of items with each subtest administered to different subgroups of examinees selected at random from the examinee population. Although each examinee receives only a proportion of the complete set of items, the statistical model…

Investigated empirically through post mortem item-examinee sampling were the relative merits of two alternative procedures for allocating items to subtests in multiple matrix sampling and the feasibility of using the jackknife in approximating standard errors of estimate. The results indicate clearly that a partially balanced incomplete block…

Investigated empirically through post mortem item-examinee sampling was the feasibility of the jackknife as a procedure for approximating standard errors of estimate in multiple matrix sampling. The parameters estimated were the mean test score, second through fourth central moments of the test score distribution, and the variance of the item…

Selected parameters for a negatively-skewed and a normally distributed normative distribution were estimated in a post-mortem item-examinee sampling investigation. Manipulated systematically were number of subtests, number of items per subtest, and number of examinees responding to each subtest. Each item-examinee sampling procedure was replicated…

Investigated empirically through post mortem item-examinee sampling were the relative merits of two alternative procedures for allocating items to subtests in multiple matrix sampling and the feasibility of using the jackknife in approximating standard errors of estimate. The results indicate clearly that a partially balanced incomplete block…

Investigated empirically through post mortem item-examinee samplings were the relative merits of two alternative procedures for allocating items to subtests in multiple matrix sampling and the feasibility of using the jackknife in approximating standard errors of estimate. (Editor)

When evaluating the effectiveness of an educational program, multiple matrix sampling is particularly effective and efficient when the goal of the evaluation is estimating group (as opposed to individual) performance. The technique is described in some detail, with its advantages and disadvantages, and examples of its application are given.…