Experimental psychology is witnessing an increase in research on individual differences, which requires the development of new tasks that can reliably assess variations among participants. To do this, cognitive researchers need statistical methods that many researchers have not learned during their training. The lack of expertise can pose…

Results indicate that scale values can be approximated satisfactorily through item-examinee sampling. Defining one observation as the response made by one examinee to one item, the similarity between the estimated scale values and normative scale values increased generally with increases in the number of observations acquired by the sampling plan.…

A model for multiple choice test-taking behavior is proposed which is different from those presently used for item sampling theory. A new theory is developed, which includes a new concept to facilitate comprehension of item sampling theory, a "number-known" score distribution. A major advantage of the model is that it accommodates data from…

A norm distribution consisting of test scores received by 810 college students on a 150 item dichotomously-scored four-alternative multiple-choice test was empirically estimated through several item-examinee sampling procedures. The post mortem item-sampling investigation was specifically designed to manipulate systematically the variables of…

In a post mortem study, it is demonstrated that linear prediction is as effective as computing a negative hyper-geometric distribution for estimating test norms following matrix sampling from a total test with a highly skewed score distribution, provided the same prediction coefficient is used for all examinee groups. It is also demonstrated…

These results indicate that in deciding on the data-gathering design to be used in seeking norm information, attention should be given to item characteristics and test length with particular attention paid to the range of biserial correlations between item response and ability. (Author)

A test of mental arithmetic skills was developed and normed for children in grades one to six. Statistical techniques were used to predict the probability correct for each item and to rank order the items. Students in a given grade took only one level of the test and inferences were made of their performance on those tests which they did not take.…

When norming tests, it may be preferable to use the matrix sampling technique. The results from the samples may be used to estimate what the distribution of scores would have been if each subject had taken all the items. This paper compares four methods for making these estimates. The sample size made it possible to compare the techniques in a…

The concept of tailored testing for individuals is applied to the construction of tests for special groups and extended to apply to item content as well as item difficulty. It is suggested that evaluators may decide to construct tests on the basis of a unique combination of items drawn from an item bank to fit the need of a particular group. At…

An achievement testing framework is being developed by the Los Angeles Unified School District to assess the educational progress of 14,000 secondary level compensatory education students with something other than standardized tests. The technique of multiple matrix sampling was applied to the use of large item domains in the subject area of…