When the basic unit being studied is a grouping of individuals, both students and items can be sampled. When this method is applied to the use of log sheets to measure fidelity of program implementation, the normal limitations of self-reporting are reduced. (BW)

Many academic tests (e.g. short-answer and multiple-choice) sample required knowledge with questions scoring 0 or 1 (dichotomous scoring). Few textbooks give useful guidance on the length of test needed to do this reliably. Posey's binomial error model of 1932 provides the best starting point, but allows neither for heterogeneity of question…

This study examined the psychosocial correlates and psychometric properties of the Self-Assessed Wisdom Scale (SAWS) (Webster, 2003a). Seventy-three men and 98 women ranging in age from 17-92 years (Mean age = 42.77) completed an expanded, 40-item version of the SAWS, the Loyola Generativity Scale, and the Experiences in Close Relationships Scale.…

This study is an a priori demonstration of the applicability of multiple matrix sampling techniques to the practical research problem of parameter estimation. Three tests were administered to two separate but parallel populations, with one receiving item samples and the other receiving full tests. Special efforts were made to minimize the context…

A norm distribution consisting of test scores received by 810 college students on a 150 item dichotomously-scored four-alternative multiple-choice test was empirically estimated through several item-examinee sampling procedures. The post mortem item-sampling investigation was specifically designed to manipulate systematically the variables of…

Multiple matrix sampling is a psychometric procedure in which a set of test items is subdivided randomly into subtests of items with each subtest administered to different subgroups of examinees selected at random from the examinee population. Although each examinee receives only a proportion of the complete set of items, the statistical model…

Investigated empirically through post mortem item-examinee sampling were the relative merits of two alternative procedures for allocating items to subtests in multiple matrix sampling and the feasibility of using the jackknife in approximating standard errors of estimate. The results indicate clearly that a partially balanced incomplete block…

The use of matrix sampling to overcome the impracticality of the pair comparison method for obtaining scale values is empirically tested. Results indicate that matrix sampling is useful in such applications. (Author/JKS)

The approach to outcome research described here has the double merit of preserving individuality and permitting pooling of data for overall analysis of results. (Author)

The assumption that an examinee's response to an item is independent of the context in which it occurs is tested. (PR)

The effect of stratified sampling of items based on item difficulty and/or interitem correlations on the estimation of test score distribution parameters using multiple matrix sampling was studied. Results indicated that stratification did not consistently improve the stability of parameter estimation. (Author/JKS)

Several techniques exist to automatically put together a test meeting a number of specifications. In an item bank, the items are stored with their characteristics. A test is constructed by selecting a set of items that fulfills the specifications set by the test assembler. Test assembly problems are often formulated in terms of a model consisting…