A common approach to needs analysis involves the development of a self-report questionnaire administered to members of the intended audience. Such an approach poses a problem however: Concern for data reliability demands polling as many respondents as possible, while concern for cost-effectiveness dictates minimizing the size of the sample. The…

Investigated empirically through post mortem item-examinee sampling were the relative merits of two alternative procedures for allocating items to subtests in multiple matrix sampling and the feasibility of using the jackknife in approximating standard errors of estimate. The results indicate clearly that a partially balanced incomplete block…

In a post-mortem study of item sampling, 1,050 examinees were divided into ten groups 50 times. Each time, their papers were scored on four different sets of item samples from a 150-item test of academic aptitude. These samples were selected using (a) unstratified random sampling and stratification on (b) content, (c) difficulty, and (d) both.…

Latent partition analysis is shown to be useful in determining the conceptual homogeneity of an item population. Such item populations are useful for mastery testing. Applications of latent partition analysis in assessing content validity are suggested. (Author/JKS)

The most familiar models of item response theory are defined at the level of individual subjects. It is possible, however, to define such models for groups of subjects. This paper discusses group-level item response models, their uses, and their relationships to subject-level models. (Author/JKS)

In this paper consideration is given to the nature of the relationships among items within item forms and how these relationships compare with an ideal case for diagnostic tests in which if a person gets one item within an item form right then he would get all items within the item form correct. (Authors)

Investigated empirically through post mortem item-examinee samplings were the relative merits of two alternative procedures for allocating items to subtests in multiple matrix sampling and the feasibility of using the jackknife in approximating standard errors of estimate. (Editor)

Assesses conditional states of item mastery found among items from different item domains and the effectiveness of various procedures for identifying such conditional relations. Item domains considered were from the curriculum area of multiplication of whole numbers, and were defined by a domain referenced testing system. (Author/RC)

This pamphlet describes the exciting potential of item banking--a new approach to testing which combines both comparability of scores with flexibility of test format. Item banks are collections of items where the characteristics of each item is known and these characteristics can be summated to described a test made from such items. The principle…

This paper briefly discusses the use of item sampling for student evaluation in a summative evaluation context. Its proposition is that item sampling is a means of achieving better and broader student evaluation because it leaves room for individualized evaluation. Item sampling can be implemented properly by associating it to the concept of item…

Comprehensive Achievement Monitoring (CAM), a new evaluation method, systematically and comprehensively measures student achievement. The unique characteristics of this model are described in detail, as are those of two more familiar models, classroom testing, and curriculum program evaluation. The amount and quality of information available from…

This overview of variables lists 17 basic educational outcomes, 13 curricular programs, 7 co-curricular programs, 3 aspects of student behavior sampled by the objectives-referenced test items in the Colorado evaluation project. (For related documents, see TM 003 086, 087.) (KM)

An investigation is conducted which presents extensive Monte Carlo results which indicate the conditions under which a procedure using the F distribution can be used to study the robustness of the confidence interval procedures for small samples. A review of the literature is presented. Procedure uses a binary data matrix. Results indicate that…

The problem of predicting universe scores for samples of examinees based on their responses to samples of items is treated. The measurement model categorizes items according to the cells of a table of test specifications, and the linear function derived for minimizing error variance in prediction uses responses to these categories. (Author/JKS)