A reverse engineering approach to automatic item generation (AIG) was applied to a figure-based publicly released test item from the Organisation for Economic Cooperation and Development (OECD) Programme for International Student Assessment (PISA) mathematical literacy cognitive instrument as part of a proof of concept. The author created an item…

Companies acquire personal information from phone, World Wide Web, or email in order to sell or send an advertisement about their product. However, when this information is acquired, moved, copied or edited, the data may loose its quality. Often, the use of data administrators or a tool that has limited capabilities to correct the mistyped…

P. Maguire, B. Devereux, F. Costello, and A. Cater discussed the Gagne and Shoben (1997) CARIN theory of conceptual combination and, after presenting a sample drawn from the British National Corpus and comparing the two corpora, concluded that the Gagne and Shoben corpus is too small and unrepresentative. They then discussed the mathematical model…

A model for multiple choice test-taking behavior is proposed which is different from those presently used for item sampling theory. A new theory is developed, which includes a new concept to facilitate comprehension of item sampling theory, a "number-known" score distribution. A major advantage of the model is that it accommodates data from…

This paper considers estimation of parameters for a model currently being used to study the Illinois Interlibrary Loan Network (ILLINET) and presents a method for determining how much data should be collected and how it should be aggregated. Four classes of model parameters discussed: demands, probabilities of success, processing times, and…

Investigates implications for finite and known item populations for classical test theory, and the alpha coefficient among items in paper-and-pencil testing. (Author/AG)

Multiple matrix sampling is a psychometric procedure in which a set of test items is subdivided randomly into subtests of items with each subtest administered to different subgroups of examinees selected at random from the examinee population. Although each examinee receives only a proportion of the complete set of items, the statistical model…

A rederivation of Lord's formula for estimating variance in multiple matrix sampling is presented as well as the ways Cronbach's coefficient alpha and the Spearman-Brown prophecy formula are related in this context. (Author/JKS)

The most familiar models of item response theory are defined at the level of individual subjects. It is possible, however, to define such models for groups of subjects. This paper discusses group-level item response models, their uses, and their relationships to subject-level models. (Author/JKS)

A method based on the Poisson approximation to the binomial distribution and on the relation between the Chi-Squared distribution and the Poisson distribution is suggested for selected use in determining the number of items and passing scores in mastery Lests. (Author/RL)

The problem of obtaining designs that result in the most precise parameter estimates is encountered in at least two situations where item response theory (IRT) models are used. In so-called two-stage testing procedures, certain designs that match difficulty levels of the test items with the ability of the examinees may be located. Such designs…

These results indicate that in deciding on the data-gathering design to be used in seeking norm information, attention should be given to item characteristics and test length with particular attention paid to the range of biserial correlations between item response and ability. (Author)

The suitability of the beta binomial test model for criterion referenced testing was investigated, first by considering whether underlying assumptions are realistic, and second, by examining the robustness of the model. Results suggest that the model may have practical value. (Author/RD)

The present study compared six methods, two of which utilize the content structure of items, to estimate total-test scores using 450 students and 60 items of the 110-item Stanford Mental Arithmetic Test. Three methods yielded fairly good estimates of the total-test score. (Author/RL)