This paper reviews the literature about item response models for the subject level and aggregated level (group level). Group-level item response models (IRMs) are used in the United States in large-scale assessment programs such as the National Assessment of Educational Progress and the California Assessment Program. In the Netherlands, these…

A variety of locally dependent models are introduced having individual difference parameters that may be interpreted as reflecting effective learning abilities. One version is a univariate extension of the Rasch model with a Markov property: the probability that a given individual will pass an item depends on previous items only through the…

The decision making processes of children in a probabilistic environment were studied within the context of the theory of signal detection (TSD). The relationship between the age of the child and his ability to revise decision criteria was examined, as well as the appropriateness of TSD measures and methodology with children. It was hypothesized…

Standard procedures for estimating item parameters in Item Response Theory models make no use of auxiliary information about test items, such as their format or content, or the skills they require for solution. This paper describes a framework for exploiting this information, thereby enhancing the precision and stability of item parameter…

Tailored testing provides the same information as group-administered standardized tests, but can do so using fewer items because the items administered are selected for the ability of the individual student. Thus, tailored testing offers several advantages over traditional methods. Because individual tailored tests are not timed, anxiety is…

The technical problems involved in obtaining Bayesian model estimates for the regression parameters in m similar groups are studied. The available computer programs, BPREP (BASIC), and BAYREG, both written in FORTRAN, require an amount of computer processing that does not encourage regular use. These programs are analyzed so that the performance…

A large number of seemingly diverse coefficients have been proposed as indices of dependability, or reliability, for domain-referenced and/or mastery tests. In this paper, it is shown that most of these indices are special cases of two generalized indices of agreement: one that is corrected for chance, and one that is not. The special cases of…

The Multi-Attribute Utilities Theory (MAUT), a model for the evaluation of public postsecondary programs, is presented and is applied to a study of WINNERS (Women's Inner-City Educational Resources Service) with an analysis of the effects of the model on the program. The first chapter provides an overview of the MAUT approach, outlining 16 steps…

The assumptions of the Criterion-Referenced Test (CRT) model proposed by Kriewall are compared to those of Emrick and Adam's Mastery-Learning (ML) model. Testing, in the context of instructional management, serves three general purposes: performance evaluation (achievement of objectives), placement (classification of students for instruction), and…

A Markov model for predicting performance on criterion-referenced tests is presented,. The model is expressed mathematically as a function of transition matrix, a current state vector, and a future state vector. The matrix is defined in terms of conditional probabilities, i.e., the probability of making a transition to a specific future…

Summarizing work which is part of an Army research program on Methodological Issues in the Construction of Criterion Referenced Tests, the focus of this paper is on a Bayesian model, which gives the probability of correctly classifying an examiner as a master or as a nonmaster while taking into consideration the test length and the mastery cut-off…

Compares classical multiple regression with Bayesian m-group regression, including cross-validation of both methods, in a study to predict first-quarter grade point average in various curricula for community colleges students who had completed developmental studies programs. Finds informal counselor prediction the largest contribution to…

With the increased use of computerized adaptive testing, which allows for continuous testing, new concerns about test security have evolved, one being the assurance that items in an item pool are safeguarded from theft. In this paper, the risk of score inflation and procedures to detect test takers using item preknowledge are explored. When test…

The results of a series of simulation studies designed to investigate the influence of guessing and item pool characteristics on the bias, accuracy, and information properties of the trait estimates derived from Owen's Bayesian sequential testing strategy are reported. (RC)

Effects of dimensionality on ability estimation of an adaptive test were examined using generated data in Bayesian computerized adaptive testing (CAT) simulations. Generally, increasing interdimensional difficulty association produced a slight decrease in test length and an increase in accuracy of ability estimation as assessed by root mean square…